[2025-10-13T17:00:02.028993] [INFO ] [MAIN ] Using last completed trading day: 2025-10-13 [2025-10-13T17:00:02.206628] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-13T17:00:02.206825] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-13T17:00:02.510685] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-13T17:00:02.512086] [WARN ] [STATE ] State set to: RUNNING [2025-10-13T17:00:02.512173] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-13T17:00:02.512223] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-13T17:00:02.512549] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-13T17:00:02.512611] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-13T17:00:03.434615] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-13T17:00:03.434769] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-13T17:00:03.434962] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-13T17:00:03.435448] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-13T17:00:03.435517] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-13T17:00:03.435561] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-13T17:00:03.435617] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-13T17:00:03.435683] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-13T17:00:03.435766] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-13T17:00:03.436129] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-13T17:00:03.436163] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-13T17:00:03.436318] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-13T17:00:03.436349] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-13T17:00:03.436379] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-13T17:00:03.436408] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-13T17:00:03.443188] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/PHD.csv (symbol PHD no longer active). [2025-10-13T17:00:03.458505] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/JEQ.csv (symbol JEQ no longer active). [2025-10-13T17:00:03.460121] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-13T17:00:03.466236] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/PHD.csv (symbol PHD no longer active). [2025-10-13T17:00:03.480404] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/JEQ.csv (symbol JEQ no longer active). [2025-10-13T17:00:03.482000] [INFO ] [LOCAL ] Deleted 4 obsolete data files. [2025-10-13T17:00:03.482054] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-13T17:00:03.482086] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-13T17:00:03.482113] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-13T17:00:03.482163] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-13T17:00:03.482498] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-13T17:00:03.482530] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-13T17:00:03.482559] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-10-13T17:00:03.482586] [INFO ] [MAIN ] Running in parallel mode [2025-10-13T17:00:03.482761] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-10-13T17:00:04.206478] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:04.200505] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:04.206882] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-13T17:00:04.204689] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:04.225467] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-13T17:00:04.242467] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-13T17:00:04.246742] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-13T17:00:04.246983] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-13T17:00:04.248487] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-13T17:00:04.247125] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-13T17:00:04.248232] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:04.249537] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-13T17:00:04.249756] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-13T17:00:04.249689] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-13T17:00:04.256492] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-13T17:00:04.256921] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-13T17:00:04.908383] [DEBUG] [LOCAL ] A: Loaded 51489 existing records from primary storage. [2025-10-13T17:00:04.907177] [DEBUG] [LOCAL ] AA: Loaded 54400 existing records from primary storage. [2025-10-13T17:00:04.951029] [INFO ] [MAIN ] AA: Loaded 54400 existing records. [2025-10-13T17:00:04.956378] [INFO ] [MAIN ] A: Loaded 51489 existing records. [2025-10-13T17:00:05.081941] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:05.202986] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:05.217798] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-13T17:00:05.263298] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-13T17:00:05.488496] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:05.495572] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-13T17:00:05.495505] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:05.495712] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-13T17:00:05.495943] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-13T17:00:05.496084] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-13T17:00:05.496696] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-13T17:00:05.496773] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-13T17:00:05.528623] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-13T17:00:05.566530] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-13T17:00:05.699234] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:00:05.702979] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-13T17:00:05.724418] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:00:05.753841] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-13T17:00:05.759100] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:00:05.793870] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-13T17:00:05.831230] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-13T17:00:05.896937] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-13T17:00:05.933328] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-13T17:00:05.938577] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 2.4s. Estimated remaining: 1h 37m 1s. Rate: 24.4 symbols/min [2025-10-13T17:00:06.226914] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-13T17:00:06.242706] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-13T17:00:06.321142] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:06.366983] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-13T17:00:06.441086] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:06.465925] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:06.463872] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-13T17:00:06.526850] [DEBUG] [LOCAL ] AAP: Loaded 52653 existing records from primary storage. [2025-10-13T17:00:06.527168] [INFO ] [MAIN ] AAP: Loaded 52653 existing records. [2025-10-13T17:00:06.705949] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T17:00:06.705845] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:06.707023] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-13T17:00:06.707865] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-13T17:00:06.707923] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-13T17:00:06.708449] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-13T17:00:06.708535] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-13T17:00:07.055995] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:07.056309] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-13T17:00:07.105035] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-13T17:00:07.105949] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-13T17:00:07.451638] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-13T17:00:07.452523] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-13T17:00:07.804427] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-13T17:00:07.805481] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-13T17:00:08.044611] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T17:00:08.055339] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-13T17:00:08.067474] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-13T17:00:08.068395] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-13T17:00:08.115790] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T17:00:08.125506] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-13T17:00:08.410253] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T17:00:08.411153] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-13T17:00:08.716782] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-13T17:00:08.718218] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-13T17:00:09.051589] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-13T17:00:09.067975] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-13T17:00:09.121438] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-13T17:00:09.126479] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-13T17:00:09.424719] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-13T17:00:09.426874] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-13T17:00:09.577336] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:00:09.587426] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-13T17:00:09.816916] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-13T17:00:09.817622] [INFO ] [REMOTE ] AAM: Full fetch complete (940 records). [2025-10-13T17:00:09.817720] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-13T17:00:10.019076] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-13T17:00:10.019359] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:00:10.019431] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:00:10.019484] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-13T17:00:10.019542] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-13T17:00:10.019578] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-13T17:00:10.019619] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-13T17:00:10.019719] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 6.5s. Estimated remaining: 2h 9m 3s. Rate: 18.4 symbols/min [2025-10-13T17:00:10.202740] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:10.232444] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-13T17:00:10.243238] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-13T17:00:10.272345] [DEBUG] [LOCAL ] AAT: Loaded 30722 existing records from primary storage. [2025-10-13T17:00:10.272604] [INFO ] [MAIN ] AAT: Loaded 30722 existing records. [2025-10-13T17:00:10.461690] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:10.461976] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-13T17:00:10.462038] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-13T17:00:10.462410] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-13T17:00:10.462466] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-13T17:00:10.823314] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:10.823727] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-13T17:00:10.851097] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T17:00:10.861222] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-13T17:00:11.166201] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T17:00:11.175609] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-13T17:00:11.637790] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T17:00:11.643519] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-13T17:00:12.411343] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-13T17:00:12.422449] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-13T17:00:12.467723] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-13T17:00:12.473437] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-13T17:00:12.625357] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T17:00:12.635337] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-13T17:00:13.449347] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-13T17:00:13.463041] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-13T17:00:14.292227] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T17:00:14.298417] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-13T17:00:14.380392] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T17:00:14.391614] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-13T17:00:14.420409] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:00:14.431863] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-13T17:00:15.038816] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T17:00:15.049908] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-13T17:00:15.171814] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T17:00:15.178373] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-13T17:00:15.941112] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:00:15.953715] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-13T17:00:16.317723] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T17:00:16.329683] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-13T17:00:16.743066] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T17:00:16.750996] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-13T17:00:16.915703] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T17:00:16.926562] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-13T17:00:17.957426] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T17:00:17.969053] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-13T17:00:18.098461] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T17:00:18.110255] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-13T17:00:18.154458] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T17:00:18.161016] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-13T17:00:18.490393] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:00:18.500430] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-13T17:00:19.423316] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T17:00:19.422845] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T17:00:19.440586] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-13T17:00:19.440905] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-13T17:00:19.879881] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T17:00:19.891727] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-13T17:00:20.105529] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T17:00:20.117374] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-13T17:00:20.907049] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T17:00:20.915585] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-13T17:00:21.390464] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T17:00:21.404867] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-13T17:00:21.884459] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T17:00:21.899130] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-13T17:00:21.944902] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T17:00:21.956156] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-13T17:00:21.994165] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T17:00:22.000623] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-13T17:00:23.076072] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T17:00:23.084152] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-13T17:00:23.116217] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T17:00:23.130287] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-13T17:00:23.387719] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T17:00:23.414813] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-13T17:00:23.427043] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T17:00:23.437952] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-13T17:00:24.424132] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T17:00:24.427528] [INFO ] [REMOTE ] AAT: Full fetch complete (42491 records). [2025-10-13T17:00:24.427615] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-13T17:00:24.428246] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:00:24.428334] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:00:24.428376] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:00:24.428414] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-13T17:00:24.428475] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-13T17:00:24.428510] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-10-13T17:00:24.428694] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-10-13T17:00:24.429374] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAT took 14.4s. Estimated remaining: 4h 35m 34s. Rate: 8.6 symbols/min [2025-10-13T17:00:24.604740] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:24.605081] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-13T17:00:24.605168] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-13T17:00:24.605279] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-13T17:00:24.605323] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-13T17:00:24.605390] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-13T17:00:24.605462] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-13T17:00:25.007397] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:25.004198] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T17:00:25.017701] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-13T17:00:25.031549] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T17:00:25.037189] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-13T17:00:25.037626] [INFO ] [REMOTE ] A: Full fetch complete (72802 records). [2025-10-13T17:00:25.038525] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-13T17:00:25.040814] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:00:25.041228] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:00:25.041299] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:00:25.041366] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-13T17:00:25.041428] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-13T17:00:25.041463] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-10-13T17:00:25.041600] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-10-13T17:00:25.042168] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. A took 21.6s. Estimated remaining: 3h 32m 38s. Rate: 11.1 symbols/min [2025-10-13T17:00:25.193510] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T17:00:25.265382] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-13T17:00:25.267762] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:25.269180] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-10-13T17:00:25.269232] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-10-13T17:00:25.269367] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-13T17:00:25.269410] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-13T17:00:25.269452] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-13T17:00:25.269485] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-13T17:00:25.293046] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:00:25.332788] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-13T17:00:25.348327] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:00:25.365242] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-13T17:00:25.384637] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:00:25.387280] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-13T17:00:25.387850] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-13T17:00:25.393442] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-13T17:00:25.398714] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-13T17:00:25.409057] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAUC took 1.0s. Estimated remaining: 2h 52m 56s. Rate: 13.7 symbols/min [2025-10-13T17:00:25.792130] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:25.826042] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:25.826569] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-13T17:00:25.880762] [DEBUG] [LOCAL ] ABBV: Loaded 54466 existing records from primary storage. [2025-10-13T17:00:25.881097] [INFO ] [MAIN ] ABBV: Loaded 54466 existing records. [2025-10-13T17:00:26.053091] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:26.053326] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-13T17:00:26.053382] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-13T17:00:26.054815] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-13T17:00:26.054875] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-13T17:00:26.408124] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:26.408513] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-13T17:00:26.449187] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T17:00:26.455416] [INFO ] [REMOTE ] AAP: Full fetch complete (75038 records). [2025-10-13T17:00:26.455542] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-13T17:00:26.838165] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-13T17:00:26.838259] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-13T17:00:26.839260] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-13T17:00:26.839347] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-13T17:00:26.842000] [DEBUG] [LOCAL ] AAP: Trimmed 75038 records to 51899 (keeping 200 days of data) [2025-10-13T17:00:27.207074] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:00:27.217507] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-13T17:00:27.222429] [DEBUG] [LOCAL ] AAP: Primary data saved (51899 records). [2025-10-13T17:00:27.222753] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-13T17:00:27.223351] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AAP took 21.2s. Estimated remaining: 2h 35m 58s. Rate: 15.2 symbols/min [2025-10-13T17:00:27.398576] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:27.413712] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-13T17:00:27.420202] [INFO ] [REMOTE ] AA: Full fetch complete (77552 records). [2025-10-13T17:00:27.420330] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-13T17:00:27.706939] [DEBUG] [LOCAL ] ABCB: Loaded 30965 existing records from primary storage. [2025-10-13T17:00:27.723592] [INFO ] [MAIN ] ABCB: Loaded 30965 existing records. [2025-10-13T17:00:28.009602] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-13T17:00:28.031362] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-13T17:00:28.031250] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:28.033407] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-13T17:00:28.033695] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-13T17:00:28.033307] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-13T17:00:28.033925] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-13T17:00:28.034382] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-13T17:00:28.034463] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-13T17:00:28.117685] [DEBUG] [LOCAL ] AA: Trimmed 77552 records to 53621 (keeping 200 days of data) [2025-10-13T17:00:28.628361] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:28.632584] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-13T17:00:28.750162] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:00:28.752210] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-13T17:00:28.770808] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-13T17:00:28.775992] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-13T17:00:28.793608] [DEBUG] [LOCAL ] AA: Primary data saved (53621 records). [2025-10-13T17:00:28.793737] [INFO ] [MAIN ] AA: Full history saved. [2025-10-13T17:00:28.794049] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AA took 25.3s. Estimated remaining: 2h 22m 28s. Rate: 16.6 symbols/min [2025-10-13T17:00:28.962341] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:29.011544] [DEBUG] [LOCAL ] ABEV: Loaded 54056 existing records from primary storage. [2025-10-13T17:00:29.011946] [INFO ] [MAIN ] ABEV: Loaded 54056 existing records. [2025-10-13T17:00:29.185420] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:29.185679] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-13T17:00:29.185736] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-13T17:00:29.186165] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-13T17:00:29.186221] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-13T17:00:29.584519] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:29.584945] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-13T17:00:29.881228] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T17:00:29.887162] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-13T17:00:30.114312] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T17:00:30.122868] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-13T17:00:30.868120] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-13T17:00:30.896152] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-13T17:00:30.898287] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T17:00:30.904976] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-13T17:00:31.223079] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T17:00:31.235716] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-13T17:00:31.756166] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T17:00:31.765804] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-13T17:00:32.209144] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T17:00:32.215322] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-13T17:00:32.783972] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-13T17:00:32.795874] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-13T17:00:32.866373] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:00:32.877405] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-13T17:00:33.302450] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T17:00:33.311196] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-13T17:00:33.558233] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T17:00:33.565470] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-13T17:00:34.324978] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T17:00:34.331235] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-13T17:00:34.657447] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T17:00:34.667320] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-13T17:00:34.767261] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T17:00:34.778430] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-13T17:00:34.973777] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T17:00:34.981813] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-13T17:00:35.186032] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T17:00:35.190771] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-13T17:00:36.187213] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-13T17:00:36.193881] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-13T17:00:36.234810] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:00:36.245988] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-13T17:00:36.260093] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T17:00:36.265838] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-13T17:00:37.130555] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-13T17:00:37.145172] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-13T17:00:37.266026] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T17:00:37.271716] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-13T17:00:37.443544] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T17:00:37.450165] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-13T17:00:38.222599] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T17:00:38.234327] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-13T17:00:38.589870] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T17:00:38.597308] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-13T17:00:38.626757] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T17:00:38.632979] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-13T17:00:39.108885] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T17:00:39.120168] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-13T17:00:39.467684] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T17:00:39.474247] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-13T17:00:39.672367] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:00:39.675109] [INFO ] [REMOTE ] AB: Full fetch complete (44613 records). [2025-10-13T17:00:39.675196] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-13T17:00:40.057119] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-13T17:00:40.057222] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-13T17:00:40.057694] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-13T17:00:40.057773] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-13T17:00:40.085733] [DEBUG] [LOCAL ] AB: Trimmed 44613 records to 25789 (keeping 200 days of data) [2025-10-13T17:00:40.087487] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T17:00:40.189573] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-13T17:00:40.256522] [DEBUG] [LOCAL ] AB: Primary data saved (25789 records). [2025-10-13T17:00:40.256688] [INFO ] [MAIN ] AB: Full history saved. [2025-10-13T17:00:40.256780] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 15.2s. Estimated remaining: 3h 1m 2s. Rate: 13.1 symbols/min [2025-10-13T17:00:40.421489] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:40.439736] [DEBUG] [LOCAL ] ABG: Loaded 18707 existing records from primary storage. [2025-10-13T17:00:40.440007] [INFO ] [MAIN ] ABG: Loaded 18707 existing records. [2025-10-13T17:00:40.617529] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:40.617764] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-13T17:00:40.617816] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-13T17:00:40.618027] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-13T17:00:40.618083] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-13T17:00:40.981166] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:40.981710] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-13T17:00:41.001265] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T17:00:41.008889] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-13T17:00:41.038442] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T17:00:41.049831] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-13T17:00:41.738941] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T17:00:41.742526] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-13T17:00:42.284163] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-13T17:00:42.294851] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-13T17:00:42.477615] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T17:00:42.481227] [INFO ] [REMOTE ] ABCB: Full fetch complete (44647 records). [2025-10-13T17:00:42.481318] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-13T17:00:42.878625] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-13T17:00:42.879355] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-13T17:00:42.880258] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-13T17:00:42.880672] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-13T17:00:42.892902] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T17:00:42.897837] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-13T17:00:42.899405] [DEBUG] [LOCAL ] ABCB: Trimmed 44647 records to 30598 (keeping 200 days of data) [2025-10-13T17:00:43.032708] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T17:00:43.055385] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-13T17:00:43.148204] [DEBUG] [LOCAL ] ABCB: Primary data saved (30598 records). [2025-10-13T17:00:43.148393] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-13T17:00:43.148486] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 15.9s. Estimated remaining: 2h 53m 30s. Rate: 13.6 symbols/min [2025-10-13T17:00:43.325110] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:43.354964] [DEBUG] [LOCAL ] ABM: Loaded 32404 existing records from primary storage. [2025-10-13T17:00:43.355242] [INFO ] [MAIN ] ABM: Loaded 32404 existing records. [2025-10-13T17:00:43.529713] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:43.529911] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-13T17:00:43.529990] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-13T17:00:43.530449] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-13T17:00:43.530508] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-13T17:00:43.889434] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:43.890120] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-13T17:00:44.084295] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T17:00:44.081046] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:00:44.101270] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-13T17:00:44.103079] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-13T17:00:44.848291] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-13T17:00:44.854391] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-13T17:00:45.123838] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-13T17:00:45.150342] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-13T17:00:45.150868] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T17:00:45.157110] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-13T17:00:45.948466] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T17:00:45.960903] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-13T17:00:46.008942] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T17:00:46.015855] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-13T17:00:46.153157] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T17:00:46.159347] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-13T17:00:46.816752] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T17:00:46.822539] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-13T17:00:47.152722] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T17:00:47.156351] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-13T17:00:47.202895] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-13T17:00:47.214811] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-13T17:00:47.535625] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T17:00:47.548202] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-13T17:00:47.845526] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T17:00:47.849569] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-13T17:00:47.918095] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T17:00:47.924813] [INFO ] [REMOTE ] ABBV: Full fetch complete (77722 records). [2025-10-13T17:00:47.925034] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-13T17:00:48.373203] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-13T17:00:48.373409] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-13T17:00:48.374180] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-13T17:00:48.374313] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-13T17:00:48.404893] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T17:00:48.405058] [DEBUG] [LOCAL ] ABBV: Trimmed 77722 records to 53686 (keeping 200 days of data) [2025-10-13T17:00:48.413683] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-13T17:00:48.750865] [DEBUG] [LOCAL ] ABBV: Primary data saved (53686 records). [2025-10-13T17:00:48.751034] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-13T17:00:48.751119] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABBV took 23.3s. Estimated remaining: 2h 58m 8s. Rate: 13.3 symbols/min [2025-10-13T17:00:48.927016] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:48.940291] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T17:00:48.945301] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-13T17:00:48.993942] [DEBUG] [LOCAL ] ABR: Loaded 52712 existing records from primary storage. [2025-10-13T17:00:48.994263] [INFO ] [MAIN ] ABR: Loaded 52712 existing records. [2025-10-13T17:00:49.169236] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:49.169567] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-13T17:00:49.169635] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-13T17:00:49.170314] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-13T17:00:49.170372] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-13T17:00:49.516014] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-13T17:00:49.566124] [INFO ] [REMOTE ] ABEV: Full fetch complete (77216 records). [2025-10-13T17:00:49.567590] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-13T17:00:49.595805] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:49.654628] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-13T17:00:49.993995] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-13T17:00:49.994359] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-13T17:00:49.995548] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-13T17:00:49.995833] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-13T17:00:50.016500] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T17:00:50.025253] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-13T17:00:50.025524] [DEBUG] [LOCAL ] ABEV: Trimmed 77216 records to 53279 (keeping 200 days of data) [2025-10-13T17:00:50.040136] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T17:00:50.100528] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-13T17:00:50.357161] [DEBUG] [LOCAL ] ABEV: Primary data saved (53279 records). [2025-10-13T17:00:50.357364] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-13T17:00:50.358741] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABEV took 21.6s. Estimated remaining: 2h 47m 37s. Rate: 14.1 symbols/min [2025-10-13T17:00:50.533776] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:50.534032] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-10-13T17:00:50.534072] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-10-13T17:00:50.534198] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-13T17:00:50.534240] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-13T17:00:50.534281] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-13T17:00:50.534315] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-13T17:00:50.907896] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:50.909198] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-13T17:00:50.927557] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T17:00:50.931981] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-13T17:00:51.289798] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T17:00:51.295841] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-13T17:00:51.631506] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T17:00:51.641931] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-13T17:00:51.647955] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T17:00:51.649985] [INFO ] [REMOTE ] ABG: Full fetch complete (26602 records). [2025-10-13T17:00:51.650070] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-13T17:00:52.034102] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-13T17:00:52.034210] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-13T17:00:52.034637] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-13T17:00:52.034733] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-13T17:00:52.035550] [DEBUG] [LOCAL ] ABG: Trimmed 26602 records to 18555 (keeping 200 days of data) [2025-10-13T17:00:52.148254] [DEBUG] [LOCAL ] ABG: Primary data saved (18555 records). [2025-10-13T17:00:52.148461] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-13T17:00:52.148568] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABG took 11.9s. Estimated remaining: 2h 39m 27s. Rate: 14.8 symbols/min [2025-10-13T17:00:52.346206] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:52.346541] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-13T17:00:52.346621] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-13T17:00:52.346944] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-13T17:00:52.347007] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-13T17:00:52.347154] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-13T17:00:52.347221] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-13T17:00:52.618724] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T17:00:52.677224] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-13T17:00:52.788913] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:52.789483] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-13T17:00:52.860943] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T17:00:52.872329] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-13T17:00:53.328354] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T17:00:53.338480] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-13T17:00:53.666044] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-13T17:00:53.673263] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-13T17:00:53.936085] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T17:00:53.940905] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-13T17:00:54.756347] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T17:00:54.767363] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-13T17:00:54.810563] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T17:00:54.818481] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-13T17:00:54.939725] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T17:00:54.949782] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-13T17:00:55.066536] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T17:00:55.071715] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-13T17:00:55.920617] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T17:00:55.925749] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-13T17:00:56.431110] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T17:00:56.442117] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-13T17:00:56.595348] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-13T17:00:56.607591] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-13T17:00:56.861239] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T17:00:56.869547] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-13T17:00:56.905996] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T17:00:56.917229] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-13T17:00:57.703554] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:00:57.713306] [INFO ] [REMOTE ] ABM: Full fetch complete (44792 records). [2025-10-13T17:00:57.714152] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-13T17:00:58.101114] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-13T17:00:58.101721] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-13T17:00:58.102281] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-13T17:00:58.102600] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-13T17:00:58.104371] [DEBUG] [LOCAL ] ABM: Trimmed 44792 records to 32067 (keeping 200 days of data) [2025-10-13T17:00:58.218885] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T17:00:58.230877] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-13T17:00:58.276074] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T17:00:58.290301] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-13T17:00:58.372163] [DEBUG] [LOCAL ] ABM: Primary data saved (32067 records). [2025-10-13T17:00:58.372321] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-13T17:00:58.372404] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 15.2s. Estimated remaining: 2h 45m 56s. Rate: 14.2 symbols/min [2025-10-13T17:00:58.538512] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:00:58.571430] [DEBUG] [LOCAL ] ACCO: Loaded 37612 existing records from primary storage. [2025-10-13T17:00:58.571732] [INFO ] [MAIN ] ACCO: Loaded 37612 existing records. [2025-10-13T17:00:58.751267] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:00:58.751516] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-13T17:00:58.751565] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-13T17:00:58.752157] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-13T17:00:58.752217] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-13T17:00:59.106149] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:00:59.106739] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-13T17:00:59.141426] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-13T17:00:59.153917] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-13T17:00:59.228592] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T17:00:59.234030] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-13T17:00:59.965121] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T17:00:59.978408] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-13T17:01:00.289738] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T17:01:00.417923] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-13T17:01:00.765450] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:01:01.224520] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-13T17:01:01.230936] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T17:01:01.270091] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-13T17:01:01.774143] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T17:01:02.017970] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-13T17:01:02.237260] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T17:01:02.817954] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-13T17:01:03.617922] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-13T17:01:04.039920] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T17:01:04.141534] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-13T17:01:04.417934] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-13T17:01:05.217902] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-13T17:01:05.565154] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T17:01:06.017927] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-13T17:01:06.479856] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T17:01:06.562470] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T17:01:06.817947] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-13T17:01:07.623068] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-13T17:01:07.639412] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T17:01:07.873306] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-13T17:01:08.417906] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-13T17:01:08.437065] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T17:01:09.217937] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-13T17:01:09.954479] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T17:01:10.017940] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-13T17:01:10.033928] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T17:01:10.036496] [INFO ] [REMOTE ] ACA: Full fetch complete (34093 records). [2025-10-13T17:01:10.036578] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-13T17:01:10.468047] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-13T17:01:10.468194] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-13T17:01:10.468694] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-13T17:01:10.468762] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-13T17:01:10.470206] [DEBUG] [LOCAL ] ACA: Trimmed 34093 records to 23039 (keeping 200 days of data) [2025-10-13T17:01:10.618034] [DEBUG] [LOCAL ] ACA: Primary data saved (23039 records). [2025-10-13T17:01:10.618167] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-13T17:01:10.618242] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 18.5s. Estimated remaining: 3h 8m 23s. Rate: 12.5 symbols/min [2025-10-13T17:01:10.786606] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:10.813298] [DEBUG] [LOCAL ] ACEL: Loaded 27037 existing records from primary storage. [2025-10-13T17:01:10.813550] [INFO ] [MAIN ] ACEL: Loaded 27037 existing records. [2025-10-13T17:01:10.824888] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-13T17:01:10.994597] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:10.994811] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-13T17:01:10.994867] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-13T17:01:10.995133] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-13T17:01:10.995190] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-13T17:01:11.362586] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:11.435612] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:01:11.617950] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-13T17:01:12.417926] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-13T17:01:13.012962] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-13T17:01:13.046141] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T17:01:13.217916] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-13T17:01:14.017985] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-13T17:01:14.448944] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-13T17:01:14.817936] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-13T17:01:14.867384] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T17:01:15.548712] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T17:01:15.617888] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-13T17:01:16.417975] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-13T17:01:16.518337] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:01:17.057358] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T17:01:17.218001] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-13T17:01:18.017952] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-13T17:01:18.274313] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-13T17:01:18.279781] [INFO ] [REMOTE ] ABR: Full fetch complete (75229 records). [2025-10-13T17:01:18.279910] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-13T17:01:18.708340] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-13T17:01:18.709129] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-13T17:01:18.709949] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-13T17:01:18.710773] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T17:01:18.711054] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-13T17:01:18.731542] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T17:01:18.737093] [INFO ] [REMOTE ] ABT: Full fetch complete (77208 records). [2025-10-13T17:01:18.737206] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-13T17:01:18.737302] [DEBUG] [LOCAL ] ABR: Trimmed 75229 records to 51970 (keeping 200 days of data) [2025-10-13T17:01:18.738439] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:01:18.738606] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:01:18.738690] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:01:18.738747] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-13T17:01:18.738804] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-13T17:01:18.738841] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-10-13T17:01:18.738879] [DEBUG] [LOCAL ] ABT: No derivative data file found to delete. [2025-10-13T17:01:18.738936] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABT took 28.4s. Estimated remaining: 3h 17m 0s. Rate: 12.0 symbols/min [2025-10-13T17:01:18.823063] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-13T17:01:19.127539] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:19.254298] [DEBUG] [LOCAL ] ABR: Primary data saved (51970 records). [2025-10-13T17:01:19.254689] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-13T17:01:19.254831] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ABR took 30.5s. Estimated remaining: 3h 5m 53s. Rate: 12.7 symbols/min [2025-10-13T17:01:19.401773] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-10-13T17:01:19.417713] [INFO ] [MAIN ] ACHR: Loaded 54598 existing records. [2025-10-13T17:01:19.567266] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:19.625600] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-13T17:01:19.673710] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:19.675255] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-13T17:01:19.675320] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-13T17:01:19.675741] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-13T17:01:19.675806] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-13T17:01:19.970286] [DEBUG] [LOCAL ] ACI: Loaded 54033 existing records from primary storage. [2025-10-13T17:01:20.009631] [INFO ] [MAIN ] ACI: Loaded 54033 existing records. [2025-10-13T17:01:20.171901] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:20.265757] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T17:01:20.314706] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:20.314990] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-13T17:01:20.315041] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-13T17:01:20.315527] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-13T17:01:20.315586] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-13T17:01:20.423101] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-13T17:01:20.754861] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:20.941601] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T17:01:20.945030] [INFO ] [REMOTE ] ACCO: Full fetch complete (53704 records). [2025-10-13T17:01:20.945114] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-13T17:01:20.945707] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:01:20.945811] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:01:20.945869] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:01:20.945949] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-13T17:01:20.946024] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-13T17:01:20.946061] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-10-13T17:01:20.946268] [DEBUG] [LOCAL ] ACCO: Deleted derivative data file. [2025-10-13T17:01:20.946359] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 22.6s. Estimated remaining: 2h 58m 46s. Rate: 13.2 symbols/min [2025-10-13T17:01:21.120935] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:21.162950] [DEBUG] [LOCAL ] ACM: Loaded 43640 existing records from primary storage. [2025-10-13T17:01:21.163249] [INFO ] [MAIN ] ACM: Loaded 43640 existing records. [2025-10-13T17:01:21.227868] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-13T17:01:21.357977] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:21.358252] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-13T17:01:21.358329] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-13T17:01:21.359248] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-13T17:01:21.359307] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-13T17:01:21.739528] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:22.017972] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-13T17:01:22.366598] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T17:01:22.817931] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-13T17:01:23.314223] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T17:01:23.350288] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-10-13T17:01:23.617893] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-13T17:01:23.789103] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T17:01:24.417928] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-13T17:01:25.217889] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-13T17:01:25.688437] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T17:01:26.017924] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-13T17:01:26.183583] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-13T17:01:26.751916] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:01:26.817894] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-13T17:01:27.427446] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T17:01:27.617906] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-13T17:01:28.417942] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-13T17:01:28.550521] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T17:01:29.217925] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-13T17:01:29.872199] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T17:01:30.017900] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-13T17:01:30.061819] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-13T17:01:30.656775] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T17:01:30.817960] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-13T17:01:31.617894] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-13T17:01:31.696917] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T17:01:32.417929] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-13T17:01:32.917597] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:01:33.217899] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-13T17:01:33.545767] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-13T17:01:34.017920] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-13T17:01:34.151628] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T17:01:34.242279] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:01:34.817935] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-13T17:01:35.445548] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T17:01:35.617896] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-13T17:01:36.003741] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T17:01:36.417920] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-13T17:01:37.217916] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-13T17:01:38.017905] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-13T17:01:38.078934] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-13T17:01:38.154454] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:01:38.389469] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T17:01:38.817905] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-13T17:01:39.369217] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T17:01:39.617904] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-13T17:01:40.417894] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-13T17:01:40.566702] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T17:01:41.152826] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-13T17:01:41.217890] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-13T17:01:42.017899] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-13T17:01:42.342742] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T17:01:42.817925] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-13T17:01:43.509162] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:01:43.617913] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-13T17:01:43.671028] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-13T17:01:44.349245] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T17:01:44.417882] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-13T17:01:44.592366] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T17:01:44.594974] [INFO ] [REMOTE ] ACEL: Full fetch complete (38534 records). [2025-10-13T17:01:44.595050] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-13T17:01:44.595639] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:01:44.595763] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:01:44.595806] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:01:44.595843] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-13T17:01:44.595897] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-13T17:01:44.595930] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-10-13T17:01:44.596081] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-10-13T17:01:44.596168] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 34.0s. Estimated remaining: 3h 40m 18s. Rate: 10.7 symbols/min [2025-10-13T17:01:44.766134] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:44.819738] [DEBUG] [LOCAL ] ACN: Loaded 54208 existing records from primary storage. [2025-10-13T17:01:44.820063] [INFO ] [MAIN ] ACN: Loaded 54208 existing records. [2025-10-13T17:01:45.016638] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:45.017094] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-13T17:01:45.017185] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-13T17:01:45.017725] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-13T17:01:45.017784] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-13T17:01:45.222980] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-13T17:01:45.410452] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:46.017934] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-13T17:01:46.169776] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T17:01:46.817915] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-13T17:01:47.617897] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-13T17:01:47.737994] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T17:01:47.958011] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-13T17:01:48.387635] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:01:48.417876] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-13T17:01:49.217909] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-13T17:01:49.326997] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T17:01:50.017912] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-13T17:01:50.187231] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:01:50.817936] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-13T17:01:51.617924] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-13T17:01:51.657768] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T17:01:51.715803] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-13T17:01:52.417906] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-13T17:01:52.711917] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T17:01:53.217919] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-13T17:01:53.301131] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T17:01:53.855186] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T17:01:54.017897] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-13T17:01:54.817970] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-13T17:01:54.910584] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T17:01:55.525409] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T17:01:55.530930] [INFO ] [REMOTE ] ACM: Full fetch complete (62795 records). [2025-10-13T17:01:55.531154] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-13T17:01:55.623140] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-13T17:01:55.925204] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-13T17:01:55.925292] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-13T17:01:55.925881] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-13T17:01:55.925945] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-13T17:01:55.927276] [DEBUG] [LOCAL ] ACM: Trimmed 62795 records to 43041 (keeping 200 days of data) [2025-10-13T17:01:56.195411] [DEBUG] [LOCAL ] ACM: Primary data saved (43041 records). [2025-10-13T17:01:56.195544] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-13T17:01:56.195624] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACM took 35.2s. Estimated remaining: 3h 52m 33s. Rate: 10.1 symbols/min [2025-10-13T17:01:56.363978] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:56.393662] [DEBUG] [LOCAL ] ACP: Loaded 31455 existing records from primary storage. [2025-10-13T17:01:56.393940] [INFO ] [MAIN ] ACP: Loaded 31455 existing records. [2025-10-13T17:01:56.424694] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-13T17:01:56.572445] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:56.572699] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-13T17:01:56.572757] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-13T17:01:56.573282] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-13T17:01:56.573339] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-13T17:01:56.927575] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:57.217913] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-13T17:01:57.418973] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-13T17:01:57.424428] [INFO ] [REMOTE ] ACI: Full fetch complete (77049 records). [2025-10-13T17:01:57.424547] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-13T17:01:57.757742] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-10-13T17:01:57.862766] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-13T17:01:57.862846] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-13T17:01:57.863521] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-13T17:01:57.863561] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-13T17:01:57.865104] [DEBUG] [LOCAL ] ACI: Trimmed 77049 records to 53274 (keeping 200 days of data) [2025-10-13T17:01:58.038136] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-13T17:01:58.211574] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:01:58.231960] [DEBUG] [LOCAL ] ACI: Primary data saved (53274 records). [2025-10-13T17:01:58.232115] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-13T17:01:58.232204] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACI took 39.0s. Estimated remaining: 3h 44m 49s. Rate: 10.5 symbols/min [2025-10-13T17:01:58.415436] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:01:58.422191] [DEBUG] [LOCAL ] ACR: Loaded 5659 existing records from primary storage. [2025-10-13T17:01:58.422373] [INFO ] [MAIN ] ACR: Loaded 5659 existing records. [2025-10-13T17:01:58.602445] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:01:58.602696] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-13T17:01:58.602754] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-13T17:01:58.602966] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-13T17:01:58.603021] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-13T17:01:58.832193] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-13T17:01:58.960400] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:01:58.982557] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T17:01:59.617989] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-13T17:02:00.417954] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-13T17:02:00.791911] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-13T17:02:00.797477] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-13T17:02:00.797587] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-13T17:02:01.103569] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T17:02:01.238086] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-13T17:02:01.237570] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-13T17:02:01.239221] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-13T17:02:01.240077] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-13T17:02:01.240280] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-13T17:02:01.296212] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:02:01.297270] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-13T17:02:01.308292] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-13T17:02:01.638524] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-13T17:02:01.638703] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-13T17:02:01.638799] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 42.9s. Estimated remaining: 3h 40m 22s. Rate: 10.7 symbols/min [2025-10-13T17:02:01.810468] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:01.846318] [DEBUG] [LOCAL ] ACRE: Loaded 34101 existing records from primary storage. [2025-10-13T17:02:01.846686] [INFO ] [MAIN ] ACRE: Loaded 34101 existing records. [2025-10-13T17:02:01.956098] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T17:02:02.031743] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-13T17:02:02.037377] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:02.038475] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-13T17:02:02.038621] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-13T17:02:02.039497] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-13T17:02:02.039596] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-13T17:02:02.388759] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:02.817931] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-13T17:02:03.617890] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-13T17:02:04.051054] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T17:02:04.430109] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-13T17:02:04.432918] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T17:02:04.793827] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:02:05.217969] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-13T17:02:06.017044] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T17:02:06.027139] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-13T17:02:06.638023] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T17:02:06.660538] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T17:02:06.817977] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-13T17:02:07.617932] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-13T17:02:08.084537] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T17:02:08.417471] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-13T17:02:08.420345] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-13T17:02:09.217943] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-13T17:02:10.017907] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-13T17:02:10.417322] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T17:02:10.573570] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-13T17:02:10.659141] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T17:02:10.817928] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-13T17:02:11.617973] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-13T17:02:11.976631] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T17:02:12.417922] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-13T17:02:13.043000] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T17:02:13.217935] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-13T17:02:13.278934] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T17:02:14.017931] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-13T17:02:14.688625] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T17:02:14.817966] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-13T17:02:15.617920] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-13T17:02:15.749809] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T17:02:16.235681] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-13T17:02:16.417982] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-13T17:02:16.697312] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T17:02:17.217939] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-13T17:02:18.017940] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-13T17:02:18.411113] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:02:18.604373] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-13T17:02:18.817952] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-13T17:02:19.301489] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T17:02:19.617918] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-13T17:02:19.905842] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T17:02:20.417942] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-13T17:02:21.108462] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T17:02:21.217924] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-13T17:02:22.017938] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-13T17:02:22.305002] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-13T17:02:22.310491] [INFO ] [REMOTE ] ACN: Full fetch complete (77155 records). [2025-10-13T17:02:22.310597] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-13T17:02:22.688490] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T17:02:22.750425] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-13T17:02:22.750539] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-13T17:02:22.751359] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-13T17:02:22.752082] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-13T17:02:22.753818] [DEBUG] [LOCAL ] ACN: Trimmed 77155 records to 53429 (keeping 200 days of data) [2025-10-13T17:02:22.818368] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-13T17:02:23.107399] [DEBUG] [LOCAL ] ACN: Primary data saved (53429 records). [2025-10-13T17:02:23.107548] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-13T17:02:23.108587] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 38.5s. Estimated remaining: 4h 8m 28s. Rate: 9.5 symbols/min [2025-10-13T17:02:23.285921] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:23.303624] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T17:02:23.317215] [DEBUG] [LOCAL ] ACV: Loaded 7819 existing records from primary storage. [2025-10-13T17:02:23.317454] [INFO ] [MAIN ] ACV: Loaded 7819 existing records. [2025-10-13T17:02:23.495231] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:23.495447] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-13T17:02:23.495494] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-13T17:02:23.495668] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-13T17:02:23.495726] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-13T17:02:23.623176] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-13T17:02:23.886420] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:24.250130] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T17:02:24.417932] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-13T17:02:24.968984] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T17:02:24.996397] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T17:02:25.217934] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-13T17:02:26.017931] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-13T17:02:26.436124] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T17:02:26.817949] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-13T17:02:27.058331] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:02:27.061691] [INFO ] [REMOTE ] ACP: Full fetch complete (46553 records). [2025-10-13T17:02:27.061801] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-13T17:02:27.428638] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-13T17:02:27.428745] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-13T17:02:27.429205] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-13T17:02:27.429245] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-13T17:02:27.430228] [DEBUG] [LOCAL ] ACP: Trimmed 46553 records to 30940 (keeping 200 days of data) [2025-10-13T17:02:27.610539] [DEBUG] [LOCAL ] ACP: Primary data saved (30940 records). [2025-10-13T17:02:27.610787] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-13T17:02:27.610894] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACP took 31.4s. Estimated remaining: 4h 5m 14s. Rate: 9.6 symbols/min [2025-10-13T17:02:27.623153] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-13T17:02:27.800970] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:27.847897] [DEBUG] [LOCAL ] ACVA: Loaded 49962 existing records from primary storage. [2025-10-13T17:02:27.848208] [INFO ] [MAIN ] ACVA: Loaded 49962 existing records. [2025-10-13T17:02:28.032969] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:28.033184] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-13T17:02:28.033229] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-13T17:02:28.034281] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-13T17:02:28.034342] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-13T17:02:28.152995] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T17:02:28.154319] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T17:02:28.219540] [INFO ] [REMOTE ] ACRE: Full fetch complete (49922 records). [2025-10-13T17:02:28.235516] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-13T17:02:28.419505] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-13T17:02:28.596412] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:28.818064] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-13T17:02:28.818152] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-13T17:02:28.818689] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-13T17:02:28.818754] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-13T17:02:28.819824] [DEBUG] [LOCAL ] ACRE: Trimmed 49922 records to 33602 (keeping 200 days of data) [2025-10-13T17:02:29.010619] [DEBUG] [LOCAL ] ACRE: Primary data saved (33602 records). [2025-10-13T17:02:29.010781] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-13T17:02:29.010867] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACRE took 27.4s. Estimated remaining: 3h 57m 11s. Rate: 9.9 symbols/min [2025-10-13T17:02:29.164996] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T17:02:29.182632] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:29.184120] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-13T17:02:29.184192] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-13T17:02:29.184544] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-13T17:02:29.184594] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-13T17:02:29.184637] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-13T17:02:29.184712] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-13T17:02:29.222991] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-13T17:02:29.533952] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:30.017917] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-13T17:02:30.684467] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T17:02:30.685873] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T17:02:30.686952] [INFO ] [REMOTE ] ACR: Full fetch complete (8506 records). [2025-10-13T17:02:30.696492] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-13T17:02:30.696982] [FATAL] [VALIDATOR ] ACR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:02:30.697064] [FATAL] [MAIN ] ACR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:02:30.697113] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:02:30.697193] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-13T17:02:30.697273] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-13T17:02:30.697310] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-10-13T17:02:30.697425] [DEBUG] [LOCAL ] ACR: Deleted derivative data file. [2025-10-13T17:02:30.697492] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. ACR took 32.5s. Estimated remaining: 3h 50m 15s. Rate: 10.2 symbols/min [2025-10-13T17:02:30.823012] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-13T17:02:30.870590] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:30.918498] [DEBUG] [LOCAL ] ADC: Loaded 46856 existing records from primary storage. [2025-10-13T17:02:30.918820] [INFO ] [MAIN ] ADC: Loaded 46856 existing records. [2025-10-13T17:02:31.120989] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:31.121194] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-13T17:02:31.121239] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-13T17:02:31.121489] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-13T17:02:31.121527] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-13T17:02:31.469814] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T17:02:31.484951] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:31.617916] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-13T17:02:32.321898] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T17:02:32.417904] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-13T17:02:33.217931] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-13T17:02:33.821917] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T17:02:34.017916] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-13T17:02:34.269602] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:02:34.269998] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-13T17:02:34.270085] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:02:34.270132] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-13T17:02:34.270193] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:02:34.270279] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-13T17:02:34.270345] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-13T17:02:34.270380] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-13T17:02:34.270419] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-13T17:02:34.270465] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. AD took 5.3s. Estimated remaining: 3h 46m 40s. Rate: 10.3 symbols/min [2025-10-13T17:02:34.440382] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:34.472871] [DEBUG] [LOCAL ] ADCT: Loaded 35703 existing records from primary storage. [2025-10-13T17:02:34.473139] [INFO ] [MAIN ] ADCT: Loaded 35703 existing records. [2025-10-13T17:02:34.656094] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:34.656328] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-13T17:02:34.656374] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-13T17:02:34.656875] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-13T17:02:34.656935] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-13T17:02:34.818389] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-13T17:02:35.011334] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T17:02:35.058638] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:35.488334] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T17:02:35.617922] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-13T17:02:36.417928] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-13T17:02:37.217902] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-13T17:02:37.488981] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T17:02:37.630620] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-13T17:02:37.843733] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T17:02:38.017931] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-13T17:02:38.769579] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T17:02:38.817933] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-13T17:02:39.578921] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T17:02:39.617919] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-13T17:02:40.417927] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-13T17:02:41.045335] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T17:02:41.217922] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-13T17:02:41.797357] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:02:42.017955] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-13T17:02:42.744871] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:02:42.817953] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-13T17:02:42.914389] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T17:02:43.617937] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-13T17:02:44.417918] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-13T17:02:44.627811] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T17:02:45.115149] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:02:45.130420] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T17:02:45.217958] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-13T17:02:46.017960] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-13T17:02:46.501191] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:02:46.585758] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T17:02:46.818019] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-13T17:02:47.422396] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T17:02:47.617955] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-13T17:02:48.417967] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-13T17:02:48.669113] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-13T17:02:49.217955] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-13T17:02:49.978106] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T17:02:50.017921] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-13T17:02:50.131295] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T17:02:50.741234] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T17:02:50.743355] [INFO ] [REMOTE ] ACV: Full fetch complete (10357 records). [2025-10-13T17:02:50.743424] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-13T17:02:50.823125] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-13T17:02:51.124810] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-13T17:02:51.124917] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-13T17:02:51.125188] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-13T17:02:51.125229] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-13T17:02:51.125767] [DEBUG] [LOCAL ] ACV: Trimmed 10357 records to 7678 (keeping 200 days of data) [2025-10-13T17:02:51.174945] [DEBUG] [LOCAL ] ACV: Primary data saved (7678 records). [2025-10-13T17:02:51.175138] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-13T17:02:51.175242] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACV took 28.1s. Estimated remaining: 4h 2m 38s. Rate: 9.7 symbols/min [2025-10-13T17:02:51.351314] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:02:51.412939] [DEBUG] [LOCAL ] ADM: Loaded 54168 existing records from primary storage. [2025-10-13T17:02:51.413459] [INFO ] [MAIN ] ADM: Loaded 54168 existing records. [2025-10-13T17:02:51.606839] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:02:51.607154] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-13T17:02:51.607207] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-13T17:02:51.608327] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-13T17:02:51.608389] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-13T17:02:51.623188] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-13T17:02:51.982508] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:02:52.417972] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-13T17:02:52.547547] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T17:02:53.190134] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T17:02:53.217895] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-13T17:02:53.740624] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T17:02:54.017927] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-13T17:02:54.580819] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T17:02:54.817931] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-13T17:02:55.572012] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:02:55.617904] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-13T17:02:56.417957] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-13T17:02:56.509250] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:02:57.188376] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T17:02:57.217905] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-13T17:02:58.017928] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-13T17:02:58.229860] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:02:58.681268] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T17:02:58.817935] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-13T17:02:59.497145] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T17:02:59.617908] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-13T17:03:00.137149] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T17:03:00.417995] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-13T17:03:01.124493] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T17:03:01.217975] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-13T17:03:02.017956] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-13T17:03:02.257932] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:03:02.765428] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T17:03:02.817914] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-13T17:03:03.421376] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:03:03.617959] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-13T17:03:04.195960] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T17:03:04.202265] [INFO ] [REMOTE ] ADCT: Full fetch complete (51383 records). [2025-10-13T17:03:04.202510] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-13T17:03:04.418702] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-13T17:03:04.726303] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-13T17:03:04.726536] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-13T17:03:04.727621] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-13T17:03:04.727734] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-13T17:03:04.729941] [DEBUG] [LOCAL ] ADCT: Trimmed 51383 records to 35218 (keeping 200 days of data) [2025-10-13T17:03:04.962230] [DEBUG] [LOCAL ] ADCT: Primary data saved (35218 records). [2025-10-13T17:03:04.962486] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-13T17:03:04.962964] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ADCT took 30.7s. Estimated remaining: 4h 13m 6s. Rate: 9.3 symbols/min [2025-10-13T17:03:05.128314] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T17:03:05.198961] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:05.226503] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-13T17:03:05.248543] [DEBUG] [LOCAL ] ADNT: Loaded 47843 existing records from primary storage. [2025-10-13T17:03:05.249004] [INFO ] [MAIN ] ADNT: Loaded 47843 existing records. [2025-10-13T17:03:05.437462] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:05.437921] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-13T17:03:05.438068] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-13T17:03:05.439285] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-13T17:03:05.439346] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-13T17:03:05.818040] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:06.017946] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-13T17:03:06.141522] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T17:03:06.821415] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-13T17:03:06.826308] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:03:07.476929] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T17:03:07.618031] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-13T17:03:08.240589] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T17:03:08.245814] [INFO ] [REMOTE ] ACVA: Full fetch complete (70590 records). [2025-10-13T17:03:08.245915] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-13T17:03:08.421395] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-13T17:03:08.638864] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-13T17:03:08.638936] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-13T17:03:08.639547] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-13T17:03:08.639588] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-13T17:03:08.640913] [DEBUG] [LOCAL ] ACVA: Trimmed 70590 records to 49302 (keeping 200 days of data) [2025-10-13T17:03:08.938890] [DEBUG] [LOCAL ] ACVA: Primary data saved (49302 records). [2025-10-13T17:03:08.939018] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-13T17:03:08.940183] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ACVA took 41.3s. Estimated remaining: 4h 9m 37s. Rate: 9.4 symbols/min [2025-10-13T17:03:09.110351] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:09.161334] [DEBUG] [LOCAL ] ADT: Loaded 54223 existing records from primary storage. [2025-10-13T17:03:09.161705] [INFO ] [MAIN ] ADT: Loaded 54223 existing records. [2025-10-13T17:03:09.224539] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-13T17:03:09.350629] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:09.351085] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-13T17:03:09.351270] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-13T17:03:09.352617] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-13T17:03:09.352720] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-13T17:03:09.674956] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-13T17:03:09.759745] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:10.017932] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-13T17:03:10.076169] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T17:03:10.080695] [INFO ] [REMOTE ] ADC: Full fetch complete (65844 records). [2025-10-13T17:03:10.080850] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-13T17:03:10.081629] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:03:10.081741] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:03:10.081785] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:03:10.081848] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-13T17:03:10.081910] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-13T17:03:10.081947] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-10-13T17:03:10.082126] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-10-13T17:03:10.082245] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADC took 39.4s. Estimated remaining: 4h 2m 41s. Rate: 9.6 symbols/min [2025-10-13T17:03:10.247845] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:10.278798] [DEBUG] [LOCAL ] ADX: Loaded 28006 existing records from primary storage. [2025-10-13T17:03:10.279170] [INFO ] [MAIN ] ADX: Loaded 28006 existing records. [2025-10-13T17:03:10.485025] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:10.485456] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-13T17:03:10.485534] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-13T17:03:10.486449] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-13T17:03:10.486520] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-13T17:03:10.822378] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-13T17:03:10.881519] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:10.919509] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T17:03:11.617905] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-13T17:03:11.833590] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:03:12.417941] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-13T17:03:12.522625] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T17:03:13.033823] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T17:03:13.217922] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-13T17:03:14.017899] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-13T17:03:14.280749] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T17:03:14.658315] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T17:03:14.817974] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-13T17:03:15.628623] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-13T17:03:15.656462] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:03:16.048226] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T17:03:16.417936] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-13T17:03:17.217932] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-13T17:03:17.372931] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T17:03:17.493344] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T17:03:18.010447] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T17:03:18.017879] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-13T17:03:18.817930] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-13T17:03:18.997045] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T17:03:19.617962] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-13T17:03:20.417906] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-13T17:03:20.680509] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T17:03:20.759905] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T17:03:21.217942] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-13T17:03:22.017918] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-13T17:03:22.162328] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:03:22.817932] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-13T17:03:22.982598] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:03:23.621909] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-13T17:03:23.627612] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T17:03:24.200158] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T17:03:24.417923] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-13T17:03:25.217947] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-13T17:03:25.369445] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:03:26.017919] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-13T17:03:26.282728] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T17:03:26.817933] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-13T17:03:26.856215] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T17:03:27.617938] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-13T17:03:27.874914] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T17:03:28.417901] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-13T17:03:28.487278] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T17:03:28.836613] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:03:28.979946] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T17:03:28.985233] [INFO ] [REMOTE ] ADM: Full fetch complete (77266 records). [2025-10-13T17:03:28.985334] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-13T17:03:29.223158] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-13T17:03:29.380325] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-13T17:03:29.380404] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-13T17:03:29.381157] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-13T17:03:29.381222] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-13T17:03:29.382684] [DEBUG] [LOCAL ] ADM: Trimmed 77266 records to 53394 (keeping 200 days of data) [2025-10-13T17:03:29.719149] [DEBUG] [LOCAL ] ADM: Primary data saved (53394 records). [2025-10-13T17:03:29.719298] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-13T17:03:29.720205] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADM took 38.5s. Estimated remaining: 4h 19m 28s. Rate: 9.0 symbols/min [2025-10-13T17:03:29.888402] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:29.939087] [DEBUG] [LOCAL ] AEE: Loaded 50867 existing records from primary storage. [2025-10-13T17:03:29.939384] [INFO ] [MAIN ] AEE: Loaded 50867 existing records. [2025-10-13T17:03:30.027613] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-13T17:03:30.123749] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:30.123960] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-13T17:03:30.124010] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-13T17:03:30.125050] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-13T17:03:30.125112] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-13T17:03:30.494054] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:30.817902] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-13T17:03:31.072534] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:03:31.467458] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T17:03:31.617914] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-13T17:03:32.353426] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T17:03:32.417935] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-13T17:03:32.920725] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:03:33.217926] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-13T17:03:34.017939] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-13T17:03:34.481866] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-13T17:03:34.817905] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-13T17:03:34.959405] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T17:03:35.033843] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T17:03:35.617915] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-13T17:03:36.429194] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-13T17:03:36.435309] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T17:03:37.174679] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:03:37.217880] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-13T17:03:37.832318] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T17:03:38.017958] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-13T17:03:38.817916] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-13T17:03:38.894543] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T17:03:39.618013] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-13T17:03:39.785943] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T17:03:39.851808] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-13T17:03:40.417941] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-13T17:03:41.217923] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-13T17:03:41.220530] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T17:03:42.012371] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T17:03:42.022208] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-13T17:03:42.817893] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-13T17:03:42.967828] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T17:03:42.973322] [INFO ] [REMOTE ] ADT: Full fetch complete (77191 records). [2025-10-13T17:03:42.973483] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-13T17:03:43.282459] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:03:43.328025] [INFO ] [REMOTE ] ADX: Full fetch complete (41850 records). [2025-10-13T17:03:43.342324] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-13T17:03:43.424883] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-13T17:03:43.456626] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-13T17:03:43.462523] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-13T17:03:43.473121] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-13T17:03:43.511174] [DEBUG] [LOCAL ] ADT: Trimmed 77191 records to 53446 (keeping 200 days of data) [2025-10-13T17:03:43.625928] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-13T17:03:43.945585] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-13T17:03:43.954073] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-13T17:03:43.954890] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-13T17:03:43.981094] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-13T17:03:44.003060] [DEBUG] [LOCAL ] ADX: Trimmed 41850 records to 27695 (keeping 200 days of data) [2025-10-13T17:03:44.266664] [DEBUG] [LOCAL ] ADT: Primary data saved (53446 records). [2025-10-13T17:03:44.267416] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-13T17:03:44.274288] [DEBUG] [LOCAL ] ADX: Primary data saved (27695 records). [2025-10-13T17:03:44.275793] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADT took 35.3s. Estimated remaining: 4h 28m 59s. Rate: 8.7 symbols/min [2025-10-13T17:03:44.276106] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-13T17:03:44.290092] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADX took 34.2s. Estimated remaining: 4h 20m 44s. Rate: 9.0 symbols/min [2025-10-13T17:03:44.632937] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:44.713620] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:44.756451] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T17:03:44.771544] [DEBUG] [LOCAL ] AEFC: Loaded 8507 existing records from primary storage. [2025-10-13T17:03:44.772592] [INFO ] [MAIN ] AEFC: Loaded 8507 existing records. [2025-10-13T17:03:44.809711] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-13T17:03:44.990897] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:44.991254] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-13T17:03:44.991343] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-13T17:03:44.993301] [DEBUG] [LOCAL ] AEG: Loaded 50280 existing records from primary storage. [2025-10-13T17:03:44.993810] [INFO ] [MAIN ] AEG: Loaded 50280 existing records. [2025-10-13T17:03:45.025845] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-13T17:03:45.069732] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-13T17:03:45.308761] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:45.319316] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-13T17:03:45.329696] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-13T17:03:45.357688] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-13T17:03:45.370290] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-13T17:03:45.769760] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:45.789299] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-13T17:03:46.017929] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:46.021030] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-13T17:03:46.023395] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-13T17:03:46.201928] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:03:46.817907] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-13T17:03:46.884802] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T17:03:47.617904] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-13T17:03:47.682316] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:03:48.237315] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T17:03:48.242324] [INFO ] [REMOTE ] ADNT: Full fetch complete (67647 records). [2025-10-13T17:03:48.242458] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-13T17:03:48.243432] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:03:48.243547] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:03:48.243623] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:03:48.243738] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-13T17:03:48.243841] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-13T17:03:48.243905] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-10-13T17:03:48.244085] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-10-13T17:03:48.244205] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADNT took 43.3s. Estimated remaining: 4h 17m 29s. Rate: 9.1 symbols/min [2025-10-13T17:03:48.420554] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-13T17:03:48.443635] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:03:48.505445] [DEBUG] [LOCAL ] AEM: Loaded 54245 existing records from primary storage. [2025-10-13T17:03:48.505899] [INFO ] [MAIN ] AEM: Loaded 54245 existing records. [2025-10-13T17:03:48.681931] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:03:48.682128] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-13T17:03:48.682175] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-13T17:03:48.682882] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-13T17:03:48.682939] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-13T17:03:49.040108] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:03:49.078158] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T17:03:49.217947] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-13T17:03:50.017922] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-13T17:03:50.171065] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T17:03:50.646973] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T17:03:50.817912] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-13T17:03:51.311309] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-13T17:03:51.617900] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-13T17:03:51.970012] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T17:03:52.417927] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-13T17:03:53.045030] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T17:03:53.217933] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-13T17:03:53.806530] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-13T17:03:54.001425] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T17:03:54.017877] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-13T17:03:54.817930] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-13T17:03:55.587577] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T17:03:55.617912] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-13T17:03:55.688013] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T17:03:56.418017] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-13T17:03:57.218011] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-13T17:03:57.285500] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:03:57.833391] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T17:03:58.017927] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-13T17:03:58.817941] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-13T17:03:58.988809] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T17:03:59.348222] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T17:03:59.617948] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-13T17:04:00.331266] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T17:04:00.417960] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-13T17:04:01.217922] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-13T17:04:01.361168] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T17:04:02.017901] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-13T17:04:02.156429] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-13T17:04:02.181149] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T17:04:02.186624] [INFO ] [REMOTE ] AEE: Full fetch complete (72742 records). [2025-10-13T17:04:02.186819] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-13T17:04:02.568294] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-13T17:04:02.568378] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-13T17:04:02.569056] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-13T17:04:02.569120] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-13T17:04:02.570497] [DEBUG] [LOCAL ] AEE: Trimmed 72742 records to 50188 (keeping 200 days of data) [2025-10-13T17:04:02.839242] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-13T17:04:02.874091] [DEBUG] [LOCAL ] AEE: Primary data saved (50188 records). [2025-10-13T17:04:02.874198] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-13T17:04:02.875104] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEE took 33.2s. Estimated remaining: 4h 26m 18s. Rate: 8.8 symbols/min [2025-10-13T17:04:03.041062] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:03.098143] [DEBUG] [LOCAL ] AEO: Loaded 54343 existing records from primary storage. [2025-10-13T17:04:03.098476] [INFO ] [MAIN ] AEO: Loaded 54343 existing records. [2025-10-13T17:04:03.272976] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:03.273195] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-13T17:04:03.273243] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-13T17:04:03.273536] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-13T17:04:03.273591] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-13T17:04:03.624097] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:03.624257] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-13T17:04:03.672552] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T17:04:04.103257] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T17:04:04.418000] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-13T17:04:05.224361] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-13T17:04:05.242251] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T17:04:06.017975] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-13T17:04:06.266452] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T17:04:06.688393] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T17:04:06.817889] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-13T17:04:06.883161] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:04:07.617918] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-13T17:04:08.417972] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-13T17:04:08.847155] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T17:04:09.169270] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T17:04:09.217974] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-13T17:04:09.538480] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T17:04:09.822756] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T17:04:10.018013] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-13T17:04:10.539703] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T17:04:10.817910] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-13T17:04:11.617930] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-13T17:04:12.417952] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-13T17:04:12.419551] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T17:04:13.217897] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-13T17:04:13.568122] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T17:04:14.017955] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-13T17:04:14.221132] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:04:14.661255] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T17:04:14.677127] [INFO ] [REMOTE ] AEFC: Full fetch complete (11891 records). [2025-10-13T17:04:14.691913] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T17:04:14.690890] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-13T17:04:14.822986] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-13T17:04:15.053420] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-13T17:04:15.053555] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-13T17:04:15.053776] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-13T17:04:15.053839] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-13T17:04:15.054290] [DEBUG] [LOCAL ] AEFC: Trimmed 11891 records to 8389 (keeping 200 days of data) [2025-10-13T17:04:15.111598] [DEBUG] [LOCAL ] AEFC: Primary data saved (8389 records). [2025-10-13T17:04:15.111772] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-13T17:04:15.111862] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEFC took 30.8s. Estimated remaining: 4h 32m 1s. Rate: 8.6 symbols/min [2025-10-13T17:04:15.278196] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:15.326860] [DEBUG] [LOCAL ] AER: Loaded 48916 existing records from primary storage. [2025-10-13T17:04:15.327195] [INFO ] [MAIN ] AER: Loaded 48916 existing records. [2025-10-13T17:04:15.503875] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:15.504068] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-13T17:04:15.504114] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-13T17:04:15.505178] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-13T17:04:15.505237] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-13T17:04:15.623073] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-13T17:04:15.855061] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:16.417895] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-13T17:04:16.502595] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T17:04:16.509380] [INFO ] [REMOTE ] AEG: Full fetch complete (69933 records). [2025-10-13T17:04:16.509516] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-13T17:04:16.510423] [FATAL] [VALIDATOR ] AEG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:04:16.510531] [FATAL] [MAIN ] AEG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:04:16.510601] [WARN ] [MAIN ] AEG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:04:16.510719] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-13T17:04:16.510806] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-13T17:04:16.510851] [INFO ] [LOCAL ] AEG: Starting deletion of derivative data. [2025-10-13T17:04:16.511035] [DEBUG] [LOCAL ] AEG: Deleted derivative data file. [2025-10-13T17:04:16.511125] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 32.2s. Estimated remaining: 4h 26m 1s. Rate: 8.8 symbols/min [2025-10-13T17:04:17.217988] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-13T17:04:17.561124] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:04:17.933755] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T17:04:18.017889] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-13T17:04:18.817918] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-13T17:04:19.380852] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-13T17:04:19.472732] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:04:19.618018] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-13T17:04:20.252717] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T17:04:20.417939] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-13T17:04:21.145817] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:04:21.217938] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-13T17:04:22.017904] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-13T17:04:22.383956] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-13T17:04:22.817903] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-13T17:04:23.047181] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T17:04:23.617935] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-13T17:04:23.902539] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T17:04:24.317516] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T17:04:24.417969] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-13T17:04:25.218008] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-13T17:04:25.289245] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T17:04:26.017956] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-13T17:04:26.328308] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T17:04:26.817957] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-13T17:04:27.329095] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-13T17:04:27.378452] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T17:04:27.617931] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-13T17:04:28.417993] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-13T17:04:28.802001] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T17:04:29.217924] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-13T17:04:29.717216] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-13T17:04:29.723400] [INFO ] [REMOTE ] AEM: Full fetch complete (77201 records). [2025-10-13T17:04:29.723578] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-13T17:04:30.141860] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-13T17:04:30.141988] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-13T17:04:30.142748] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-13T17:04:30.142836] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-13T17:04:30.144614] [DEBUG] [LOCAL ] AEM: Trimmed 77201 records to 53478 (keeping 200 days of data) [2025-10-13T17:04:30.270070] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:04:30.282569] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-13T17:04:30.543825] [DEBUG] [LOCAL ] AEM: Primary data saved (53478 records). [2025-10-13T17:04:30.544033] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-13T17:04:30.544140] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 42.3s. Estimated remaining: 4h 33m 16s. Rate: 8.5 symbols/min [2025-10-13T17:04:31.153682] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-13T17:04:31.164766] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-13T17:04:31.972299] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T17:04:31.983156] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-13T17:04:32.851549] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T17:04:32.856534] [INFO ] [REMOTE ] AEO: Full fetch complete (77066 records). [2025-10-13T17:04:32.856716] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-13T17:04:32.857587] [FATAL] [VALIDATOR ] AEO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:04:32.857704] [FATAL] [MAIN ] AEO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:04:32.857772] [WARN ] [MAIN ] AEO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:04:32.857848] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-13T17:04:32.857912] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-10-13T17:04:32.857949] [INFO ] [LOCAL ] AEO: Starting deletion of derivative data. [2025-10-13T17:04:32.858087] [DEBUG] [LOCAL ] AEO: Deleted derivative data file. [2025-10-13T17:04:32.858691] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AEO took 30.0s. Estimated remaining: 4h 28m 27s. Rate: 8.7 symbols/min [2025-10-13T17:04:33.247572] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T17:04:33.257937] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-13T17:04:34.936994] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:04:34.947789] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-13T17:04:36.596037] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T17:04:36.603269] [INFO ] [REMOTE ] AER: Full fetch complete (69573 records). [2025-10-13T17:04:36.603463] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-13T17:04:37.033789] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-13T17:04:37.033901] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-13T17:04:37.034766] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-13T17:04:37.034835] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-13T17:04:37.037225] [DEBUG] [LOCAL ] AER: Trimmed 69573 records to 48213 (keeping 200 days of data) [2025-10-13T17:04:37.367420] [DEBUG] [LOCAL ] AER: Primary data saved (48213 records). [2025-10-13T17:04:37.367794] [INFO ] [MAIN ] AER: Full history saved. [2025-10-13T17:04:37.368853] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AER took 22.3s. Estimated remaining: 4h 26m 1s. Rate: 8.8 symbols/min [2025-10-13T17:04:38.047571] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:38.023163] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:38.109758] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-13T17:04:38.126577] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:38.144930] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-13T17:04:38.148832] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-13T17:04:38.149056] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-13T17:04:38.147722] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:38.149329] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-13T17:04:38.150061] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-13T17:04:38.278393] [DEBUG] [LOCAL ] AFB: Loaded 11547 existing records from primary storage. [2025-10-13T17:04:38.285092] [INFO ] [MAIN ] AFB: Loaded 11547 existing records. [2025-10-13T17:04:38.451184] [DEBUG] [LOCAL ] AESI: Loaded 50320 existing records from primary storage. [2025-10-13T17:04:38.536779] [INFO ] [MAIN ] AESI: Loaded 50320 existing records. [2025-10-13T17:04:38.754166] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:38.813764] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-13T17:04:38.849401] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-13T17:04:38.849221] [DEBUG] [LOCAL ] AES: Loaded 54450 existing records from primary storage. [2025-10-13T17:04:38.875989] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-13T17:04:38.901401] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-13T17:04:38.942403] [INFO ] [MAIN ] AES: Loaded 54450 existing records. [2025-10-13T17:04:39.106849] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:39.166275] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-13T17:04:39.238866] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:39.340196] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-13T17:04:39.388742] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-13T17:04:39.428172] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-13T17:04:39.463248] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-13T17:04:39.520111] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:04:39.594799] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-13T17:04:39.594977] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:04:39.595053] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-13T17:04:39.595118] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:04:39.595190] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-13T17:04:39.595255] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-13T17:04:39.595293] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-13T17:04:39.595331] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-13T17:04:39.595380] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.2s. Estimated remaining: 4h 21m 31s. Rate: 8.9 symbols/min [2025-10-13T17:04:39.685955] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:39.691785] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-13T17:04:39.715857] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-13T17:04:39.848855] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-13T17:04:39.879332] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-13T17:04:39.990146] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:40.037156] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-13T17:04:40.128363] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:04:40.528626] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:40.558200] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-13T17:04:40.590630] [DEBUG] [LOCAL ] AFG: Loaded 32729 existing records from primary storage. [2025-10-13T17:04:40.603691] [INFO ] [MAIN ] AFG: Loaded 32729 existing records. [2025-10-13T17:04:40.840066] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:40.864188] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-13T17:04:40.908941] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:04:40.909664] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-13T17:04:40.909790] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-13T17:04:40.910128] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-13T17:04:40.910186] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-13T17:04:41.018351] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T17:04:41.032423] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-13T17:04:41.272396] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:04:41.272798] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-13T17:04:41.933170] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T17:04:41.936518] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-13T17:04:41.996830] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T17:04:42.007711] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-13T17:04:42.577827] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T17:04:42.580550] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-13T17:04:42.660843] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T17:04:42.667532] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-13T17:04:42.810517] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T17:04:42.821823] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-13T17:04:43.172386] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T17:04:43.181726] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-13T17:04:43.423704] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T17:04:43.446229] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T17:04:43.617949] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-13T17:04:44.417966] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-13T17:04:44.559084] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T17:04:44.791477] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T17:04:44.994013] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:04:45.217925] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-13T17:04:45.310632] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T17:04:46.017954] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-13T17:04:46.809082] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T17:04:46.819771] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-13T17:04:47.224907] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T17:04:47.617952] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-13T17:04:48.327539] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T17:04:48.417913] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-13T17:04:48.489773] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T17:04:49.217946] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-13T17:04:49.682510] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T17:04:50.018016] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-13T17:04:50.818023] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-13T17:04:50.904490] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:04:51.618019] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-13T17:04:51.748414] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T17:04:51.942809] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T17:04:52.417974] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-13T17:04:52.667701] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T17:04:53.217933] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-13T17:04:53.311730] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T17:04:54.017984] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-13T17:04:54.319163] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T17:04:54.817966] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-13T17:04:55.617941] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-13T17:04:56.093939] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-13T17:04:56.252258] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T17:04:56.361622] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T17:04:56.417929] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-13T17:04:57.217971] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-13T17:04:57.521449] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T17:04:57.804959] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T17:04:58.018007] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-13T17:04:58.817977] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-13T17:04:59.582617] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T17:04:59.584690] [INFO ] [REMOTE ] AFB: Full fetch complete (16517 records). [2025-10-13T17:04:59.584766] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-13T17:04:59.623141] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-13T17:04:59.983515] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-13T17:04:59.983807] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-13T17:04:59.984246] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-13T17:04:59.984337] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-13T17:04:59.985308] [DEBUG] [LOCAL ] AFB: Trimmed 16517 records to 11281 (keeping 200 days of data) [2025-10-13T17:05:00.057193] [DEBUG] [LOCAL ] AFB: Primary data saved (11281 records). [2025-10-13T17:05:00.057392] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-13T17:05:00.057495] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFB took 22.7s. Estimated remaining: 4h 34m 6s. Rate: 8.5 symbols/min [2025-10-13T17:05:00.253212] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-13T17:05:00.290890] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:00.296759] [DEBUG] [LOCAL ] AFGB: Loaded 2330 existing records from primary storage. [2025-10-13T17:05:00.297066] [INFO ] [MAIN ] AFGB: Loaded 2330 existing records. [2025-10-13T17:05:00.423199] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-13T17:05:00.487763] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:00.488053] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-13T17:05:00.488105] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-13T17:05:00.488302] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-13T17:05:00.488362] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-13T17:05:00.871246] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:01.184579] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T17:05:01.217892] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-13T17:05:02.017906] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-13T17:05:02.441403] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-13T17:05:02.465568] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T17:05:02.470510] [INFO ] [REMOTE ] AFG: Full fetch complete (46130 records). [2025-10-13T17:05:02.470720] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-13T17:05:02.471622] [FATAL] [VALIDATOR ] AFG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:05:02.471739] [FATAL] [MAIN ] AFG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:05:02.471784] [WARN ] [MAIN ] AFG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:05:02.471832] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-13T17:05:02.471904] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-10-13T17:05:02.471946] [INFO ] [LOCAL ] AFG: Starting deletion of derivative data. [2025-10-13T17:05:02.472140] [DEBUG] [LOCAL ] AFG: Deleted derivative data file. [2025-10-13T17:05:02.472256] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AFG took 22.9s. Estimated remaining: 4h 29m 47s. Rate: 8.6 symbols/min [2025-10-13T17:05:02.687044] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:02.692067] [DEBUG] [LOCAL ] AFGC: Loaded 2568 existing records from primary storage. [2025-10-13T17:05:02.692306] [INFO ] [MAIN ] AFGC: Loaded 2568 existing records. [2025-10-13T17:05:02.823252] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-13T17:05:02.910227] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:02.910537] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-13T17:05:02.910615] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-13T17:05:02.910831] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-13T17:05:02.910882] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-13T17:05:03.317709] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:03.617956] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-13T17:05:03.971715] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T17:05:04.186625] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T17:05:04.417983] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-13T17:05:04.824014] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-13T17:05:04.862455] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T17:05:05.217923] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-13T17:05:05.643323] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T17:05:06.017993] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-13T17:05:06.817979] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-13T17:05:07.339725] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-13T17:05:07.617931] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-13T17:05:08.231757] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-13T17:05:08.234394] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-13T17:05:08.417936] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-13T17:05:08.926966] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-13T17:05:09.218015] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-13T17:05:09.629824] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-13T17:05:10.017936] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-13T17:05:10.817930] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-13T17:05:11.509884] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:05:11.617922] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-13T17:05:12.417927] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-13T17:05:12.725966] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-13T17:05:12.785383] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-13T17:05:12.913033] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T17:05:13.217962] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-13T17:05:13.785394] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T17:05:14.017969] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-13T17:05:14.542903] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T17:05:14.817925] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-13T17:05:15.285553] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T17:05:15.617921] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-13T17:05:16.417966] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-13T17:05:17.217909] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-13T17:05:17.312877] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:05:17.626984] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-13T17:05:18.017941] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-13T17:05:18.387156] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-13T17:05:18.394237] [INFO ] [REMOTE ] AES: Full fetch complete (77720 records). [2025-10-13T17:05:18.394489] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-13T17:05:18.572794] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T17:05:18.598757] [INFO ] [REMOTE ] AFGB: Full fetch complete (3597 records). [2025-10-13T17:05:18.664487] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-13T17:05:18.819081] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-13T17:05:18.936787] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-13T17:05:18.942252] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-13T17:05:18.948256] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-13T17:05:18.969015] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-13T17:05:19.003460] [DEBUG] [LOCAL ] AES: Trimmed 77720 records to 53669 (keeping 200 days of data) [2025-10-13T17:05:19.301611] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-13T17:05:19.302681] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-13T17:05:19.302848] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-13T17:05:19.302935] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-13T17:05:19.303705] [DEBUG] [LOCAL ] AFGB: Trimmed 3597 records to 2291 (keeping 200 days of data) [2025-10-13T17:05:19.324525] [DEBUG] [LOCAL ] AFGB: Primary data saved (2291 records). [2025-10-13T17:05:19.324689] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-13T17:05:19.324821] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFGB took 19.3s. Estimated remaining: 4h 38m 24s. Rate: 8.4 symbols/min [2025-10-13T17:05:19.512507] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:19.524477] [DEBUG] [LOCAL ] AFGD: Loaded 1816 existing records from primary storage. [2025-10-13T17:05:19.525624] [INFO ] [MAIN ] AFGD: Loaded 1816 existing records. [2025-10-13T17:05:19.626888] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-13T17:05:19.835983] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:19.843495] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-13T17:05:19.846613] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-13T17:05:19.848626] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-13T17:05:19.848765] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-13T17:05:20.343849] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T17:05:20.387282] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:20.393465] [DEBUG] [LOCAL ] AES: Primary data saved (53669 records). [2025-10-13T17:05:20.393948] [INFO ] [MAIN ] AES: Full history saved. [2025-10-13T17:05:20.394633] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AES took 43.0s. Estimated remaining: 4h 33m 1s. Rate: 8.5 symbols/min [2025-10-13T17:05:20.427517] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-13T17:05:20.593007] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T17:05:20.622830] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:20.629191] [DEBUG] [LOCAL ] AFGE: Loaded 2444 existing records from primary storage. [2025-10-13T17:05:20.629497] [INFO ] [MAIN ] AFGE: Loaded 2444 existing records. [2025-10-13T17:05:20.814126] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:20.814663] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-13T17:05:20.814731] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-13T17:05:20.814971] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-13T17:05:20.815030] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-13T17:05:21.114709] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T17:05:21.201499] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:21.217922] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-13T17:05:22.017929] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-13T17:05:22.418584] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-13T17:05:22.817944] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-13T17:05:22.940940] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T17:05:22.946186] [INFO ] [REMOTE ] AESI: Full fetch complete (70844 records). [2025-10-13T17:05:22.946291] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-13T17:05:23.283586] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-13T17:05:23.331186] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-13T17:05:23.331248] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-13T17:05:23.331912] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-13T17:05:23.331979] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-13T17:05:23.333305] [DEBUG] [LOCAL ] AESI: Trimmed 70844 records to 49713 (keeping 200 days of data) [2025-10-13T17:05:23.621498] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-13T17:05:23.621299] [DEBUG] [LOCAL ] AESI: Primary data saved (49713 records). [2025-10-13T17:05:23.621817] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-13T17:05:23.623447] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AESI took 46.3s. Estimated remaining: 4h 29m 41s. Rate: 8.6 symbols/min [2025-10-13T17:05:23.791552] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:23.841487] [DEBUG] [LOCAL ] AFL: Loaded 53938 existing records from primary storage. [2025-10-13T17:05:23.841838] [INFO ] [MAIN ] AFL: Loaded 53938 existing records. [2025-10-13T17:05:24.014008] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:24.014227] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-13T17:05:24.014281] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-13T17:05:24.014601] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-13T17:05:24.014697] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-13T17:05:24.268568] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T17:05:24.376144] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:24.417934] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-13T17:05:24.873063] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T17:05:25.217924] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-13T17:05:25.789771] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T17:05:26.017923] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-13T17:05:26.474615] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T17:05:26.817926] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-13T17:05:27.199327] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-13T17:05:27.617921] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-13T17:05:28.094590] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-13T17:05:28.417933] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-13T17:05:28.858713] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T17:05:29.217924] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-13T17:05:29.574370] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-13T17:05:30.017917] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-13T17:05:30.817918] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-13T17:05:31.378974] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T17:05:31.617896] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-13T17:05:31.719912] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T17:05:31.976150] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-13T17:05:32.417921] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-13T17:05:32.838313] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T17:05:33.217953] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-13T17:05:33.677177] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-13T17:05:34.017919] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-13T17:05:34.817993] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-13T17:05:35.279789] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-13T17:05:35.557764] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T17:05:35.617892] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-13T17:05:36.417940] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-13T17:05:36.897250] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-13T17:05:37.014637] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:05:37.217972] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-13T17:05:37.660025] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T17:05:38.017972] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-13T17:05:38.489670] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T17:05:38.817991] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-13T17:05:39.226581] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-13T17:05:39.617979] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-13T17:05:39.969142] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-13T17:05:39.970082] [INFO ] [REMOTE ] AFGD: Full fetch complete (3047 records). [2025-10-13T17:05:39.970207] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-13T17:05:40.363389] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-13T17:05:40.363564] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-13T17:05:40.363755] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-13T17:05:40.363824] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-13T17:05:40.364177] [DEBUG] [LOCAL ] AFGD: Trimmed 3047 records to 1795 (keeping 200 days of data) [2025-10-13T17:05:40.376766] [DEBUG] [LOCAL ] AFGD: Primary data saved (1795 records). [2025-10-13T17:05:40.376849] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-13T17:05:40.376929] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGD took 21.1s. Estimated remaining: 4h 37m 38s. Rate: 8.4 symbols/min [2025-10-13T17:05:40.423084] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-13T17:05:40.550536] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:40.609458] [DEBUG] [LOCAL ] AG: Loaded 54422 existing records from primary storage. [2025-10-13T17:05:40.609917] [INFO ] [MAIN ] AG: Loaded 54422 existing records. [2025-10-13T17:05:40.792608] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:40.792880] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-13T17:05:40.792926] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-13T17:05:40.793448] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-13T17:05:40.793505] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-13T17:05:40.983346] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T17:05:41.176722] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:41.217895] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-13T17:05:42.017983] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-13T17:05:42.818013] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-13T17:05:43.284967] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T17:05:43.303546] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-13T17:05:43.617911] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-13T17:05:44.010303] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-13T17:05:44.054453] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-13T17:05:44.417946] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-13T17:05:45.217965] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-13T17:05:45.962663] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T17:05:46.017943] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-13T17:05:46.817935] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-13T17:05:47.059072] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T17:05:47.206743] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-13T17:05:47.617896] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-13T17:05:47.803839] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T17:05:48.109606] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-13T17:05:48.417937] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-13T17:05:49.217939] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-13T17:05:49.880310] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-13T17:05:50.017919] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-13T17:05:50.288168] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T17:05:50.382257] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-13T17:05:50.817981] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-13T17:05:51.617926] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-13T17:05:52.020465] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-13T17:05:52.021228] [INFO ] [REMOTE ] AFGC: Full fetch complete (3670 records). [2025-10-13T17:05:52.021293] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-13T17:05:52.389558] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-13T17:05:52.389743] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-13T17:05:52.389923] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-13T17:05:52.390150] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-13T17:05:52.390814] [DEBUG] [LOCAL ] AFGC: Trimmed 3670 records to 2526 (keeping 200 days of data) [2025-10-13T17:05:52.406591] [DEBUG] [LOCAL ] AFGC: Primary data saved (2526 records). [2025-10-13T17:05:52.406712] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-13T17:05:52.406796] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGC took 49.9s. Estimated remaining: 4h 41m 26s. Rate: 8.3 symbols/min [2025-10-13T17:05:52.423708] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-13T17:05:52.546830] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T17:05:52.631368] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:52.673111] [DEBUG] [LOCAL ] AGCO: Loaded 42959 existing records from primary storage. [2025-10-13T17:05:52.673380] [INFO ] [MAIN ] AGCO: Loaded 42959 existing records. [2025-10-13T17:05:52.851570] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:05:52.851829] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-13T17:05:52.851878] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-13T17:05:52.852296] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-13T17:05:52.852355] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-13T17:05:53.000320] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T17:05:53.056963] [INFO ] [REMOTE ] AFGE: Full fetch complete (3453 records). [2025-10-13T17:05:53.105363] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-13T17:05:53.218162] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-13T17:05:53.392979] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:53.615052] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-13T17:05:53.615126] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-13T17:05:53.615243] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-13T17:05:53.615283] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-13T17:05:53.615623] [DEBUG] [LOCAL ] AFGE: Trimmed 3453 records to 2404 (keeping 200 days of data) [2025-10-13T17:05:53.630634] [DEBUG] [LOCAL ] AFGE: Primary data saved (2404 records). [2025-10-13T17:05:53.630735] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-13T17:05:53.630808] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 33.2s. Estimated remaining: 4h 36m 33s. Rate: 8.4 symbols/min [2025-10-13T17:05:53.801790] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:05:53.801971] [DEBUG] [LOCAL ] AGD: No existing data file found in primary storage. [2025-10-13T17:05:53.802009] [WARN ] [MAIN ] AGD: No existing data found, performing full refresh instead. [2025-10-13T17:05:53.802118] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-13T17:05:53.802159] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-13T17:05:53.802200] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-10-13T17:05:53.802231] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-13T17:05:54.023020] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-13T17:05:54.175451] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:05:54.817930] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-13T17:05:55.142521] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T17:05:55.617982] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-13T17:05:55.790212] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T17:05:56.277248] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-13T17:05:56.417916] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-13T17:05:57.217924] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-13T17:05:57.392681] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T17:05:58.017911] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-13T17:05:58.451549] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-13T17:05:58.684798] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T17:05:58.817962] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-13T17:05:59.617903] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-13T17:05:59.865759] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T17:05:59.890909] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:06:00.417928] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-13T17:06:01.016037] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T17:06:01.042952] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T17:06:01.217923] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-13T17:06:02.017984] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-13T17:06:02.817946] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-13T17:06:02.868543] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T17:06:03.617889] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-13T17:06:03.629482] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T17:06:03.869111] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T17:06:03.874923] [INFO ] [REMOTE ] AFL: Full fetch complete (76908 records). [2025-10-13T17:06:03.875099] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-13T17:06:04.274011] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-13T17:06:04.274141] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-13T17:06:04.274893] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-13T17:06:04.274959] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-13T17:06:04.276487] [DEBUG] [LOCAL ] AFL: Trimmed 76908 records to 53185 (keeping 200 days of data) [2025-10-13T17:06:04.460102] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-13T17:06:04.608157] [DEBUG] [LOCAL ] AFL: Primary data saved (53185 records). [2025-10-13T17:06:04.608293] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-13T17:06:04.608374] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 41.0s. Estimated remaining: 4h 39m 23s. Rate: 8.3 symbols/min [2025-10-13T17:06:04.780766] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:04.833531] [DEBUG] [LOCAL ] AGI: Loaded 54200 existing records from primary storage. [2025-10-13T17:06:04.834056] [INFO ] [MAIN ] AGI: Loaded 54200 existing records. [2025-10-13T17:06:05.033616] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:05.033971] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-13T17:06:05.034125] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-13T17:06:05.034674] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-13T17:06:05.034741] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-13T17:06:05.227876] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-13T17:06:05.375835] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T17:06:05.514445] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:06.017931] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-13T17:06:06.317024] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T17:06:06.366165] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T17:06:06.817958] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-13T17:06:07.617947] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-13T17:06:07.818403] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T17:06:08.417954] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-13T17:06:08.662947] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T17:06:08.949368] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-13T17:06:09.217967] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-13T17:06:10.017953] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-13T17:06:10.077734] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T17:06:10.594052] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T17:06:10.817945] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-13T17:06:11.617979] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-13T17:06:11.658742] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T17:06:12.201607] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-13T17:06:12.417992] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-13T17:06:13.217970] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-13T17:06:13.325676] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T17:06:14.017905] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-13T17:06:14.376419] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T17:06:14.442421] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T17:06:14.817975] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-13T17:06:15.617900] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-13T17:06:15.775166] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T17:06:16.417900] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-13T17:06:16.463465] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:06:17.217943] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-13T17:06:17.543713] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T17:06:17.771639] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-13T17:06:18.017946] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-13T17:06:18.715607] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T17:06:18.779428] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T17:06:18.817897] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-13T17:06:19.497883] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T17:06:19.617922] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-13T17:06:20.417912] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-13T17:06:20.720322] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T17:06:21.217942] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-13T17:06:22.017931] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-13T17:06:22.817900] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-13T17:06:22.841350] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-13T17:06:22.847247] [INFO ] [REMOTE ] AG: Full fetch complete (77619 records). [2025-10-13T17:06:22.847374] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-13T17:06:23.001683] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T17:06:23.105427] [INFO ] [REMOTE ] AGD: Full fetch complete (26258 records). [2025-10-13T17:06:23.130373] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-13T17:06:23.444462] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-13T17:06:23.531268] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-13T17:06:23.551605] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-13T17:06:23.604906] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-13T17:06:23.633174] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-13T17:06:23.633103] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-13T17:06:23.703851] [DEBUG] [LOCAL ] AG: Trimmed 77619 records to 53643 (keeping 200 days of data) [2025-10-13T17:06:23.731435] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-13T17:06:23.731524] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-13T17:06:23.731852] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-13T17:06:23.731912] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-13T17:06:23.732738] [DEBUG] [LOCAL ] AGD: Trimmed 26258 records to 19042 (keeping 200 days of data) [2025-10-13T17:06:23.965351] [DEBUG] [LOCAL ] AGD: Primary data saved (19042 records). [2025-10-13T17:06:23.967071] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-13T17:06:23.967457] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGD took 30.3s. Estimated remaining: 4h 48m 28s. Rate: 8.0 symbols/min [2025-10-13T17:06:24.148671] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:24.319761] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T17:06:24.332880] [DEBUG] [LOCAL ] AGL: Loaded 53272 existing records from primary storage. [2025-10-13T17:06:24.335824] [INFO ] [MAIN ] AGL: Loaded 53272 existing records. [2025-10-13T17:06:24.422446] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-13T17:06:24.628420] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:24.629598] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-13T17:06:24.630041] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-13T17:06:24.631038] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-13T17:06:24.632590] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-13T17:06:24.755148] [DEBUG] [LOCAL ] AG: Primary data saved (53643 records). [2025-10-13T17:06:24.775435] [INFO ] [MAIN ] AG: Full history saved. [2025-10-13T17:06:24.776382] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AG took 44.4s. Estimated remaining: 4h 43m 24s. Rate: 8.2 symbols/min [2025-10-13T17:06:25.040957] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:25.212174] [DEBUG] [LOCAL ] AGM: Loaded 10669 existing records from primary storage. [2025-10-13T17:06:25.231363] [INFO ] [MAIN ] AGM: Loaded 10669 existing records. [2025-10-13T17:06:25.313347] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:25.332418] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-13T17:06:25.459020] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:25.460072] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-13T17:06:25.460123] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-13T17:06:25.460267] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-13T17:06:25.460305] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-13T17:06:25.791504] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-13T17:06:25.892042] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T17:06:25.897909] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:25.903069] [INFO ] [REMOTE ] AGCO: Full fetch complete (61614 records). [2025-10-13T17:06:25.903190] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-13T17:06:26.023010] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-13T17:06:26.285029] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-13T17:06:26.285115] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-13T17:06:26.285733] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-13T17:06:26.285796] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-13T17:06:26.287041] [DEBUG] [LOCAL ] AGCO: Trimmed 61614 records to 42483 (keeping 200 days of data) [2025-10-13T17:06:26.544164] [DEBUG] [LOCAL ] AGCO: Primary data saved (42483 records). [2025-10-13T17:06:26.544296] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-13T17:06:26.544370] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGCO took 34.1s. Estimated remaining: 4h 39m 14s. Rate: 8.3 symbols/min [2025-10-13T17:06:26.709052] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:26.735784] [DEBUG] [LOCAL ] AGO: Loaded 28322 existing records from primary storage. [2025-10-13T17:06:26.736059] [INFO ] [MAIN ] AGO: Loaded 28322 existing records. [2025-10-13T17:06:26.824404] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-13T17:06:26.913796] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:26.914054] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-13T17:06:26.914102] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-13T17:06:26.914453] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-13T17:06:26.914516] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-13T17:06:27.265611] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T17:06:27.308297] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:27.558937] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-13T17:06:27.628875] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-13T17:06:27.655763] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T17:06:28.199167] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T17:06:28.417926] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-13T17:06:29.050584] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T17:06:29.217903] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-13T17:06:29.932915] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T17:06:30.017891] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-13T17:06:30.814828] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T17:06:30.817870] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-13T17:06:31.391403] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T17:06:31.617899] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-13T17:06:32.417928] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-13T17:06:33.217932] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-13T17:06:33.527968] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T17:06:33.627282] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-13T17:06:34.017971] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-13T17:06:34.817917] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-13T17:06:34.950321] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T17:06:34.990675] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:06:35.617914] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-13T17:06:36.230056] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T17:06:36.417944] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-13T17:06:37.057507] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T17:06:37.217949] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-13T17:06:37.567294] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T17:06:38.017925] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-13T17:06:38.817908] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-13T17:06:38.857741] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-13T17:06:38.889223] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T17:06:39.617921] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-13T17:06:40.417911] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-13T17:06:40.511027] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T17:06:41.229149] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-13T17:06:41.258303] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T17:06:41.704539] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T17:06:42.017929] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-13T17:06:42.785720] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T17:06:42.817889] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-13T17:06:43.454425] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T17:06:43.617931] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-13T17:06:44.414600] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T17:06:44.424779] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-13T17:06:44.443837] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T17:06:45.217976] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-13T17:06:45.927665] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T17:06:46.017950] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-13T17:06:46.430315] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-13T17:06:46.436370] [INFO ] [REMOTE ] AGI: Full fetch complete (76961 records). [2025-10-13T17:06:46.436571] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-13T17:06:46.827887] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-13T17:06:46.854549] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-13T17:06:46.854808] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-13T17:06:46.855824] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-13T17:06:46.855907] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-13T17:06:46.858497] [DEBUG] [LOCAL ] AGI: Trimmed 76961 records to 53423 (keeping 200 days of data) [2025-10-13T17:06:47.198049] [DEBUG] [LOCAL ] AGI: Primary data saved (53423 records). [2025-10-13T17:06:47.198247] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-13T17:06:47.198349] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGI took 42.6s. Estimated remaining: 4h 48m 42s. Rate: 8.0 symbols/min [2025-10-13T17:06:47.378702] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:47.414718] [DEBUG] [LOCAL ] AGRO: Loaded 33809 existing records from primary storage. [2025-10-13T17:06:47.415088] [INFO ] [MAIN ] AGRO: Loaded 33809 existing records. [2025-10-13T17:06:47.610625] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:47.611209] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-13T17:06:47.611351] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-13T17:06:47.611994] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-13T17:06:47.612057] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-13T17:06:47.643978] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-13T17:06:47.899555] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:06:48.028379] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:48.314114] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T17:06:48.417945] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-13T17:06:48.528772] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T17:06:48.530864] [INFO ] [REMOTE ] AGM: Full fetch complete (13194 records). [2025-10-13T17:06:48.530964] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-13T17:06:48.933723] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-13T17:06:48.933857] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-13T17:06:48.934110] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-13T17:06:48.934153] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-13T17:06:48.934710] [DEBUG] [LOCAL ] AGM: Trimmed 13194 records to 10647 (keeping 200 days of data) [2025-10-13T17:06:49.003825] [DEBUG] [LOCAL ] AGM: Primary data saved (10647 records). [2025-10-13T17:06:49.003973] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-13T17:06:49.004064] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGM took 24.2s. Estimated remaining: 4h 44m 36s. Rate: 8.1 symbols/min [2025-10-13T17:06:49.179513] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:49.219792] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-13T17:06:49.222487] [DEBUG] [LOCAL ] AGX: Loaded 33549 existing records from primary storage. [2025-10-13T17:06:49.223015] [INFO ] [MAIN ] AGX: Loaded 33549 existing records. [2025-10-13T17:06:49.429436] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:49.429861] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-13T17:06:49.429916] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-13T17:06:49.430261] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-13T17:06:49.430337] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-13T17:06:49.860854] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:49.934183] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T17:06:50.017903] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-13T17:06:50.744303] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T17:06:50.818013] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-13T17:06:50.993668] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T17:06:51.618056] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-13T17:06:52.417900] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-13T17:06:52.704731] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T17:06:53.136577] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T17:06:53.217938] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-13T17:06:53.494768] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T17:06:54.017922] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-13T17:06:54.668920] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:06:54.817993] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-13T17:06:55.424286] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T17:06:55.617952] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-13T17:06:56.220668] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:06:56.417955] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-13T17:06:57.217934] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-13T17:06:57.312686] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T17:06:57.318208] [INFO ] [REMOTE ] AGL: Full fetch complete (75634 records). [2025-10-13T17:06:57.318331] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-13T17:06:57.784024] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-13T17:06:57.784136] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-13T17:06:57.785016] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-13T17:06:57.785263] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-13T17:06:57.804896] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:06:57.813120] [DEBUG] [LOCAL ] AGL: Trimmed 75634 records to 52552 (keeping 200 days of data) [2025-10-13T17:06:58.020981] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-13T17:06:58.109231] [DEBUG] [LOCAL ] AGL: Primary data saved (52552 records). [2025-10-13T17:06:58.109375] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-13T17:06:58.109468] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGL took 34.1s. Estimated remaining: 4h 45m 40s. Rate: 8.1 symbols/min [2025-10-13T17:06:58.283943] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:06:58.321634] [DEBUG] [LOCAL ] AHH: Loaded 41288 existing records from primary storage. [2025-10-13T17:06:58.321975] [INFO ] [MAIN ] AHH: Loaded 41288 existing records. [2025-10-13T17:06:58.525537] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:06:58.525839] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-13T17:06:58.525905] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-13T17:06:58.544136] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-13T17:06:58.544330] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-13T17:06:58.619207] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T17:06:58.823140] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-13T17:06:58.928771] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:06:59.038495] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T17:06:59.617908] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-13T17:06:59.759400] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T17:07:00.417991] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-13T17:07:01.134071] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T17:07:01.217993] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-13T17:07:01.663912] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T17:07:01.667220] [INFO ] [REMOTE ] AGO: Full fetch complete (39348 records). [2025-10-13T17:07:01.670551] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-13T17:07:01.671899] [FATAL] [VALIDATOR ] AGO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:07:01.671991] [FATAL] [MAIN ] AGO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:07:01.672040] [WARN ] [MAIN ] AGO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:07:01.672128] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-13T17:07:01.672227] [DEBUG] [LOCAL ] AGO: No primary data file found to delete. [2025-10-13T17:07:01.672293] [INFO ] [LOCAL ] AGO: Starting deletion of derivative data. [2025-10-13T17:07:01.672823] [DEBUG] [LOCAL ] AGO: Deleted derivative data file. [2025-10-13T17:07:01.673831] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 35.1s. Estimated remaining: 4h 42m 57s. Rate: 8.2 symbols/min [2025-10-13T17:07:01.868897] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:01.869140] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-13T17:07:01.869180] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-13T17:07:01.869351] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-13T17:07:01.869393] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-13T17:07:01.869434] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-13T17:07:01.869466] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-13T17:07:02.025885] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-13T17:07:02.279599] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:02.591283] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T17:07:02.817991] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-13T17:07:03.536133] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:07:03.617963] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-13T17:07:03.818524] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:07:03.818988] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-13T17:07:03.819102] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:07:03.819163] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-13T17:07:03.819244] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:07:03.819330] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-13T17:07:03.819411] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-13T17:07:03.819454] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-13T17:07:03.819497] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-13T17:07:03.819551] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AHL took 2.1s. Estimated remaining: 4h 39m 23s. Rate: 8.3 symbols/min [2025-10-13T17:07:04.018543] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:04.071999] [DEBUG] [LOCAL ] AHR: Loaded 49812 existing records from primary storage. [2025-10-13T17:07:04.072422] [INFO ] [MAIN ] AHR: Loaded 49812 existing records. [2025-10-13T17:07:04.254246] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:07:04.254789] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-13T17:07:04.254857] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-13T17:07:04.255413] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-13T17:07:04.255580] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-13T17:07:04.418427] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-13T17:07:04.643852] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:04.649664] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T17:07:05.217926] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-13T17:07:05.892351] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T17:07:06.017969] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-13T17:07:06.817917] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-13T17:07:06.926563] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T17:07:07.187121] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-13T17:07:07.617990] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-13T17:07:08.253100] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T17:07:08.417958] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-13T17:07:09.227155] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-13T17:07:09.255157] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:07:09.810333] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T17:07:10.017912] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-13T17:07:10.711257] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:07:10.817902] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-13T17:07:11.618031] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-13T17:07:11.698310] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T17:07:12.320736] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T17:07:12.417976] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-13T17:07:12.738897] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T17:07:13.217943] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-13T17:07:13.757919] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T17:07:14.017938] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-13T17:07:14.116281] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T17:07:14.817907] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-13T17:07:15.617961] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-13T17:07:15.776085] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T17:07:15.986269] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T17:07:16.417933] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-13T17:07:17.011237] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T17:07:17.217957] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-13T17:07:18.017978] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-13T17:07:18.157618] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:07:18.276699] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T17:07:18.817955] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-13T17:07:19.617961] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-13T17:07:19.930720] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T17:07:20.417902] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-13T17:07:20.634350] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:07:21.165848] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T17:07:21.217909] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-13T17:07:21.568539] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T17:07:21.572380] [INFO ] [REMOTE ] AGRO: Full fetch complete (49100 records). [2025-10-13T17:07:21.572475] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-13T17:07:21.975248] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-13T17:07:21.975327] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-13T17:07:21.975835] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-13T17:07:21.975897] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-13T17:07:21.977010] [DEBUG] [LOCAL ] AGRO: Trimmed 49100 records to 33364 (keeping 200 days of data) [2025-10-13T17:07:22.025114] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-13T17:07:22.173476] [DEBUG] [LOCAL ] AGRO: Primary data saved (33364 records). [2025-10-13T17:07:22.173732] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-13T17:07:22.173823] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGRO took 35.0s. Estimated remaining: 4h 46m 31s. Rate: 8.1 symbols/min [2025-10-13T17:07:22.348490] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:22.379932] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T17:07:22.385835] [DEBUG] [LOCAL ] AHT: Loaded 6364 existing records from primary storage. [2025-10-13T17:07:22.394421] [INFO ] [MAIN ] AHT: Loaded 6364 existing records. [2025-10-13T17:07:22.582526] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:07:22.582804] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-13T17:07:22.582857] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-13T17:07:22.583056] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-13T17:07:22.583114] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-13T17:07:22.830158] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-13T17:07:22.965058] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:23.364726] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T17:07:23.617943] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-13T17:07:24.239408] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T17:07:24.417921] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-13T17:07:25.109281] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T17:07:25.217934] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-13T17:07:25.830090] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T17:07:26.017934] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-13T17:07:26.771419] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T17:07:26.817957] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-13T17:07:27.617917] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-13T17:07:27.709346] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:07:27.754575] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T17:07:28.417952] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-13T17:07:28.870317] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T17:07:28.873914] [INFO ] [REMOTE ] AGX: Full fetch complete (48660 records). [2025-10-13T17:07:28.874026] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-13T17:07:29.027203] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:07:29.223080] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-13T17:07:29.294630] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-13T17:07:29.294753] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-13T17:07:29.295337] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-13T17:07:29.295400] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-13T17:07:29.296409] [DEBUG] [LOCAL ] AGX: Trimmed 48660 records to 33020 (keeping 200 days of data) [2025-10-13T17:07:29.496362] [DEBUG] [LOCAL ] AGX: Primary data saved (33020 records). [2025-10-13T17:07:29.496490] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-13T17:07:29.497587] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AGX took 40.5s. Estimated remaining: 4h 46m 19s. Rate: 8.1 symbols/min [2025-10-13T17:07:29.664461] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:29.664689] [DEBUG] [LOCAL ] AI: No existing data file found in primary storage. [2025-10-13T17:07:29.664763] [WARN ] [MAIN ] AI: No existing data found, performing full refresh instead. [2025-10-13T17:07:29.664875] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-13T17:07:29.664916] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-13T17:07:29.664957] [DEBUG] [LOCAL ] AI: No primary data file found to delete. [2025-10-13T17:07:29.664998] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-13T17:07:30.024791] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:30.019455] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-13T17:07:30.032142] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T17:07:30.817923] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-13T17:07:31.617901] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-13T17:07:31.681403] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T17:07:31.685605] [INFO ] [REMOTE ] AHH: Full fetch complete (59734 records). [2025-10-13T17:07:31.685755] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-13T17:07:32.069623] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-13T17:07:32.069746] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-13T17:07:32.070385] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-13T17:07:32.070433] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-13T17:07:32.071881] [DEBUG] [LOCAL ] AHH: Trimmed 59734 records to 40607 (keeping 200 days of data) [2025-10-13T17:07:32.308250] [DEBUG] [LOCAL ] AHH: Primary data saved (40607 records). [2025-10-13T17:07:32.308658] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-13T17:07:32.308766] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHH took 34.2s. Estimated remaining: 4h 43m 17s. Rate: 8.2 symbols/min [2025-10-13T17:07:32.423104] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-13T17:07:32.484612] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:32.539211] [DEBUG] [LOCAL ] AIG: Loaded 54250 existing records from primary storage. [2025-10-13T17:07:32.539634] [INFO ] [MAIN ] AIG: Loaded 54250 existing records. [2025-10-13T17:07:32.718736] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:07:32.719005] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-13T17:07:32.719054] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-13T17:07:32.719933] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-13T17:07:32.719995] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-13T17:07:33.038989] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T17:07:33.122902] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:33.199896] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T17:07:33.217888] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-13T17:07:33.479972] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-13T17:07:34.017930] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-13T17:07:34.828736] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-13T17:07:34.835311] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T17:07:35.475323] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T17:07:35.617923] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-13T17:07:36.237905] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-13T17:07:36.417967] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-13T17:07:37.204171] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:07:37.217896] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-13T17:07:38.017969] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-13T17:07:38.682597] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-13T17:07:38.692915] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T17:07:38.817944] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-13T17:07:38.984473] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:07:39.413838] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T17:07:39.617960] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-13T17:07:40.409527] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T17:07:40.417873] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-13T17:07:41.145465] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T17:07:41.217941] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-13T17:07:42.017913] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-13T17:07:42.818019] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-13T17:07:42.878115] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T17:07:43.556396] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T17:07:43.617966] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-13T17:07:44.121785] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-13T17:07:44.178829] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T17:07:44.181119] [INFO ] [REMOTE ] AHT: Full fetch complete (9208 records). [2025-10-13T17:07:44.181310] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-13T17:07:44.423206] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-13T17:07:44.765009] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-13T17:07:44.765144] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-13T17:07:44.765575] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-13T17:07:44.765673] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-13T17:07:44.766408] [DEBUG] [LOCAL ] AHT: Trimmed 9208 records to 6328 (keeping 200 days of data) [2025-10-13T17:07:44.804432] [DEBUG] [LOCAL ] AHT: Primary data saved (6328 records). [2025-10-13T17:07:44.804622] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-13T17:07:44.804760] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHT took 22.6s. Estimated remaining: 4h 46m 21s. Rate: 8.1 symbols/min [2025-10-13T17:07:44.996949] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:44.997180] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-13T17:07:44.997275] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-13T17:07:44.997403] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-13T17:07:44.997452] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-13T17:07:44.997496] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-13T17:07:44.997529] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-13T17:07:45.223202] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-13T17:07:45.376236] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:46.017979] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-13T17:07:46.205906] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:07:46.206368] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-13T17:07:46.206467] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:07:46.206520] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-13T17:07:46.206558] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:07:46.206600] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-13T17:07:46.206692] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-13T17:07:46.206754] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-13T17:07:46.206801] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-13T17:07:46.206857] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AII took 1.4s. Estimated remaining: 4h 42m 32s. Rate: 8.2 symbols/min [2025-10-13T17:07:46.394233] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:46.423814] [DEBUG] [LOCAL ] AIN: Loaded 24875 existing records from primary storage. [2025-10-13T17:07:46.424203] [INFO ] [MAIN ] AIN: Loaded 24875 existing records. [2025-10-13T17:07:46.624326] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:07:46.625056] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-13T17:07:46.625135] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-13T17:07:46.637559] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-13T17:07:46.656458] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-13T17:07:46.695209] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-13T17:07:46.834009] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-13T17:07:47.079625] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:47.140664] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-13T17:07:47.618004] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-13T17:07:48.417995] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-13T17:07:48.928179] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-13T17:07:49.217988] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-13T17:07:49.418122] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T17:07:49.444959] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:07:50.017996] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-13T17:07:50.817953] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-13T17:07:51.091107] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:07:51.328573] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-13T17:07:51.617952] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-13T17:07:52.417953] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-13T17:07:52.560730] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T17:07:52.567212] [INFO ] [REMOTE ] AHR: Full fetch complete (70665 records). [2025-10-13T17:07:52.567516] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-13T17:07:52.998879] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-13T17:07:52.999013] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-13T17:07:53.000040] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-13T17:07:53.000153] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-13T17:07:53.002362] [DEBUG] [LOCAL ] AHR: Trimmed 70665 records to 49096 (keeping 200 days of data) [2025-10-13T17:07:53.234143] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-13T17:07:53.340003] [DEBUG] [LOCAL ] AHR: Primary data saved (49096 records). [2025-10-13T17:07:53.340195] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-13T17:07:53.341372] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AHR took 49.5s. Estimated remaining: 4h 42m 17s. Rate: 8.2 symbols/min [2025-10-13T17:07:53.504274] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T17:07:53.558751] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:07:53.558971] [DEBUG] [LOCAL ] AIO: No existing data file found in primary storage. [2025-10-13T17:07:53.559009] [WARN ] [MAIN ] AIO: No existing data found, performing full refresh instead. [2025-10-13T17:07:53.559151] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-13T17:07:53.559194] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-13T17:07:53.559236] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-10-13T17:07:53.559270] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-13T17:07:53.950012] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:07:54.030058] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-13T17:07:54.037726] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-13T17:07:54.817941] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-13T17:07:55.062428] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:07:55.212314] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T17:07:55.617996] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-13T17:07:56.417917] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-13T17:07:56.824183] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T17:07:57.217919] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-13T17:07:57.412470] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-13T17:07:58.017904] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-13T17:07:58.191558] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T17:07:58.229733] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T17:07:58.817917] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-13T17:07:59.250770] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:07:59.617953] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-13T17:08:00.417939] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-13T17:08:00.522723] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T17:08:00.637686] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T17:08:01.217966] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-13T17:08:01.823724] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T17:08:02.017961] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-13T17:08:02.711682] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T17:08:02.818006] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-13T17:08:03.548156] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-13T17:08:03.617901] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-13T17:08:03.820211] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T17:08:04.417979] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-13T17:08:05.217975] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-13T17:08:05.674027] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T17:08:06.017939] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-13T17:08:06.111888] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-13T17:08:06.118497] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-13T17:08:06.118713] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-13T17:08:06.534963] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-13T17:08:06.535170] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-13T17:08:06.536049] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-13T17:08:06.536117] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-13T17:08:06.538219] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53759 (keeping 200 days of data) [2025-10-13T17:08:06.810960] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T17:08:06.824288] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-13T17:08:06.921549] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T17:08:06.951331] [DEBUG] [LOCAL ] AI: Primary data saved (53759 records). [2025-10-13T17:08:06.951536] [INFO ] [MAIN ] AI: Full history saved. [2025-10-13T17:08:06.951631] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AI took 37.5s. Estimated remaining: 4h 45m 52s. Rate: 8.1 symbols/min [2025-10-13T17:08:07.136990] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:07.166961] [DEBUG] [LOCAL ] AIR: Loaded 29366 existing records from primary storage. [2025-10-13T17:08:07.167303] [INFO ] [MAIN ] AIR: Loaded 29366 existing records. [2025-10-13T17:08:07.364424] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:07.364750] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-13T17:08:07.364808] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-13T17:08:07.365264] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-13T17:08:07.365324] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-13T17:08:07.626225] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-13T17:08:07.768060] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:07.853483] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T17:08:08.417954] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-13T17:08:08.459227] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T17:08:09.217942] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-13T17:08:09.510324] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T17:08:10.017930] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-13T17:08:10.049760] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T17:08:10.817946] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-13T17:08:11.589762] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T17:08:11.617890] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-13T17:08:11.769317] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:08:12.122150] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-13T17:08:12.417964] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-13T17:08:13.217975] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-13T17:08:13.232578] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T17:08:14.017969] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-13T17:08:14.361944] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T17:08:14.817942] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-13T17:08:14.898734] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T17:08:14.900946] [INFO ] [REMOTE ] AIO: Full fetch complete (20119 records). [2025-10-13T17:08:14.901020] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-13T17:08:15.299729] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-13T17:08:15.299844] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-13T17:08:15.300279] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-13T17:08:15.300323] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-13T17:08:15.301093] [DEBUG] [LOCAL ] AIO: Trimmed 20119 records to 13409 (keeping 200 days of data) [2025-10-13T17:08:15.385702] [DEBUG] [LOCAL ] AIO: Primary data saved (13409 records). [2025-10-13T17:08:15.385895] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-13T17:08:15.385987] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIO took 22.0s. Estimated remaining: 4h 46m 19s. Rate: 8.1 symbols/min [2025-10-13T17:08:15.560289] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:15.593293] [DEBUG] [LOCAL ] AIT: Loaded 27469 existing records from primary storage. [2025-10-13T17:08:15.593685] [INFO ] [MAIN ] AIT: Loaded 27469 existing records. [2025-10-13T17:08:15.625297] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-13T17:08:15.781937] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:15.782166] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-13T17:08:15.782249] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-13T17:08:15.782562] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-13T17:08:15.782621] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-13T17:08:16.144093] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:16.445443] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-13T17:08:16.472494] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T17:08:16.512513] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T17:08:17.217951] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-13T17:08:17.713491] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:08:18.017977] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-13T17:08:18.465413] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T17:08:18.487691] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T17:08:18.493763] [INFO ] [REMOTE ] AIG: Full fetch complete (77385 records). [2025-10-13T17:08:18.493933] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-13T17:08:18.823085] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-13T17:08:18.914982] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-13T17:08:18.915185] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-13T17:08:18.916207] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-13T17:08:18.916682] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-13T17:08:18.919426] [DEBUG] [LOCAL ] AIG: Trimmed 77385 records to 53474 (keeping 200 days of data) [2025-10-13T17:08:19.275384] [DEBUG] [LOCAL ] AIG: Primary data saved (53474 records). [2025-10-13T17:08:19.275552] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-13T17:08:19.275717] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIG took 47.0s. Estimated remaining: 4h 44m 9s. Rate: 8.1 symbols/min [2025-10-13T17:08:19.455300] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:19.491901] [DEBUG] [LOCAL ] AIV: Loaded 41565 existing records from primary storage. [2025-10-13T17:08:19.492192] [INFO ] [MAIN ] AIV: Loaded 41565 existing records. [2025-10-13T17:08:19.623140] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-13T17:08:19.694963] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:19.695218] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-13T17:08:19.695268] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-13T17:08:19.695600] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-13T17:08:19.695700] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-13T17:08:20.085418] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:20.246168] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T17:08:20.417942] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-13T17:08:20.793822] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T17:08:21.217931] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-13T17:08:21.561787] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T17:08:22.017945] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-13T17:08:22.299783] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-13T17:08:22.302795] [INFO ] [REMOTE ] AIN: Full fetch complete (33500 records). [2025-10-13T17:08:22.302870] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-13T17:08:22.668308] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-13T17:08:22.668385] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-13T17:08:22.668811] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-13T17:08:22.668873] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-13T17:08:22.669748] [DEBUG] [LOCAL ] AIN: Trimmed 33500 records to 24485 (keeping 200 days of data) [2025-10-13T17:08:22.819316] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-13T17:08:22.826890] [DEBUG] [LOCAL ] AIN: Primary data saved (24485 records). [2025-10-13T17:08:22.827033] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-13T17:08:22.827119] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIN took 36.6s. Estimated remaining: 4h 41m 52s. Rate: 8.2 symbols/min [2025-10-13T17:08:23.004383] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:23.035437] [DEBUG] [LOCAL ] AIZ: Loaded 30023 existing records from primary storage. [2025-10-13T17:08:23.035725] [INFO ] [MAIN ] AIZ: Loaded 30023 existing records. [2025-10-13T17:08:23.220149] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:23.220624] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-13T17:08:23.220782] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-13T17:08:23.221373] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-13T17:08:23.221468] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-13T17:08:23.337054] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:08:23.609217] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:23.617888] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-13T17:08:23.783440] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T17:08:24.417930] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-13T17:08:25.013603] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T17:08:25.217956] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-13T17:08:25.357209] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T17:08:26.017955] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-13T17:08:26.728135] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:08:26.817928] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-13T17:08:27.368490] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T17:08:27.617949] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-13T17:08:28.085701] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T17:08:28.417936] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-13T17:08:28.989246] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T17:08:29.217940] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-13T17:08:29.760077] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-13T17:08:30.017971] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-13T17:08:30.580910] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T17:08:30.817972] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-13T17:08:31.397280] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:08:31.617982] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-13T17:08:32.255627] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T17:08:32.417890] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-13T17:08:33.013689] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T17:08:33.217899] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-13T17:08:33.662822] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T17:08:34.017926] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-13T17:08:34.661437] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T17:08:34.817919] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-13T17:08:34.936423] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-13T17:08:35.617933] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-13T17:08:36.373399] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:08:36.417953] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-13T17:08:36.818632] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T17:08:37.217987] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-13T17:08:37.860110] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T17:08:38.017966] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-13T17:08:38.731736] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T17:08:38.817909] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-13T17:08:39.310249] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T17:08:39.617911] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-13T17:08:40.083498] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T17:08:40.418028] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-13T17:08:40.788784] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T17:08:41.217942] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-13T17:08:41.785110] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T17:08:42.017908] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-13T17:08:42.288239] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T17:08:42.290923] [INFO ] [REMOTE ] AIT: Full fetch complete (39052 records). [2025-10-13T17:08:42.291013] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-13T17:08:42.706892] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-13T17:08:42.706970] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-13T17:08:42.707383] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-13T17:08:42.707442] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-13T17:08:42.708285] [DEBUG] [LOCAL ] AIT: Trimmed 39052 records to 27046 (keeping 200 days of data) [2025-10-13T17:08:42.822679] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-13T17:08:42.881973] [DEBUG] [LOCAL ] AIT: Primary data saved (27046 records). [2025-10-13T17:08:42.882132] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-13T17:08:42.882214] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIT took 27.5s. Estimated remaining: 4h 48m 48s. Rate: 8.0 symbols/min [2025-10-13T17:08:43.058157] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:43.064407] [DEBUG] [LOCAL ] AIZN: Loaded 4172 existing records from primary storage. [2025-10-13T17:08:43.064583] [INFO ] [MAIN ] AIZN: Loaded 4172 existing records. [2025-10-13T17:08:43.250823] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:43.251268] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-13T17:08:43.251342] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-13T17:08:43.251631] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-13T17:08:43.251786] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-13T17:08:43.380943] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T17:08:43.633921] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-13T17:08:43.638995] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:43.859169] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T17:08:44.417916] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-13T17:08:44.642173] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T17:08:45.217932] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-13T17:08:45.700319] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T17:08:46.017963] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-13T17:08:46.817956] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-13T17:08:46.840967] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T17:08:46.845488] [INFO ] [REMOTE ] AIR: Full fetch complete (39934 records). [2025-10-13T17:08:46.845585] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-13T17:08:47.237352] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-13T17:08:47.237480] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-13T17:08:47.238010] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-13T17:08:47.238106] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-13T17:08:47.246434] [DEBUG] [LOCAL ] AIR: Trimmed 39934 records to 29044 (keeping 200 days of data) [2025-10-13T17:08:47.261761] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T17:08:47.442303] [DEBUG] [LOCAL ] AIR: Primary data saved (29044 records). [2025-10-13T17:08:47.442474] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-13T17:08:47.442564] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIR took 40.5s. Estimated remaining: 4h 47m 3s. Rate: 8.0 symbols/min [2025-10-13T17:08:47.615378] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:47.617927] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-13T17:08:47.663148] [DEBUG] [LOCAL ] AJG: Loaded 47279 existing records from primary storage. [2025-10-13T17:08:47.663462] [INFO ] [MAIN ] AJG: Loaded 47279 existing records. [2025-10-13T17:08:47.841667] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:47.841877] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-13T17:08:47.841923] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-13T17:08:47.842356] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-13T17:08:47.842412] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-13T17:08:48.204778] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:48.223581] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T17:08:48.239008] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T17:08:48.417942] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-13T17:08:49.217947] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-13T17:08:50.026076] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-13T17:08:50.045463] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T17:08:50.476328] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T17:08:50.631516] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:08:50.817897] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-13T17:08:51.280385] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T17:08:51.617909] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-13T17:08:52.417959] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-13T17:08:53.036854] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T17:08:53.217942] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-13T17:08:53.305252] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:08:54.017920] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-13T17:08:54.421975] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T17:08:54.425227] [INFO ] [REMOTE ] AIZ: Full fetch complete (42765 records). [2025-10-13T17:08:54.425372] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-13T17:08:54.825272] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-13T17:08:54.828310] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-13T17:08:54.829231] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-13T17:08:54.829916] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-13T17:08:54.829987] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-13T17:08:54.831375] [DEBUG] [LOCAL ] AIZ: Trimmed 42765 records to 29610 (keeping 200 days of data) [2025-10-13T17:08:55.027906] [DEBUG] [LOCAL ] AIZ: Primary data saved (29610 records). [2025-10-13T17:08:55.028098] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-13T17:08:55.028198] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIZ took 32.2s. Estimated remaining: 4h 46m 59s. Rate: 8.0 symbols/min [2025-10-13T17:08:55.205866] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:55.206213] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-13T17:08:55.206264] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-13T17:08:55.206387] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-13T17:08:55.206431] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-13T17:08:55.206474] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-13T17:08:55.206508] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-13T17:08:55.489693] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T17:08:55.609523] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:55.617915] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-13T17:08:55.727118] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T17:08:56.417956] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-13T17:08:57.202805] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T17:08:57.217879] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-13T17:08:58.002826] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T17:08:58.017936] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-13T17:08:58.439585] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T17:08:58.445025] [INFO ] [REMOTE ] AIV: Full fetch complete (60102 records). [2025-10-13T17:08:58.445173] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-13T17:08:58.825795] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-13T17:08:58.848334] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-13T17:08:58.848456] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-13T17:08:58.849325] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-13T17:08:58.849437] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-13T17:08:58.851514] [DEBUG] [LOCAL ] AIV: Trimmed 60102 records to 41190 (keeping 200 days of data) [2025-10-13T17:08:59.095231] [DEBUG] [LOCAL ] AIV: Primary data saved (41190 records). [2025-10-13T17:08:59.095411] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-13T17:08:59.095512] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIV took 39.8s. Estimated remaining: 4h 45m 2s. Rate: 8.1 symbols/min [2025-10-13T17:08:59.280074] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:08:59.328173] [DEBUG] [LOCAL ] AKR: Loaded 46485 existing records from primary storage. [2025-10-13T17:08:59.328699] [INFO ] [MAIN ] AKR: Loaded 46485 existing records. [2025-10-13T17:08:59.400269] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T17:08:59.529871] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:08:59.530168] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-13T17:08:59.530221] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-13T17:08:59.530895] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-13T17:08:59.530956] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-13T17:08:59.623027] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-13T17:08:59.907681] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:08:59.942120] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T17:09:00.134846] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T17:09:00.417985] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-13T17:09:01.218003] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-13T17:09:01.662587] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-13T17:09:02.018305] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-13T17:09:02.029288] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T17:09:02.642052] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T17:09:02.817988] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-13T17:09:03.617933] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-13T17:09:04.381306] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T17:09:04.420073] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-13T17:09:04.426584] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T17:09:05.217972] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-13T17:09:05.658507] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T17:09:06.017951] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-13T17:09:06.144147] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T17:09:06.684144] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T17:09:06.817936] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-13T17:09:07.617958] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-13T17:09:08.125112] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-13T17:09:08.164908] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T17:09:08.417973] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-13T17:09:09.217962] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-13T17:09:09.725342] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T17:09:10.017929] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-13T17:09:10.817907] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-13T17:09:10.936033] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T17:09:11.303156] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T17:09:11.346816] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-13T17:09:11.617936] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-13T17:09:12.239494] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T17:09:12.417913] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-13T17:09:12.855024] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T17:09:13.217957] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-13T17:09:14.017936] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-13T17:09:14.767167] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T17:09:14.817889] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-13T17:09:15.617952] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-13T17:09:15.698515] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T17:09:16.186347] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T17:09:16.417913] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-13T17:09:16.571506] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T17:09:17.217956] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-13T17:09:18.017905] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-13T17:09:18.066096] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T17:09:18.358589] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-13T17:09:18.727674] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:09:18.817969] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-13T17:09:19.617959] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-13T17:09:20.400008] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T17:09:20.417987] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-13T17:09:20.726223] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-13T17:09:21.217902] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-13T17:09:21.336983] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T17:09:22.017949] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-13T17:09:22.306357] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-13T17:09:22.817933] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-13T17:09:22.854705] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T17:09:23.408209] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T17:09:23.410287] [INFO ] [REMOTE ] AIZN: Full fetch complete (5927 records). [2025-10-13T17:09:23.410508] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-13T17:09:23.626471] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-13T17:09:23.793043] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-13T17:09:23.793127] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-13T17:09:23.793344] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-13T17:09:23.793438] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-13T17:09:23.793858] [DEBUG] [LOCAL ] AIZN: Trimmed 5927 records to 4085 (keeping 200 days of data) [2025-10-13T17:09:23.817944] [DEBUG] [LOCAL ] AIZN: Primary data saved (4085 records). [2025-10-13T17:09:23.818028] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-13T17:09:23.818106] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZN took 40.9s. Estimated remaining: 4h 53m 59s. Rate: 7.8 symbols/min [2025-10-13T17:09:23.980788] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:09:24.020890] [DEBUG] [LOCAL ] AL: Loaded 45184 existing records from primary storage. [2025-10-13T17:09:24.021197] [INFO ] [MAIN ] AL: Loaded 45184 existing records. [2025-10-13T17:09:24.191790] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:09:24.192070] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-13T17:09:24.192116] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-13T17:09:24.192534] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-13T17:09:24.192590] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-13T17:09:24.427593] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-13T17:09:24.547466] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:09:25.028953] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T17:09:25.030140] [INFO ] [REMOTE ] AKA: Full fetch complete (2423 records). [2025-10-13T17:09:25.030222] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-13T17:09:25.220988] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-13T17:09:25.228346] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T17:09:25.229738] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:09:25.229834] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:09:25.229891] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-13T17:09:25.229948] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-13T17:09:25.230035] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-13T17:09:25.230089] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-13T17:09:25.230170] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AKA took 30.2s. Estimated remaining: 4h 50m 37s. Rate: 7.9 symbols/min [2025-10-13T17:09:25.415796] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:09:25.447345] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T17:09:25.522890] [DEBUG] [LOCAL ] ALB: Loaded 54068 existing records from primary storage. [2025-10-13T17:09:25.523363] [INFO ] [MAIN ] ALB: Loaded 54068 existing records. [2025-10-13T17:09:25.720041] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:09:25.720309] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-13T17:09:25.720359] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-13T17:09:25.721429] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-13T17:09:25.721492] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-13T17:09:26.023210] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-13T17:09:26.094925] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:09:26.817929] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-13T17:09:27.099967] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T17:09:27.617899] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-13T17:09:27.664937] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T17:09:27.672863] [INFO ] [REMOTE ] AJG: Full fetch complete (68971 records). [2025-10-13T17:09:27.672977] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-13T17:09:28.055210] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-13T17:09:28.055349] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-13T17:09:28.056058] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-13T17:09:28.056120] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-13T17:09:28.057437] [DEBUG] [LOCAL ] AJG: Trimmed 68971 records to 46567 (keeping 200 days of data) [2025-10-13T17:09:28.324146] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T17:09:28.337083] [INFO ] [REMOTE ] AKR: Full fetch complete (65234 records). [2025-10-13T17:09:28.338532] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-13T17:09:28.419035] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-13T17:09:28.832448] [DEBUG] [LOCAL ] AJG: Primary data saved (46567 records). [2025-10-13T17:09:28.833567] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-13T17:09:28.835244] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AJG took 41.4s. Estimated remaining: 4h 48m 27s. Rate: 8.0 symbols/min [2025-10-13T17:09:29.096969] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-13T17:09:29.139782] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-13T17:09:29.141923] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-13T17:09:29.158199] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-13T17:09:29.227562] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:09:29.229133] [DEBUG] [LOCAL ] AKR: Trimmed 65234 records to 46010 (keeping 200 days of data) [2025-10-13T17:09:29.263748] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:09:29.374555] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-13T17:09:29.496933] [DEBUG] [LOCAL ] ALC: Loaded 51798 existing records from primary storage. [2025-10-13T17:09:29.498542] [INFO ] [MAIN ] ALC: Loaded 51798 existing records. [2025-10-13T17:09:29.842477] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:09:29.856775] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-13T17:09:29.859208] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-13T17:09:29.863308] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-13T17:09:29.863393] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-13T17:09:30.041405] [DEBUG] [LOCAL ] AKR: Primary data saved (46010 records). [2025-10-13T17:09:30.052059] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-13T17:09:30.072160] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AKR took 31.0s. Estimated remaining: 4h 45m 10s. Rate: 8.0 symbols/min [2025-10-13T17:09:30.479776] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:09:30.482772] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-13T17:09:30.505834] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:09:30.570849] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T17:09:30.585528] [DEBUG] [LOCAL ] ALE: Loaded 31823 existing records from primary storage. [2025-10-13T17:09:30.586069] [INFO ] [MAIN ] ALE: Loaded 31823 existing records. [2025-10-13T17:09:30.775939] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:09:30.795341] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:09:30.803360] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-13T17:09:30.803433] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-13T17:09:30.804052] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-13T17:09:30.804111] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-13T17:09:30.824412] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-13T17:09:31.160692] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:09:31.617982] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-13T17:09:32.164175] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T17:09:32.417983] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-13T17:09:32.722530] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T17:09:32.944537] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-13T17:09:33.217984] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-13T17:09:33.614393] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T17:09:34.017990] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-13T17:09:34.519128] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T17:09:34.817964] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-13T17:09:35.618001] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-13T17:09:35.835309] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T17:09:35.866847] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T17:09:36.418023] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-13T17:09:37.149928] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:09:37.217907] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-13T17:09:38.017912] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-13T17:09:38.357151] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:09:38.675743] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T17:09:38.817936] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-13T17:09:39.453290] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T17:09:39.617934] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-13T17:09:40.027132] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T17:09:40.417941] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-13T17:09:40.768917] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T17:09:41.217932] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-13T17:09:42.017911] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-13T17:09:42.107713] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:09:42.518229] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T17:09:42.817936] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-13T17:09:43.625246] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-13T17:09:43.645296] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T17:09:44.415526] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T17:09:44.423956] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-13T17:09:45.217936] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-13T17:09:45.632006] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T17:09:45.805551] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-13T17:09:46.017907] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-13T17:09:46.249075] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:09:46.817978] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-13T17:09:47.628164] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-13T17:09:47.634613] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T17:09:48.185458] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T17:09:48.417902] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-13T17:09:49.217945] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-13T17:09:49.283852] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T17:09:49.579516] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T17:09:50.017974] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-13T17:09:50.714060] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T17:09:50.817940] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-13T17:09:51.005125] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T17:09:51.617932] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-13T17:09:52.415145] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:09:52.424965] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-13T17:09:52.636872] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T17:09:53.217937] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-13T17:09:53.972171] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:09:54.017883] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-13T17:09:54.597135] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T17:09:54.817927] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-13T17:09:55.617973] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-13T17:09:56.269530] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-13T17:09:56.417883] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-13T17:09:56.696752] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T17:09:57.102764] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T17:09:57.108284] [INFO ] [REMOTE ] AL: Full fetch complete (63003 records). [2025-10-13T17:09:57.108470] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-13T17:09:57.223090] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-13T17:09:57.541551] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-13T17:09:57.541709] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-13T17:09:57.542667] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-13T17:09:57.542747] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-13T17:09:57.544951] [DEBUG] [LOCAL ] AL: Trimmed 63003 records to 44615 (keeping 200 days of data) [2025-10-13T17:09:57.863604] [DEBUG] [LOCAL ] AL: Primary data saved (44615 records). [2025-10-13T17:09:57.863838] [INFO ] [MAIN ] AL: Full history saved. [2025-10-13T17:09:57.864755] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AL took 34.0s. Estimated remaining: 4h 55m 8s. Rate: 7.8 symbols/min [2025-10-13T17:09:58.017973] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-13T17:09:58.392764] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T17:09:58.764746] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T17:09:58.817886] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-13T17:09:59.617905] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-13T17:09:59.844030] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T17:09:59.978925] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T17:09:59.982907] [INFO ] [REMOTE ] ALE: Full fetch complete (43529 records). [2025-10-13T17:09:59.982985] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-13T17:10:00.359835] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-13T17:10:00.359911] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-13T17:10:00.360374] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-13T17:10:00.360436] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-13T17:10:00.361346] [DEBUG] [LOCAL ] ALE: Trimmed 43529 records to 31630 (keeping 200 days of data) [2025-10-13T17:10:00.425473] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-13T17:10:00.553216] [DEBUG] [LOCAL ] ALE: Primary data saved (31630 records). [2025-10-13T17:10:00.553381] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-13T17:10:00.553465] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALE took 30.5s. Estimated remaining: 4h 52m 32s. Rate: 7.8 symbols/min [2025-10-13T17:10:01.538572] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T17:10:01.549683] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-13T17:10:02.192090] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T17:10:02.199581] [INFO ] [REMOTE ] ALC: Full fetch complete (72882 records). [2025-10-13T17:10:02.199875] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-13T17:10:02.201079] [FATAL] [VALIDATOR ] ALC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:10:02.201221] [FATAL] [MAIN ] ALC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:10:02.201281] [WARN ] [MAIN ] ALC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:10:02.201369] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-13T17:10:02.201458] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-13T17:10:02.201509] [INFO ] [LOCAL ] ALC: Starting deletion of derivative data. [2025-10-13T17:10:02.201756] [DEBUG] [LOCAL ] ALC: Deleted derivative data file. [2025-10-13T17:10:02.202914] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALC took 33.4s. Estimated remaining: 4h 49m 30s. Rate: 7.9 symbols/min [2025-10-13T17:10:04.010831] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-13T17:10:04.016573] [INFO ] [REMOTE ] ALB: Full fetch complete (76512 records). [2025-10-13T17:10:04.016870] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-13T17:10:04.017949] [FATAL] [VALIDATOR ] ALB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:10:04.018097] [FATAL] [MAIN ] ALB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:10:04.018153] [WARN ] [MAIN ] ALB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:10:04.018223] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-13T17:10:04.018293] [DEBUG] [LOCAL ] ALB: No primary data file found to delete. [2025-10-13T17:10:04.018328] [INFO ] [LOCAL ] ALB: Starting deletion of derivative data. [2025-10-13T17:10:04.018479] [DEBUG] [LOCAL ] ALB: Deleted derivative data file. [2025-10-13T17:10:04.018588] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALB took 38.8s. Estimated remaining: 4h 46m 38s. Rate: 8.0 symbols/min [2025-10-13T17:10:04.605784] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:04.765353] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:04.810475] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:04.832818] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:04.835447] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-13T17:10:04.836407] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-13T17:10:04.836620] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-13T17:10:04.836715] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-13T17:10:04.836794] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-13T17:10:04.838204] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-13T17:10:04.960674] [DEBUG] [LOCAL ] ALG: Loaded 9947 existing records from primary storage. [2025-10-13T17:10:04.971573] [INFO ] [MAIN ] ALG: Loaded 9947 existing records. [2025-10-13T17:10:05.090140] [DEBUG] [LOCAL ] ALEX: Loaded 31679 existing records from primary storage. [2025-10-13T17:10:05.126178] [INFO ] [MAIN ] ALEX: Loaded 31679 existing records. [2025-10-13T17:10:05.453088] [DEBUG] [LOCAL ] ALIT: Loaded 53554 existing records from primary storage. [2025-10-13T17:10:05.537596] [INFO ] [MAIN ] ALIT: Loaded 53554 existing records. [2025-10-13T17:10:05.558895] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:05.660169] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-13T17:10:05.727418] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-13T17:10:05.802860] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-13T17:10:05.789196] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:05.809087] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:05.809419] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-13T17:10:05.809330] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-13T17:10:05.820600] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-13T17:10:05.826150] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-13T17:10:05.954934] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:05.934476] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-13T17:10:05.968476] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-13T17:10:06.033532] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-13T17:10:06.074776] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-13T17:10:06.096207] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-13T17:10:06.096323] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-13T17:10:06.137975] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:10:06.182533] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-13T17:10:06.236377] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:10:06.272042] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-13T17:10:06.327396] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:10:06.438547] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-13T17:10:06.483750] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-13T17:10:06.581813] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-13T17:10:06.662482] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-13T17:10:06.701792] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALH took 2.7s. Estimated remaining: 4h 44m 14s. Rate: 8.1 symbols/min [2025-10-13T17:10:06.945219] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:06.934912] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:06.968803] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-13T17:10:06.974162] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-13T17:10:07.182205] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:07.180510] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:07.183244] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-13T17:10:07.237005] [DEBUG] [LOCAL ] ALK: Loaded 53837 existing records from primary storage. [2025-10-13T17:10:07.237316] [INFO ] [MAIN ] ALK: Loaded 53837 existing records. [2025-10-13T17:10:07.418150] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:07.418375] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-13T17:10:07.418422] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-13T17:10:07.418876] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-13T17:10:07.418933] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-13T17:10:07.802270] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:07.802617] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-13T17:10:08.155205] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T17:10:08.158130] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-13T17:10:08.542863] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:10:08.550802] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-13T17:10:08.753672] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:10:08.764720] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-13T17:10:08.871993] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T17:10:08.875378] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-13T17:10:09.245965] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T17:10:09.256790] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-13T17:10:09.410158] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T17:10:09.738189] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T17:10:10.017907] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-13T17:10:10.340135] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T17:10:10.796202] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T17:10:10.821271] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-13T17:10:10.825132] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T17:10:11.617938] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-13T17:10:12.417944] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-13T17:10:12.535260] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T17:10:12.609076] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T17:10:13.217928] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-13T17:10:13.689623] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T17:10:14.017941] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-13T17:10:14.699517] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T17:10:14.795193] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T17:10:14.817880] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-13T17:10:15.530256] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T17:10:15.617916] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-13T17:10:16.417975] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-13T17:10:17.136064] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T17:10:17.217936] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-13T17:10:17.997459] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T17:10:18.017885] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-13T17:10:18.226262] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T17:10:18.817894] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-13T17:10:19.617910] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-13T17:10:19.655573] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T17:10:19.808346] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T17:10:20.417923] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-13T17:10:20.565993] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T17:10:21.217928] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-13T17:10:21.659592] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T17:10:21.827351] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-13T17:10:22.017921] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-13T17:10:22.817944] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-13T17:10:23.617916] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-13T17:10:23.705021] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T17:10:24.112021] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T17:10:24.417969] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-13T17:10:25.217898] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-13T17:10:25.278293] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T17:10:26.017911] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-13T17:10:26.224887] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T17:10:26.514263] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T17:10:26.644437] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T17:10:26.817917] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-13T17:10:27.617942] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-13T17:10:28.347947] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T17:10:28.388234] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T17:10:28.417886] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-13T17:10:29.217989] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-13T17:10:30.017941] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-13T17:10:30.253424] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T17:10:30.258760] [INFO ] [REMOTE ] ALK: Full fetch complete (76835 records). [2025-10-13T17:10:30.258880] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-13T17:10:30.650104] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T17:10:30.673660] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-13T17:10:30.673795] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-13T17:10:30.681873] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-13T17:10:30.681997] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-13T17:10:30.684588] [DEBUG] [LOCAL ] ALK: Trimmed 76835 records to 53061 (keeping 200 days of data) [2025-10-13T17:10:30.849801] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-13T17:10:30.891989] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T17:10:30.897080] [INFO ] [REMOTE ] ALG: Full fetch complete (15423 records). [2025-10-13T17:10:30.904732] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-13T17:10:31.350464] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-13T17:10:31.368512] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-13T17:10:31.370165] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-13T17:10:31.370516] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-13T17:10:31.374397] [DEBUG] [LOCAL ] ALG: Trimmed 15423 records to 9742 (keeping 200 days of data) [2025-10-13T17:10:31.451375] [DEBUG] [LOCAL ] ALK: Primary data saved (53061 records). [2025-10-13T17:10:31.452945] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-13T17:10:31.453066] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALK took 24.7s. Estimated remaining: 4h 52m 10s. Rate: 7.8 symbols/min [2025-10-13T17:10:31.581631] [DEBUG] [LOCAL ] ALG: Primary data saved (9742 records). [2025-10-13T17:10:31.599469] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-13T17:10:31.605757] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALG took 27.6s. Estimated remaining: 4h 48m 35s. Rate: 7.9 symbols/min [2025-10-13T17:10:31.633327] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-13T17:10:31.638455] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:31.812294] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:31.853600] [DEBUG] [LOCAL ] ALL: Loaded 50524 existing records from primary storage. [2025-10-13T17:10:31.853978] [INFO ] [MAIN ] ALL: Loaded 50524 existing records. [2025-10-13T17:10:32.045874] [DEBUG] [LOCAL ] ALLE: Loaded 44999 existing records from primary storage. [2025-10-13T17:10:32.062770] [INFO ] [MAIN ] ALLE: Loaded 44999 existing records. [2025-10-13T17:10:32.066483] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:32.121700] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-13T17:10:32.130802] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-13T17:10:32.142201] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-13T17:10:32.142295] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-13T17:10:32.387321] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:32.398195] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-13T17:10:32.413199] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-13T17:10:32.452953] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-13T17:10:32.480551] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T17:10:32.480812] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-13T17:10:32.570571] [INFO ] [REMOTE ] ALEX: Full fetch complete (44367 records). [2025-10-13T17:10:32.597321] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-13T17:10:32.679046] [FATAL] [VALIDATOR ] ALEX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:10:32.690898] [FATAL] [MAIN ] ALEX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:10:32.701305] [WARN ] [MAIN ] ALEX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:10:32.744356] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-13T17:10:32.777864] [DEBUG] [LOCAL ] ALEX: No primary data file found to delete. [2025-10-13T17:10:32.822595] [INFO ] [LOCAL ] ALEX: Starting deletion of derivative data. [2025-10-13T17:10:32.822499] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:32.852855] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-13T17:10:32.909484] [DEBUG] [LOCAL ] ALEX: Deleted derivative data file. [2025-10-13T17:10:32.947405] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALEX took 28.9s. Estimated remaining: 4h 45m 38s. Rate: 8.0 symbols/min [2025-10-13T17:10:33.153396] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:33.230444] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-13T17:10:33.234035] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:33.304315] [DEBUG] [LOCAL ] ALLY: Loaded 54004 existing records from primary storage. [2025-10-13T17:10:33.304824] [INFO ] [MAIN ] ALLY: Loaded 54004 existing records. [2025-10-13T17:10:33.553565] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:33.575556] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-13T17:10:33.575729] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-13T17:10:33.579081] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T17:10:33.579199] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-13T17:10:33.590984] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-13T17:10:33.969878] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:34.017932] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-13T17:10:34.663502] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:10:34.817901] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-13T17:10:34.855435] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T17:10:35.617902] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-13T17:10:35.713513] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T17:10:36.417975] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-13T17:10:36.587252] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:10:37.217923] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-13T17:10:37.494466] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T17:10:37.647346] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T17:10:38.017928] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-13T17:10:38.611875] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:10:38.817934] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-13T17:10:39.617948] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-13T17:10:39.774375] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T17:10:40.399060] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T17:10:40.417892] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-13T17:10:41.162486] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T17:10:41.218017] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-13T17:10:42.023006] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-13T17:10:42.035135] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:10:42.693605] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T17:10:42.817933] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-13T17:10:43.291264] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T17:10:43.617981] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-13T17:10:44.417950] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-13T17:10:44.532362] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:10:45.162708] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T17:10:45.217932] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-13T17:10:46.017906] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-13T17:10:46.276953] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T17:10:46.703744] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T17:10:46.817954] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-13T17:10:47.617923] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-13T17:10:47.755935] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:10:48.417910] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-13T17:10:48.570800] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:10:49.217955] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-13T17:10:49.451555] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T17:10:49.932226] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T17:10:50.017932] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-13T17:10:50.817926] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-13T17:10:50.894724] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:10:51.617973] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-13T17:10:51.758235] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T17:10:52.068183] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T17:10:52.417900] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-13T17:10:53.217938] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-13T17:10:53.310374] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:10:53.734733] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T17:10:54.017951] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-13T17:10:54.817933] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-13T17:10:54.878491] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T17:10:55.617942] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-13T17:10:55.792854] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T17:10:55.798463] [INFO ] [REMOTE ] ALIT: Full fetch complete (76446 records). [2025-10-13T17:10:55.798623] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-13T17:10:56.200526] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-13T17:10:56.200631] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-13T17:10:56.201398] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-13T17:10:56.201468] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-13T17:10:56.203136] [DEBUG] [LOCAL ] ALIT: Trimmed 76446 records to 52786 (keeping 200 days of data) [2025-10-13T17:10:56.314411] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T17:10:56.436601] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-13T17:10:56.542276] [DEBUG] [LOCAL ] ALIT: Primary data saved (52786 records). [2025-10-13T17:10:56.542572] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-13T17:10:56.542693] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALIT took 52.5s. Estimated remaining: 4h 52m 43s. Rate: 7.8 symbols/min [2025-10-13T17:10:56.708150] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:10:56.746116] [DEBUG] [LOCAL ] ALSN: Loaded 44031 existing records from primary storage. [2025-10-13T17:10:56.746439] [INFO ] [MAIN ] ALSN: Loaded 44031 existing records. [2025-10-13T17:10:56.930828] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:10:56.931163] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-13T17:10:56.931213] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-13T17:10:56.932287] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-13T17:10:56.932349] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-13T17:10:57.223103] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-13T17:10:57.292912] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:10:57.349662] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T17:10:58.017962] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-13T17:10:58.200077] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:10:58.592914] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T17:10:58.817978] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-13T17:10:59.617940] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-13T17:10:59.728186] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T17:11:00.417916] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-13T17:11:00.447404] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T17:11:01.217927] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-13T17:11:01.498024] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T17:11:01.734081] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T17:11:02.017936] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-13T17:11:02.817928] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-13T17:11:02.912200] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T17:11:03.444118] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T17:11:03.617923] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-13T17:11:04.125523] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T17:11:04.417920] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-13T17:11:05.060682] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:11:05.066262] [INFO ] [REMOTE ] ALLY: Full fetch complete (76954 records). [2025-10-13T17:11:05.066363] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-13T17:11:05.242263] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-13T17:11:05.465678] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-13T17:11:05.465779] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-13T17:11:05.466507] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-13T17:11:05.466549] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-13T17:11:05.468160] [DEBUG] [LOCAL ] ALLY: Trimmed 76954 records to 53223 (keeping 200 days of data) [2025-10-13T17:11:05.785035] [DEBUG] [LOCAL ] ALLY: Primary data saved (53223 records). [2025-10-13T17:11:05.785195] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-13T17:11:05.785291] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALLY took 32.8s. Estimated remaining: 4h 53m 17s. Rate: 7.8 symbols/min [2025-10-13T17:11:05.965744] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:05.988131] [DEBUG] [LOCAL ] ALTG: Loaded 23947 existing records from primary storage. [2025-10-13T17:11:05.988405] [INFO ] [MAIN ] ALTG: Loaded 23947 existing records. [2025-10-13T17:11:06.020435] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-13T17:11:06.192252] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:06.201571] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-13T17:11:06.201892] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-13T17:11:06.203262] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T17:11:06.203327] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-13T17:11:06.203520] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-13T17:11:06.591440] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:06.618549] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T17:11:06.623049] [INFO ] [REMOTE ] ALLE: Full fetch complete (64582 records). [2025-10-13T17:11:06.623225] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-13T17:11:06.829121] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-13T17:11:07.041393] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-13T17:11:07.041477] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-13T17:11:07.042148] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-13T17:11:07.042228] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-13T17:11:07.043607] [DEBUG] [LOCAL ] ALLE: Trimmed 64582 records to 44301 (keeping 200 days of data) [2025-10-13T17:11:07.321054] [DEBUG] [LOCAL ] ALLE: Primary data saved (44301 records). [2025-10-13T17:11:07.321209] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-13T17:11:07.321309] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLE took 35.7s. Estimated remaining: 4h 50m 28s. Rate: 7.9 symbols/min [2025-10-13T17:11:07.488294] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:07.499674] [DEBUG] [LOCAL ] ALUR: Loaded 10535 existing records from primary storage. [2025-10-13T17:11:07.499897] [INFO ] [MAIN ] ALUR: Loaded 10535 existing records. [2025-10-13T17:11:07.623083] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-13T17:11:07.680175] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:07.680778] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-13T17:11:07.680857] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-13T17:11:07.681046] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-13T17:11:07.681093] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-13T17:11:08.010547] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-13T17:11:08.076948] [INFO ] [REMOTE ] ALL: Full fetch complete (72246 records). [2025-10-13T17:11:08.082266] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:08.082498] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-13T17:11:08.172385] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T17:11:08.432593] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-13T17:11:08.489002] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-13T17:11:08.489079] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-13T17:11:08.489783] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-13T17:11:08.489846] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-13T17:11:08.491253] [DEBUG] [LOCAL ] ALL: Trimmed 72246 records to 49796 (keeping 200 days of data) [2025-10-13T17:11:08.794350] [DEBUG] [LOCAL ] ALL: Primary data saved (49796 records). [2025-10-13T17:11:08.794483] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-13T17:11:08.795752] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALL took 37.3s. Estimated remaining: 4h 47m 40s. Rate: 7.9 symbols/min [2025-10-13T17:11:08.986064] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:09.030409] [DEBUG] [LOCAL ] ALV: Loaded 42734 existing records from primary storage. [2025-10-13T17:11:09.030745] [INFO ] [MAIN ] ALV: Loaded 42734 existing records. [2025-10-13T17:11:09.216261] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:09.216534] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-13T17:11:09.216875] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-13T17:11:09.217336] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-13T17:11:09.217436] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-13T17:11:09.240477] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-13T17:11:09.518935] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T17:11:09.566288] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T17:11:09.645554] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:10.017949] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-13T17:11:10.730105] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T17:11:10.817893] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-13T17:11:11.037682] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T17:11:11.617928] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-13T17:11:12.048427] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T17:11:12.417939] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-13T17:11:12.960317] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T17:11:13.217917] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-13T17:11:13.925891] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:11:14.017914] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-13T17:11:14.610074] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T17:11:14.817927] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-13T17:11:15.186774] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-13T17:11:15.617927] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-13T17:11:16.417934] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-13T17:11:16.456210] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:11:16.640486] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T17:11:17.217933] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-13T17:11:17.551859] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T17:11:18.017938] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-13T17:11:18.674639] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T17:11:18.817947] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-13T17:11:19.221418] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-13T17:11:19.617907] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-13T17:11:20.121004] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T17:11:20.160186] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T17:11:20.417914] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-13T17:11:21.217918] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-13T17:11:21.634488] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T17:11:22.017911] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-13T17:11:22.400365] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:11:22.817928] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-13T17:11:23.309398] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T17:11:23.617909] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-13T17:11:23.645063] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T17:11:24.209371] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T17:11:24.417967] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-13T17:11:25.217896] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-13T17:11:25.379496] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T17:11:26.017931] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-13T17:11:26.687158] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-13T17:11:26.804032] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T17:11:26.817890] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-13T17:11:27.617935] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-13T17:11:28.111378] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T17:11:28.116217] [INFO ] [REMOTE ] ALSN: Full fetch complete (62250 records). [2025-10-13T17:11:28.116318] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-13T17:11:28.423006] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-13T17:11:28.503239] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-13T17:11:28.503445] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-13T17:11:28.504093] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-13T17:11:28.504154] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-13T17:11:28.505360] [DEBUG] [LOCAL ] ALSN: Trimmed 62250 records to 43420 (keeping 200 days of data) [2025-10-13T17:11:28.731636] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T17:11:28.787811] [DEBUG] [LOCAL ] ALSN: Primary data saved (43420 records). [2025-10-13T17:11:28.787948] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-13T17:11:28.788028] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALSN took 32.2s. Estimated remaining: 4h 52m 52s. Rate: 7.8 symbols/min [2025-10-13T17:11:28.963316] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:28.971553] [DEBUG] [LOCAL ] ALX: Loaded 6768 existing records from primary storage. [2025-10-13T17:11:28.971799] [INFO ] [MAIN ] ALX: Loaded 6768 existing records. [2025-10-13T17:11:29.145213] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:29.145441] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-13T17:11:29.145485] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-13T17:11:29.145714] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-13T17:11:29.145770] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-13T17:11:29.223068] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-13T17:11:29.490686] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:29.907799] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T17:11:30.017906] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-13T17:11:30.213119] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:11:30.644685] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-13T17:11:30.817980] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-13T17:11:31.617964] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-13T17:11:31.637877] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T17:11:31.639401] [INFO ] [REMOTE ] ALUR: Full fetch complete (19732 records). [2025-10-13T17:11:31.639507] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-13T17:11:32.122737] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-13T17:11:32.122918] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-13T17:11:32.123510] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-13T17:11:32.123585] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-13T17:11:32.124736] [DEBUG] [LOCAL ] ALUR: Trimmed 19732 records to 9743 (keeping 200 days of data) [2025-10-13T17:11:32.171519] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T17:11:32.206389] [DEBUG] [LOCAL ] ALUR: Primary data saved (9743 records). [2025-10-13T17:11:32.206595] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-13T17:11:32.206878] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 24.9s. Estimated remaining: 4h 50m 55s. Rate: 7.8 symbols/min [2025-10-13T17:11:32.421565] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-13T17:11:32.421473] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:32.488001] [DEBUG] [LOCAL ] AM: Loaded 52754 existing records from primary storage. [2025-10-13T17:11:32.488497] [INFO ] [MAIN ] AM: Loaded 52754 existing records. [2025-10-13T17:11:32.739558] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:32.739901] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-13T17:11:32.740044] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-13T17:11:32.741155] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-13T17:11:32.741247] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-13T17:11:32.927096] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-13T17:11:33.227799] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-13T17:11:33.235753] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:34.017931] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-13T17:11:34.389626] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T17:11:34.511179] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T17:11:34.817954] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-13T17:11:35.617937] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-13T17:11:36.349151] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T17:11:36.374689] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T17:11:36.417911] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-13T17:11:37.217926] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-13T17:11:37.939795] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T17:11:38.017929] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-13T17:11:38.330084] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T17:11:38.469520] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-13T17:11:38.817937] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-13T17:11:39.617958] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-13T17:11:40.417918] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-13T17:11:40.480951] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T17:11:41.217995] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-13T17:11:41.413183] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T17:11:41.526472] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T17:11:41.529447] [INFO ] [REMOTE ] ALTG: Full fetch complete (33531 records). [2025-10-13T17:11:41.529581] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-13T17:11:41.911300] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-13T17:11:41.911384] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-13T17:11:41.911828] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-13T17:11:41.911891] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-13T17:11:41.912748] [DEBUG] [LOCAL ] ALTG: Trimmed 33531 records to 23514 (keeping 200 days of data) [2025-10-13T17:11:42.018094] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-13T17:11:42.043328] [DEBUG] [LOCAL ] ALTG: Primary data saved (23514 records). [2025-10-13T17:11:42.043466] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-13T17:11:42.043560] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALTG took 36.3s. Estimated remaining: 4h 51m 42s. Rate: 7.8 symbols/min [2025-10-13T17:11:42.248768] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:42.289733] [DEBUG] [LOCAL ] AMBC: Loaded 36913 existing records from primary storage. [2025-10-13T17:11:42.290130] [INFO ] [MAIN ] AMBC: Loaded 36913 existing records. [2025-10-13T17:11:42.474504] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:42.474818] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-13T17:11:42.474875] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-13T17:11:42.475257] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-13T17:11:42.475318] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-13T17:11:42.685772] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T17:11:42.822921] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-13T17:11:42.893830] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:42.927810] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T17:11:43.617909] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-13T17:11:43.788554] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T17:11:44.417942] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-13T17:11:44.777417] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:11:45.217973] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-13T17:11:46.017911] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-13T17:11:46.161824] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T17:11:46.292805] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:11:46.474071] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T17:11:46.817944] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-13T17:11:47.617969] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-13T17:11:48.172486] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T17:11:48.206785] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:11:48.417979] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-13T17:11:49.217976] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-13T17:11:49.935310] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T17:11:50.017891] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-13T17:11:50.709227] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T17:11:50.817958] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-13T17:11:51.623343] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-13T17:11:51.634268] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T17:11:52.424373] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-13T17:11:52.426877] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T17:11:52.819891] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T17:11:53.217926] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-13T17:11:53.856269] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T17:11:54.017979] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-13T17:11:54.663321] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T17:11:54.817905] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-13T17:11:54.926891] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T17:11:55.617977] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-13T17:11:56.066011] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T17:11:56.070381] [INFO ] [REMOTE ] ALV: Full fetch complete (61754 records). [2025-10-13T17:11:56.070495] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-13T17:11:56.421465] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-13T17:11:56.459408] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T17:11:56.465355] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-13T17:11:56.465535] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-13T17:11:56.465694] [INFO ] [REMOTE ] ALX: Full fetch complete (7649 records). [2025-10-13T17:11:56.466635] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-13T17:11:56.466806] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-13T17:11:56.466919] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-13T17:11:56.559809] [DEBUG] [LOCAL ] ALV: Trimmed 61754 records to 42115 (keeping 200 days of data) [2025-10-13T17:11:57.033971] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-13T17:11:57.060180] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-13T17:11:57.060990] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-13T17:11:57.061111] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-13T17:11:57.077418] [DEBUG] [LOCAL ] ALX: Trimmed 7649 records to 6822 (keeping 200 days of data) [2025-10-13T17:11:57.142727] [DEBUG] [LOCAL ] ALX: Primary data saved (6822 records). [2025-10-13T17:11:57.145958] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-13T17:11:57.152325] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALX took 28.4s. Estimated remaining: 4h 54m 39s. Rate: 7.7 symbols/min [2025-10-13T17:11:57.223046] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-13T17:11:57.229506] [DEBUG] [LOCAL ] ALV: Primary data saved (42115 records). [2025-10-13T17:11:57.229749] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-13T17:11:57.239078] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. ALV took 48.4s. Estimated remaining: 4h 51m 23s. Rate: 7.8 symbols/min [2025-10-13T17:11:57.470668] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:57.522114] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:57.522346] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-13T17:11:57.522494] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-13T17:11:57.522635] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-13T17:11:57.522718] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-13T17:11:57.522768] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-13T17:11:57.522802] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-13T17:11:57.843682] [DEBUG] [LOCAL ] AMBP: Loaded 45241 existing records from primary storage. [2025-10-13T17:11:57.844470] [INFO ] [MAIN ] AMBP: Loaded 45241 existing records. [2025-10-13T17:11:57.998482] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:58.021417] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-13T17:11:58.115160] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:58.115510] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-13T17:11:58.115702] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-13T17:11:58.126572] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-13T17:11:58.140719] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-13T17:11:58.166925] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T17:11:58.260985] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:11:58.264381] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-13T17:11:58.264553] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:11:58.264620] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-13T17:11:58.265071] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:11:58.275783] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-13T17:11:58.306235] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-13T17:11:58.311721] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-13T17:11:58.317721] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-13T17:11:58.344535] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBQ took 1.1s. Estimated remaining: 4h 48m 36s. Rate: 7.9 symbols/min [2025-10-13T17:11:58.701983] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:11:58.746428] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:58.770058] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:11:58.817957] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-13T17:11:58.835738] [DEBUG] [LOCAL ] AMC: Loaded 54541 existing records from primary storage. [2025-10-13T17:11:58.836109] [INFO ] [MAIN ] AMC: Loaded 54541 existing records. [2025-10-13T17:11:59.016154] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:11:59.016371] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-13T17:11:59.016417] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-13T17:11:59.017310] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-13T17:11:59.017367] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-13T17:11:59.366213] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:11:59.617925] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-13T17:12:00.417913] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-13T17:12:00.670690] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T17:12:01.217924] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-13T17:12:02.017908] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-13T17:12:02.121117] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T17:12:02.316589] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-13T17:12:02.447638] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T17:12:02.817943] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-13T17:12:03.301873] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T17:12:03.617952] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-13T17:12:04.417938] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-13T17:12:05.113731] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:12:05.154277] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-13T17:12:05.217901] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-13T17:12:06.017935] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-13T17:12:06.176338] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T17:12:06.817960] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-13T17:12:07.313091] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-13T17:12:07.421113] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T17:12:07.617926] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-13T17:12:08.417902] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-13T17:12:08.465098] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:12:08.989548] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T17:12:09.217923] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-13T17:12:10.017940] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-13T17:12:10.500366] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T17:12:10.504951] [INFO ] [REMOTE ] AMBC: Full fetch complete (51570 records). [2025-10-13T17:12:10.505038] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-13T17:12:10.820612] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-13T17:12:10.885711] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-13T17:12:10.885868] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-13T17:12:10.886611] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-13T17:12:10.886740] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-13T17:12:10.950301] [DEBUG] [LOCAL ] AMBC: Trimmed 51570 records to 36300 (keeping 200 days of data) [2025-10-13T17:12:10.952538] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-13T17:12:11.166178] [DEBUG] [LOCAL ] AMBC: Primary data saved (36300 records). [2025-10-13T17:12:11.166322] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-13T17:12:11.167143] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBC took 29.1s. Estimated remaining: 4h 50m 34s. Rate: 7.8 symbols/min [2025-10-13T17:12:11.343367] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:11.395098] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-10-13T17:12:11.395418] [INFO ] [MAIN ] AMCR: Loaded 54449 existing records. [2025-10-13T17:12:11.573796] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:11.574274] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-13T17:12:11.574513] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-13T17:12:11.576311] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-13T17:12:11.576379] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-13T17:12:11.621055] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-13T17:12:11.948675] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T17:12:12.016878] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:12.417904] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-13T17:12:12.574390] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T17:12:13.217965] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-13T17:12:13.899417] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-13T17:12:14.019175] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-13T17:12:14.022116] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T17:12:14.697530] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T17:12:14.817922] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-13T17:12:15.617931] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-13T17:12:16.417955] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-13T17:12:16.503429] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-13T17:12:17.217928] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-13T17:12:17.275019] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T17:12:17.414034] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-13T17:12:17.419858] [INFO ] [REMOTE ] AM: Full fetch complete (75546 records). [2025-10-13T17:12:17.420045] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-13T17:12:17.832199] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-13T17:12:17.832369] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-13T17:12:17.833326] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-13T17:12:17.833396] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-13T17:12:17.836439] [DEBUG] [LOCAL ] AM: Trimmed 75546 records to 51957 (keeping 200 days of data) [2025-10-13T17:12:18.059431] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-13T17:12:18.101415] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:12:18.234133] [DEBUG] [LOCAL ] AM: Primary data saved (51957 records). [2025-10-13T17:12:18.234347] [INFO ] [MAIN ] AM: Full history saved. [2025-10-13T17:12:18.234470] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AM took 46.0s. Estimated remaining: 4h 50m 12s. Rate: 7.8 symbols/min [2025-10-13T17:12:18.406105] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:18.458378] [DEBUG] [LOCAL ] AME: Loaded 49435 existing records from primary storage. [2025-10-13T17:12:18.458802] [INFO ] [MAIN ] AME: Loaded 49435 existing records. [2025-10-13T17:12:18.642260] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:18.642577] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-13T17:12:18.642629] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-13T17:12:18.643872] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-13T17:12:18.643931] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-13T17:12:18.820992] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-13T17:12:19.015272] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:19.302918] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-13T17:12:19.349613] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T17:12:19.617929] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-13T17:12:20.352603] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:12:20.417992] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-13T17:12:21.217972] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-13T17:12:21.920780] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-13T17:12:21.981218] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:12:22.017953] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-13T17:12:22.385040] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T17:12:22.817997] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-13T17:12:23.584770] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T17:12:23.617913] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-13T17:12:24.169764] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T17:12:24.417943] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-13T17:12:25.217956] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-13T17:12:25.564795] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T17:12:26.017950] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-13T17:12:26.687304] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-13T17:12:26.764303] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T17:12:26.817903] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-13T17:12:27.618010] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-13T17:12:28.156365] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-13T17:12:28.417915] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-13T17:12:28.458762] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:12:29.217948] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-13T17:12:29.832856] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T17:12:29.894793] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-13T17:12:30.017955] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-13T17:12:30.598598] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:12:30.817925] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-13T17:12:31.617987] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-13T17:12:32.238551] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-13T17:12:32.244754] [INFO ] [REMOTE ] AMC: Full fetch complete (77924 records). [2025-10-13T17:12:32.244902] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-13T17:12:32.419727] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-13T17:12:32.426768] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T17:12:32.719526] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-13T17:12:32.719681] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-13T17:12:32.720785] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-13T17:12:32.720885] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-13T17:12:32.723057] [DEBUG] [LOCAL ] AMC: Trimmed 77924 records to 53762 (keeping 200 days of data) [2025-10-13T17:12:33.048234] [DEBUG] [LOCAL ] AMC: Primary data saved (53762 records). [2025-10-13T17:12:33.048585] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-13T17:12:33.048867] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMC took 34.7s. Estimated remaining: 4h 52m 52s. Rate: 7.8 symbols/min [2025-10-13T17:12:33.227852] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-13T17:12:33.232447] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:33.263168] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T17:12:33.290293] [DEBUG] [LOCAL ] AMG: Loaded 20399 existing records from primary storage. [2025-10-13T17:12:33.290558] [INFO ] [MAIN ] AMG: Loaded 20399 existing records. [2025-10-13T17:12:33.476140] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:33.476380] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-13T17:12:33.476433] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-13T17:12:33.476940] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-13T17:12:33.477009] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-13T17:12:33.828838] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:34.017933] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-13T17:12:34.444795] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T17:12:34.659690] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T17:12:34.664395] [INFO ] [REMOTE ] AMBP: Full fetch complete (65287 records). [2025-10-13T17:12:34.664568] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-13T17:12:34.823055] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-13T17:12:35.061116] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-13T17:12:35.061237] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-13T17:12:35.063586] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-13T17:12:35.063705] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-13T17:12:35.065589] [DEBUG] [LOCAL ] AMBP: Trimmed 65287 records to 44625 (keeping 200 days of data) [2025-10-13T17:12:35.340812] [DEBUG] [LOCAL ] AMBP: Primary data saved (44625 records). [2025-10-13T17:12:35.341026] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-13T17:12:35.341153] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMBP took 38.2s. Estimated remaining: 4h 50m 39s. Rate: 7.8 symbols/min [2025-10-13T17:12:35.525215] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:35.582295] [DEBUG] [LOCAL ] AMH: Loaded 52533 existing records from primary storage. [2025-10-13T17:12:35.582788] [INFO ] [MAIN ] AMH: Loaded 52533 existing records. [2025-10-13T17:12:35.627505] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-13T17:12:35.812699] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:35.813037] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-13T17:12:35.813452] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-13T17:12:35.816131] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-13T17:12:35.816049] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T17:12:35.816347] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-13T17:12:36.142459] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T17:12:36.228619] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:36.417939] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-13T17:12:37.217994] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-13T17:12:37.424906] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T17:12:38.017919] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-13T17:12:38.093040] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T17:12:38.148892] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T17:12:38.817916] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-13T17:12:39.617937] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-13T17:12:39.740585] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-13T17:12:39.779742] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T17:12:40.417931] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-13T17:12:41.119064] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T17:12:41.217912] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-13T17:12:41.681237] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T17:12:42.017995] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-13T17:12:42.712828] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T17:12:42.817903] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-13T17:12:42.849806] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T17:12:43.617929] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-13T17:12:44.418019] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-13T17:12:44.696741] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T17:12:44.702387] [INFO ] [REMOTE ] AMCR: Full fetch complete (77680 records). [2025-10-13T17:12:44.702531] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-13T17:12:45.105425] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-13T17:12:45.105532] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-13T17:12:45.106318] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-13T17:12:45.106426] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-13T17:12:45.144808] [DEBUG] [LOCAL ] AMCR: Trimmed 77680 records to 53669 (keeping 200 days of data) [2025-10-13T17:12:45.147325] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:12:45.242685] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-13T17:12:45.473184] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-10-13T17:12:45.473324] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-13T17:12:45.474106] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AMCR took 34.3s. Estimated remaining: 4h 51m 27s. Rate: 7.8 symbols/min [2025-10-13T17:12:45.647784] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:45.681213] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T17:12:45.731327] [DEBUG] [LOCAL ] AMN: Loaded 42328 existing records from primary storage. [2025-10-13T17:12:45.731787] [INFO ] [MAIN ] AMN: Loaded 42328 existing records. [2025-10-13T17:12:45.907002] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:45.907262] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-13T17:12:45.907308] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-13T17:12:45.907574] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-13T17:12:45.907630] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-13T17:12:46.023077] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-13T17:12:46.254118] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:46.817924] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-13T17:12:46.852497] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T17:12:47.617988] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-13T17:12:47.823178] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T17:12:48.011266] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:12:48.417983] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-13T17:12:49.217943] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-13T17:12:49.387205] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T17:12:49.832258] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T17:12:50.017970] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-13T17:12:50.817938] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-13T17:12:50.836613] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T17:12:50.986423] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T17:12:51.617946] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-13T17:12:52.417915] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-13T17:12:52.451516] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T17:12:52.572237] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T17:12:53.217922] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-13T17:12:54.017920] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-13T17:12:54.154034] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T17:12:54.615894] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T17:12:54.642336] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T17:12:54.817983] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-13T17:12:55.617976] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-13T17:12:56.423053] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-13T17:12:56.431883] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T17:12:56.438218] [INFO ] [REMOTE ] AME: Full fetch complete (69893 records). [2025-10-13T17:12:56.438401] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-13T17:12:56.846442] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-13T17:12:56.846532] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-13T17:12:56.847295] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-13T17:12:56.847387] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-13T17:12:56.849128] [DEBUG] [LOCAL ] AME: Trimmed 69893 records to 48705 (keeping 200 days of data) [2025-10-13T17:12:57.150946] [DEBUG] [LOCAL ] AME: Primary data saved (48705 records). [2025-10-13T17:12:57.151149] [INFO ] [MAIN ] AME: Full history saved. [2025-10-13T17:12:57.151452] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AME took 38.9s. Estimated remaining: 4h 52m 50s. Rate: 7.8 symbols/min [2025-10-13T17:12:57.225067] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-13T17:12:57.336554] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:12:57.369666] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T17:12:57.408766] [DEBUG] [LOCAL ] AMP: Loaded 32366 existing records from primary storage. [2025-10-13T17:12:57.409074] [INFO ] [MAIN ] AMP: Loaded 32366 existing records. [2025-10-13T17:12:57.585940] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:12:57.586182] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-13T17:12:57.586242] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-13T17:12:57.586499] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-13T17:12:57.586557] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-13T17:12:57.947921] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:12:57.994851] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T17:12:58.017937] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-13T17:12:58.450957] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T17:12:58.817941] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-13T17:12:59.373373] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T17:12:59.617965] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-13T17:13:00.333585] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T17:13:00.417882] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-13T17:13:00.662862] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:13:00.665436] [INFO ] [REMOTE ] AMG: Full fetch complete (29526 records). [2025-10-13T17:13:00.665534] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-13T17:13:01.107962] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-13T17:13:01.108165] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-13T17:13:01.108689] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-13T17:13:01.108756] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-13T17:13:01.110272] [DEBUG] [LOCAL ] AMG: Trimmed 29526 records to 20121 (keeping 200 days of data) [2025-10-13T17:13:01.222843] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-13T17:13:01.259201] [DEBUG] [LOCAL ] AMG: Primary data saved (20121 records). [2025-10-13T17:13:01.259424] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-13T17:13:01.259624] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMG took 28.2s. Estimated remaining: 4h 51m 21s. Rate: 7.8 symbols/min [2025-10-13T17:13:01.465317] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:01.522475] [DEBUG] [LOCAL ] AMPX: Loaded 53098 existing records from primary storage. [2025-10-13T17:13:01.522967] [INFO ] [MAIN ] AMPX: Loaded 53098 existing records. [2025-10-13T17:13:01.714707] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:01.714966] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-13T17:13:01.715013] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-13T17:13:01.715518] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-13T17:13:01.715574] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-13T17:13:02.018528] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-13T17:13:02.094481] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:02.197323] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T17:13:02.668511] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T17:13:02.817943] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-13T17:13:03.553207] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:13:03.617938] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-13T17:13:04.293858] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:13:04.417945] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-13T17:13:05.053040] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T17:13:05.217933] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-13T17:13:06.017922] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-13T17:13:06.236803] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T17:13:06.549951] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T17:13:06.817931] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-13T17:13:07.039168] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T17:13:07.617946] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-13T17:13:08.417932] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-13T17:13:08.790289] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-13T17:13:08.796852] [INFO ] [REMOTE ] AMH: Full fetch complete (74832 records). [2025-10-13T17:13:08.797040] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-13T17:13:09.126693] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:13:09.225217] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-13T17:13:09.270785] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-13T17:13:09.270937] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-13T17:13:09.271864] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-13T17:13:09.271933] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-13T17:13:09.274062] [DEBUG] [LOCAL ] AMH: Trimmed 74832 records to 51797 (keeping 200 days of data) [2025-10-13T17:13:09.623094] [DEBUG] [LOCAL ] AMH: Primary data saved (51797 records). [2025-10-13T17:13:09.623336] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-13T17:13:09.623469] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMH took 34.3s. Estimated remaining: 4h 51m 28s. Rate: 7.8 symbols/min [2025-10-13T17:13:09.833810] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:09.874413] [DEBUG] [LOCAL ] AMPY: Loaded 39277 existing records from primary storage. [2025-10-13T17:13:09.874921] [INFO ] [MAIN ] AMPY: Loaded 39277 existing records. [2025-10-13T17:13:10.022588] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-13T17:13:10.072055] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:10.072765] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-13T17:13:10.072927] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-13T17:13:10.073462] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-13T17:13:10.073533] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-13T17:13:10.224585] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T17:13:10.500459] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:10.817947] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-13T17:13:11.191927] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T17:13:11.279311] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T17:13:11.617935] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-13T17:13:12.009278] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:13:12.417938] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-13T17:13:13.223059] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-13T17:13:13.245121] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:13:13.789048] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T17:13:14.017938] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-13T17:13:14.817932] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-13T17:13:15.000717] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T17:13:15.392783] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T17:13:15.617931] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-13T17:13:16.417902] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-13T17:13:16.592486] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T17:13:17.120260] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T17:13:17.218035] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-13T17:13:17.466546] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T17:13:18.018047] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-13T17:13:18.817900] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-13T17:13:19.146605] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T17:13:19.600847] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T17:13:19.605754] [INFO ] [REMOTE ] AMN: Full fetch complete (60234 records). [2025-10-13T17:13:19.605892] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-13T17:13:19.623118] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-13T17:13:20.065730] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-13T17:13:20.065849] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-13T17:13:20.066720] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-13T17:13:20.066811] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-13T17:13:20.068268] [DEBUG] [LOCAL ] AMN: Trimmed 60234 records to 41763 (keeping 200 days of data) [2025-10-13T17:13:20.212095] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:13:20.346843] [DEBUG] [LOCAL ] AMN: Primary data saved (41763 records). [2025-10-13T17:13:20.347027] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-13T17:13:20.347592] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMN took 34.9s. Estimated remaining: 4h 52m 27s. Rate: 7.8 symbols/min [2025-10-13T17:13:20.423177] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-13T17:13:20.517769] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:20.549244] [DEBUG] [LOCAL ] AMR: Loaded 29346 existing records from primary storage. [2025-10-13T17:13:20.549496] [INFO ] [MAIN ] AMR: Loaded 29346 existing records. [2025-10-13T17:13:20.726447] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:20.726726] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-13T17:13:20.726781] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-13T17:13:20.727103] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-13T17:13:20.727162] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-13T17:13:21.077543] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:21.218032] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-13T17:13:21.580976] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:13:21.951210] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T17:13:21.954672] [INFO ] [REMOTE ] AMP: Full fetch complete (47351 records). [2025-10-13T17:13:21.954781] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-13T17:13:22.023908] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-13T17:13:22.315310] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T17:13:22.362501] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-13T17:13:22.362573] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-13T17:13:22.363089] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-13T17:13:22.363151] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-13T17:13:22.364063] [DEBUG] [LOCAL ] AMP: Trimmed 47351 records to 32007 (keeping 200 days of data) [2025-10-13T17:13:22.570188] [DEBUG] [LOCAL ] AMP: Primary data saved (32007 records). [2025-10-13T17:13:22.570336] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-13T17:13:22.570419] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMP took 25.4s. Estimated remaining: 4h 50m 19s. Rate: 7.8 symbols/min [2025-10-13T17:13:22.766936] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:22.805264] [DEBUG] [LOCAL ] AMRC: Loaded 38710 existing records from primary storage. [2025-10-13T17:13:22.805617] [INFO ] [MAIN ] AMRC: Loaded 38710 existing records. [2025-10-13T17:13:22.826201] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-13T17:13:22.984453] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:22.984627] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-13T17:13:22.984709] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-13T17:13:22.985408] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-13T17:13:22.985467] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-13T17:13:23.334274] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:23.618046] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-13T17:13:23.768515] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T17:13:23.798141] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T17:13:24.417965] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-13T17:13:24.860387] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T17:13:25.217966] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-13T17:13:25.448859] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T17:13:26.017920] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-13T17:13:26.454390] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T17:13:26.817934] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-13T17:13:27.594199] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T17:13:27.617925] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-13T17:13:27.734056] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T17:13:28.417925] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-13T17:13:28.810928] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T17:13:29.217932] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-13T17:13:30.018015] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-13T17:13:30.793180] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-13T17:13:30.825280] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-13T17:13:30.831259] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T17:13:31.237136] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T17:13:31.617937] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-13T17:13:32.196533] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T17:13:32.418000] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-13T17:13:33.217956] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-13T17:13:33.619690] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-13T17:13:33.647278] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T17:13:34.017942] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-13T17:13:34.683239] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T17:13:34.817937] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-13T17:13:35.608266] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T17:13:35.617892] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-13T17:13:36.110231] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T17:13:36.418008] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-13T17:13:36.846876] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:13:37.217987] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-13T17:13:37.821439] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T17:13:38.018048] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-13T17:13:38.453984] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T17:13:38.817946] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-13T17:13:39.617961] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-13T17:13:39.924099] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T17:13:39.971394] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T17:13:40.418010] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-13T17:13:41.013751] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:13:41.217968] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-13T17:13:42.017963] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-13T17:13:42.709214] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T17:13:42.781536] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-13T17:13:42.787961] [INFO ] [REMOTE ] AMPX: Full fetch complete (75049 records). [2025-10-13T17:13:42.788196] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-13T17:13:42.823158] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-13T17:13:43.217281] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-13T17:13:43.217436] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-13T17:13:43.218387] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-13T17:13:43.218458] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-13T17:13:43.220498] [DEBUG] [LOCAL ] AMPX: Trimmed 75049 records to 52323 (keeping 200 days of data) [2025-10-13T17:13:43.458455] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T17:13:43.576702] [DEBUG] [LOCAL ] AMPX: Primary data saved (52323 records). [2025-10-13T17:13:43.576922] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-13T17:13:43.578411] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMPX took 42.3s. Estimated remaining: 4h 54m 58s. Rate: 7.7 symbols/min [2025-10-13T17:13:43.624623] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-13T17:13:43.758817] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:43.759002] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-13T17:13:43.759041] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-13T17:13:43.759191] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-13T17:13:43.759232] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-13T17:13:43.759273] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-13T17:13:43.759316] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-13T17:13:44.140759] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:44.161122] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T17:13:44.418000] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-13T17:13:45.150788] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T17:13:45.217947] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-13T17:13:45.431028] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:13:45.431506] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-13T17:13:45.431604] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:13:45.431698] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-13T17:13:45.431748] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:13:45.431792] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-13T17:13:45.431857] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-13T17:13:45.431894] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-13T17:13:45.431935] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-13T17:13:45.431989] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMRZ took 1.9s. Estimated remaining: 4h 52m 43s. Rate: 7.7 symbols/min [2025-10-13T17:13:45.608218] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:45.636883] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:13:45.694997] [DEBUG] [LOCAL ] AMT: Loaded 53216 existing records from primary storage. [2025-10-13T17:13:45.695319] [INFO ] [MAIN ] AMT: Loaded 53216 existing records. [2025-10-13T17:13:45.893660] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:45.893892] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-13T17:13:45.893951] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-13T17:13:45.895037] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-13T17:13:45.895098] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-13T17:13:46.023047] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-13T17:13:46.280253] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:46.817949] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-13T17:13:47.273020] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T17:13:47.617934] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-13T17:13:48.426213] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-13T17:13:48.432348] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T17:13:49.117500] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T17:13:49.217939] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-13T17:13:50.023072] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-13T17:13:50.036796] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T17:13:50.377811] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T17:13:50.817981] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-13T17:13:51.463214] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:13:51.468086] [INFO ] [REMOTE ] AMPY: Full fetch complete (52464 records). [2025-10-13T17:13:51.468173] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-13T17:13:51.641360] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-13T17:13:51.850507] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-13T17:13:51.850581] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-13T17:13:51.851175] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-13T17:13:51.851239] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-13T17:13:51.852256] [DEBUG] [LOCAL ] AMPY: Trimmed 52464 records to 38869 (keeping 200 days of data) [2025-10-13T17:13:52.060693] [DEBUG] [LOCAL ] AMPY: Primary data saved (38869 records). [2025-10-13T17:13:52.060825] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-13T17:13:52.060905] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMPY took 42.4s. Estimated remaining: 4h 52m 12s. Rate: 7.7 symbols/min [2025-10-13T17:13:52.232066] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:52.253144] [DEBUG] [LOCAL ] AMTB: Loaded 20747 existing records from primary storage. [2025-10-13T17:13:52.253373] [INFO ] [MAIN ] AMTB: Loaded 20747 existing records. [2025-10-13T17:13:52.420535] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-13T17:13:52.433190] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:52.434314] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-13T17:13:52.434403] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-13T17:13:52.435047] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-13T17:13:52.435105] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-13T17:13:52.590571] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:13:52.872542] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:52.922379] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T17:13:53.217940] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-13T17:13:53.781567] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T17:13:54.017945] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-13T17:13:54.485749] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T17:13:54.491129] [INFO ] [REMOTE ] AMRC: Full fetch complete (53862 records). [2025-10-13T17:13:54.491267] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-13T17:13:54.832371] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-13T17:13:54.885901] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-13T17:13:54.885986] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-13T17:13:54.886546] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-13T17:13:54.886590] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-13T17:13:54.888088] [DEBUG] [LOCAL ] AMRC: Trimmed 53862 records to 38297 (keeping 200 days of data) [2025-10-13T17:13:55.109687] [DEBUG] [LOCAL ] AMRC: Primary data saved (38297 records). [2025-10-13T17:13:55.109845] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-13T17:13:55.109929] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMRC took 32.5s. Estimated remaining: 4h 50m 26s. Rate: 7.8 symbols/min [2025-10-13T17:13:55.285937] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:55.291636] [DEBUG] [LOCAL ] AMTD: Loaded 3793 existing records from primary storage. [2025-10-13T17:13:55.291826] [INFO ] [MAIN ] AMTD: Loaded 3793 existing records. [2025-10-13T17:13:55.482120] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:55.482563] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-13T17:13:55.482698] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-13T17:13:55.483059] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-13T17:13:55.483140] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-13T17:13:55.628830] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-13T17:13:55.771267] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T17:13:55.894116] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:55.975419] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:13:55.978602] [INFO ] [REMOTE ] AMR: Full fetch complete (40332 records). [2025-10-13T17:13:55.978717] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-13T17:13:56.362586] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-13T17:13:56.362780] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-13T17:13:56.363588] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-13T17:13:56.363684] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-13T17:13:56.365118] [DEBUG] [LOCAL ] AMR: Trimmed 40332 records to 28890 (keeping 200 days of data) [2025-10-13T17:13:56.422252] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-13T17:13:56.562506] [DEBUG] [LOCAL ] AMR: Primary data saved (28890 records). [2025-10-13T17:13:56.562745] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-13T17:13:56.563632] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMR took 36.2s. Estimated remaining: 4h 48m 8s. Rate: 7.9 symbols/min [2025-10-13T17:13:56.754473] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:13:56.815384] [DEBUG] [LOCAL ] AMTM: Loaded 51363 existing records from primary storage. [2025-10-13T17:13:56.815861] [INFO ] [MAIN ] AMTM: Loaded 51363 existing records. [2025-10-13T17:13:57.006796] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:13:57.031944] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:13:57.033031] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-13T17:13:57.033082] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-13T17:13:57.034039] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-13T17:13:57.034099] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-13T17:13:57.226625] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-13T17:13:57.382501] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:13:57.963381] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T17:13:58.018010] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-13T17:13:58.817962] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-13T17:13:59.114056] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T17:13:59.147751] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T17:13:59.617957] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-13T17:14:00.417983] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-13T17:14:00.487087] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T17:14:00.547896] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T17:14:00.841445] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-13T17:14:01.217991] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-13T17:14:02.017936] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-13T17:14:02.600713] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T17:14:02.739354] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:14:02.817960] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-13T17:14:03.618003] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-13T17:14:04.342402] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T17:14:04.417953] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-13T17:14:04.837933] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T17:14:05.129689] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:14:05.217907] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-13T17:14:06.017946] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-13T17:14:06.805117] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T17:14:06.818020] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-13T17:14:07.617939] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-13T17:14:08.046069] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T17:14:08.403789] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T17:14:08.417895] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-13T17:14:08.574603] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T17:14:09.217951] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-13T17:14:09.643520] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:14:09.867120] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T17:14:10.017958] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-13T17:14:10.817939] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-13T17:14:11.617946] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-13T17:14:11.844194] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T17:14:12.108587] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T17:14:12.417922] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-13T17:14:12.508255] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:14:13.217940] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-13T17:14:13.540458] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T17:14:14.017943] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-13T17:14:14.772030] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:14:14.817984] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-13T17:14:15.617949] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-13T17:14:15.724086] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T17:14:15.763145] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T17:14:16.261899] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T17:14:16.417937] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-13T17:14:16.816437] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-13T17:14:17.217939] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-13T17:14:18.017963] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-13T17:14:18.817939] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-13T17:14:19.163572] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-13T17:14:19.194375] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:14:19.412459] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T17:14:19.617954] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-13T17:14:20.417950] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-13T17:14:21.217914] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-13T17:14:21.301382] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:14:22.017939] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-13T17:14:22.069005] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T17:14:22.243616] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T17:14:22.712899] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-13T17:14:22.817930] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-13T17:14:23.617939] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-13T17:14:23.740449] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T17:14:24.177027] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T17:14:24.178125] [INFO ] [REMOTE ] AMTD: Full fetch complete (5603 records). [2025-10-13T17:14:24.178195] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-13T17:14:24.423133] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-13T17:14:24.546067] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-13T17:14:24.546187] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-13T17:14:24.546407] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-13T17:14:24.546453] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-13T17:14:24.547155] [DEBUG] [LOCAL ] AMTD: Trimmed 5603 records to 3779 (keeping 200 days of data) [2025-10-13T17:14:24.570252] [DEBUG] [LOCAL ] AMTD: Primary data saved (3779 records). [2025-10-13T17:14:24.570427] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-13T17:14:24.570534] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTD took 29.5s. Estimated remaining: 4h 54m 59s. Rate: 7.7 symbols/min [2025-10-13T17:14:24.751989] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:24.765871] [DEBUG] [LOCAL ] AMWL: Loaded 9466 existing records from primary storage. [2025-10-13T17:14:24.766213] [INFO ] [MAIN ] AMWL: Loaded 9466 existing records. [2025-10-13T17:14:24.954945] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:14:24.955238] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-13T17:14:24.955294] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-13T17:14:24.955699] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-13T17:14:24.955762] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-13T17:14:25.225322] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-13T17:14:25.338936] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:25.463190] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:14:25.465604] [INFO ] [REMOTE ] AMTB: Full fetch complete (29561 records). [2025-10-13T17:14:25.465851] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-13T17:14:25.845198] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-13T17:14:25.845302] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-13T17:14:25.845793] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-13T17:14:25.845858] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-13T17:14:25.847109] [DEBUG] [LOCAL ] AMTB: Trimmed 29561 records to 20503 (keeping 200 days of data) [2025-10-13T17:14:25.971787] [DEBUG] [LOCAL ] AMTB: Primary data saved (20503 records). [2025-10-13T17:14:25.971927] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-13T17:14:25.972013] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMTB took 33.9s. Estimated remaining: 4h 52m 41s. Rate: 7.7 symbols/min [2025-10-13T17:14:26.023363] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-13T17:14:26.158629] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:26.209061] [DEBUG] [LOCAL ] AMX: Loaded 49829 existing records from primary storage. [2025-10-13T17:14:26.209445] [INFO ] [MAIN ] AMX: Loaded 49829 existing records. [2025-10-13T17:14:26.408547] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:14:26.408864] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-13T17:14:26.408928] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-13T17:14:26.410449] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-13T17:14:26.410543] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-13T17:14:26.819189] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-13T17:14:26.905334] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:26.949086] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T17:14:27.063474] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T17:14:27.617944] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-13T17:14:28.417968] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-13T17:14:28.880983] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-13T17:14:28.886966] [INFO ] [REMOTE ] AMT: Full fetch complete (76030 records). [2025-10-13T17:14:28.887240] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-13T17:14:29.225053] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-13T17:14:29.237950] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T17:14:29.266610] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T17:14:29.353889] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-13T17:14:29.353974] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-13T17:14:29.354762] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-13T17:14:29.354826] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-13T17:14:29.356300] [DEBUG] [LOCAL ] AMT: Trimmed 76030 records to 52462 (keeping 200 days of data) [2025-10-13T17:14:29.686843] [DEBUG] [LOCAL ] AMT: Primary data saved (52462 records). [2025-10-13T17:14:29.686991] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-13T17:14:29.687865] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMT took 44.3s. Estimated remaining: 4h 51m 11s. Rate: 7.8 symbols/min [2025-10-13T17:14:29.859332] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:29.896073] [DEBUG] [LOCAL ] AN: Loaded 32078 existing records from primary storage. [2025-10-13T17:14:29.896347] [INFO ] [MAIN ] AN: Loaded 32078 existing records. [2025-10-13T17:14:30.031403] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-13T17:14:30.071780] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:14:30.072030] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-13T17:14:30.072077] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-13T17:14:30.072415] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-13T17:14:30.072472] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-13T17:14:30.422887] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:30.796535] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T17:14:30.799734] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:14:30.817877] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-13T17:14:31.617941] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-13T17:14:32.375084] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T17:14:32.417926] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-13T17:14:33.220236] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-13T17:14:33.224607] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T17:14:33.230661] [INFO ] [REMOTE ] AMTM: Full fetch complete (73836 records). [2025-10-13T17:14:33.230772] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-13T17:14:33.647591] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-13T17:14:33.647709] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-13T17:14:33.648473] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-13T17:14:33.648540] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-13T17:14:33.650175] [DEBUG] [LOCAL ] AMTM: Trimmed 73836 records to 50593 (keeping 200 days of data) [2025-10-13T17:14:33.951171] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:14:33.975243] [DEBUG] [LOCAL ] AMTM: Primary data saved (50593 records). [2025-10-13T17:14:33.975340] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-13T17:14:33.976078] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMTM took 37.4s. Estimated remaining: 4h 49m 54s. Rate: 7.8 symbols/min [2025-10-13T17:14:34.023143] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-13T17:14:34.149240] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:34.205662] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-10-13T17:14:34.206016] [INFO ] [MAIN ] ANET: Loaded 54546 existing records. [2025-10-13T17:14:34.383217] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:14:34.383572] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-13T17:14:34.383752] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-13T17:14:34.384112] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-13T17:14:34.384173] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-13T17:14:34.550392] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T17:14:34.777497] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:34.773969] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T17:14:34.817883] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-13T17:14:35.618035] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-13T17:14:35.632247] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:14:36.417976] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-13T17:14:37.217950] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-13T17:14:37.738900] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-13T17:14:38.028479] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-13T17:14:38.036048] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T17:14:38.431150] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T17:14:38.818051] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-13T17:14:39.618011] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-13T17:14:39.679316] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T17:14:39.995541] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T17:14:40.417954] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-13T17:14:40.984406] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T17:14:41.108476] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T17:14:41.217954] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-13T17:14:42.021543] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-13T17:14:42.731581] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:14:42.748721] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-13T17:14:42.817881] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-13T17:14:43.561579] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T17:14:43.617943] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-13T17:14:44.417969] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-13T17:14:45.133544] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T17:14:45.226628] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-13T17:14:45.255744] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T17:14:45.928686] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T17:14:45.930847] [INFO ] [REMOTE ] AMWL: Full fetch complete (14370 records). [2025-10-13T17:14:45.930920] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-13T17:14:46.023170] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-13T17:14:46.306571] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-13T17:14:46.306674] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-13T17:14:46.306954] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-13T17:14:46.306995] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-13T17:14:46.307489] [DEBUG] [LOCAL ] AMWL: Trimmed 14370 records to 9437 (keeping 200 days of data) [2025-10-13T17:14:46.360467] [DEBUG] [LOCAL ] AMWL: Primary data saved (9437 records). [2025-10-13T17:14:46.360598] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-13T17:14:46.360770] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMWL took 21.8s. Estimated remaining: 4h 51m 19s. Rate: 7.7 symbols/min [2025-10-13T17:14:46.536033] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:46.588189] [DEBUG] [LOCAL ] ANF: Loaded 52849 existing records from primary storage. [2025-10-13T17:14:46.588540] [INFO ] [MAIN ] ANF: Loaded 52849 existing records. [2025-10-13T17:14:46.771957] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:14:46.772183] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-13T17:14:46.772257] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-13T17:14:46.772805] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-13T17:14:46.772865] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-13T17:14:46.827899] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-13T17:14:47.129099] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:47.621951] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-13T17:14:47.626613] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T17:14:48.064858] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T17:14:48.417938] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-13T17:14:49.217940] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-13T17:14:49.595064] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T17:14:50.017971] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-13T17:14:50.615232] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-13T17:14:50.706474] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T17:14:50.817938] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-13T17:14:51.480404] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T17:14:51.617940] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-13T17:14:52.361260] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T17:14:52.417905] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-13T17:14:52.813253] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T17:14:53.217986] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-13T17:14:53.804986] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:14:54.018032] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-13T17:14:54.817968] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-13T17:14:55.026547] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T17:14:55.573233] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T17:14:55.578454] [INFO ] [REMOTE ] AMX: Full fetch complete (70708 records). [2025-10-13T17:14:55.578557] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-13T17:14:55.623231] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-13T17:14:55.964123] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-13T17:14:55.964208] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-13T17:14:55.964934] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-13T17:14:55.964997] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-13T17:14:55.966409] [DEBUG] [LOCAL ] AMX: Trimmed 70708 records to 49092 (keeping 200 days of data) [2025-10-13T17:14:56.254995] [DEBUG] [LOCAL ] AMX: Primary data saved (49092 records). [2025-10-13T17:14:56.255128] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-13T17:14:56.255218] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. AMX took 30.3s. Estimated remaining: 4h 51m 54s. Rate: 7.7 symbols/min [2025-10-13T17:14:56.423583] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-13T17:14:56.427049] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:14:56.428617] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-13T17:14:56.428846] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-13T17:14:56.428994] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-13T17:14:56.429044] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-13T17:14:56.429091] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-13T17:14:56.429127] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-13T17:14:56.821372] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:14:57.017858] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-13T17:14:57.075346] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T17:14:57.217945] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-13T17:14:57.818244] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T17:14:58.017951] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-13T17:14:58.817966] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-13T17:14:59.565851] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-13T17:14:59.617952] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-13T17:14:59.811246] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:14:59.830833] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:14:59.831114] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-13T17:14:59.831202] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:14:59.831250] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-13T17:14:59.831312] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:14:59.831384] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-13T17:14:59.831448] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-13T17:14:59.831485] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-13T17:14:59.831526] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-13T17:14:59.831574] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. ANGX took 3.6s. Estimated remaining: 4h 50m 25s. Rate: 7.8 symbols/min [2025-10-13T17:14:59.999983] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:15:00.033178] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:00.051718] [DEBUG] [LOCAL ] ANRO: Loaded 19612 existing records from primary storage. [2025-10-13T17:15:00.051952] [INFO ] [MAIN ] ANRO: Loaded 19612 existing records. [2025-10-13T17:15:00.240246] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:00.240490] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-13T17:15:00.240546] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-13T17:15:00.240800] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-13T17:15:00.240857] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-13T17:15:00.425240] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-13T17:15:00.600244] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:01.217960] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-13T17:15:01.769228] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T17:15:02.017979] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-13T17:15:02.817959] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-13T17:15:03.112021] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T17:15:03.617966] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-13T17:15:04.007787] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-13T17:15:04.357398] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T17:15:04.417973] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-13T17:15:05.217965] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-13T17:15:05.414901] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T17:15:06.018018] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-13T17:15:06.348408] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T17:15:06.408291] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T17:15:06.411418] [INFO ] [REMOTE ] AN: Full fetch complete (46881 records). [2025-10-13T17:15:06.411528] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-13T17:15:06.412288] [FATAL] [VALIDATOR ] AN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:15:06.412376] [FATAL] [MAIN ] AN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:15:06.412442] [WARN ] [MAIN ] AN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:15:06.412514] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-13T17:15:06.412578] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-13T17:15:06.412619] [INFO ] [LOCAL ] AN: Starting deletion of derivative data. [2025-10-13T17:15:06.412856] [DEBUG] [LOCAL ] AN: Deleted derivative data file. [2025-10-13T17:15:06.413501] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. AN took 36.7s. Estimated remaining: 4h 49m 55s. Rate: 7.8 symbols/min [2025-10-13T17:15:06.817957] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-13T17:15:06.998291] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T17:15:07.617950] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-13T17:15:08.417953] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-13T17:15:08.715721] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T17:15:09.166855] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-13T17:15:09.217900] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-13T17:15:10.018007] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-13T17:15:10.348184] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T17:15:10.818013] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-13T17:15:11.087740] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T17:15:11.177084] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T17:15:11.617910] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-13T17:15:12.418000] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-13T17:15:12.550279] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T17:15:13.218019] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-13T17:15:13.580948] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T17:15:13.963908] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-13T17:15:14.017992] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-13T17:15:14.817982] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-13T17:15:14.973272] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:15:15.167472] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T17:15:15.450090] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T17:15:15.455560] [INFO ] [REMOTE ] ANET: Full fetch complete (77470 records). [2025-10-13T17:15:15.455768] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-13T17:15:15.457479] [FATAL] [VALIDATOR ] ANET: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:15:15.457732] [FATAL] [MAIN ] ANET: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:15:15.457806] [WARN ] [MAIN ] ANET: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:15:15.457882] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-13T17:15:15.457988] [DEBUG] [LOCAL ] ANET: No primary data file found to delete. [2025-10-13T17:15:15.458046] [INFO ] [LOCAL ] ANET: Starting deletion of derivative data. [2025-10-13T17:15:15.458212] [DEBUG] [LOCAL ] ANET: Deleted derivative data file. [2025-10-13T17:15:15.458849] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANET took 41.5s. Estimated remaining: 4h 50m 13s. Rate: 7.8 symbols/min [2025-10-13T17:15:15.617927] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-13T17:15:16.417925] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-13T17:15:17.268220] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T17:15:17.279602] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-13T17:15:17.430254] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T17:15:18.017964] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-13T17:15:18.844673] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T17:15:18.849635] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-13T17:15:19.138784] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T17:15:19.589533] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T17:15:19.617996] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-13T17:15:20.418033] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-13T17:15:20.440676] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-13T17:15:21.218021] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-13T17:15:22.353216] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-13T17:15:22.371927] [INFO ] [REMOTE ] ANF: Full fetch complete (75593 records). [2025-10-13T17:15:22.373447] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T17:15:22.372854] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-13T17:15:22.378934] [INFO ] [REMOTE ] ANRO: Full fetch complete (29667 records). [2025-10-13T17:15:22.379066] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-13T17:15:23.150834] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-13T17:15:23.173695] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-13T17:15:23.154954] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-13T17:15:23.174278] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-13T17:15:23.173829] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-13T17:15:23.175139] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-13T17:15:23.175055] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-13T17:15:23.175405] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-13T17:15:23.176527] [DEBUG] [LOCAL ] ANRO: Trimmed 29667 records to 19332 (keeping 200 days of data) [2025-10-13T17:15:23.177547] [DEBUG] [LOCAL ] ANF: Trimmed 75593 records to 52071 (keeping 200 days of data) [2025-10-13T17:15:23.387717] [DEBUG] [LOCAL ] ANRO: Primary data saved (19332 records). [2025-10-13T17:15:23.396471] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-13T17:15:23.398863] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANRO took 23.6s. Estimated remaining: 4h 50m 9s. Rate: 7.8 symbols/min [2025-10-13T17:15:23.578589] [DEBUG] [LOCAL ] ANF: Primary data saved (52071 records). [2025-10-13T17:15:23.578752] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-13T17:15:23.578840] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANF took 37.2s. Estimated remaining: 4h 47m 39s. Rate: 7.8 symbols/min [2025-10-13T17:15:24.196509] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:24.153693] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:24.232969] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:24.244224] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-13T17:15:24.264149] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-13T17:15:24.264379] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-13T17:15:24.264464] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-13T17:15:24.264567] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-13T17:15:24.264676] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-13T17:15:24.321472] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:24.355478] [DEBUG] [LOCAL ] AOMR: No existing data file found in primary storage. [2025-10-13T17:15:24.372369] [WARN ] [MAIN ] AOMR: No existing data found, performing full refresh instead. [2025-10-13T17:15:24.403272] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-13T17:15:24.441903] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-13T17:15:24.496741] [DEBUG] [LOCAL ] AOD: Loaded 31144 existing records from primary storage. [2025-10-13T17:15:24.497926] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-13T17:15:24.505886] [INFO ] [MAIN ] AOD: Loaded 31144 existing records. [2025-10-13T17:15:24.495469] [DEBUG] [LOCAL ] ANVS: Loaded 23802 existing records from primary storage. [2025-10-13T17:15:24.505586] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-13T17:15:24.547493] [INFO ] [MAIN ] ANVS: Loaded 23802 existing records. [2025-10-13T17:15:25.058703] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:25.185784] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-13T17:15:25.235638] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:25.243162] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-13T17:15:25.289876] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:25.263430] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-13T17:15:25.297319] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-13T17:15:25.307116] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-13T17:15:25.351983] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-13T17:15:25.357234] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-13T17:15:25.411546] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-13T17:15:25.427188] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-13T17:15:25.721037] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:15:25.737168] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:25.792925] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-13T17:15:25.834314] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-13T17:15:25.835312] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:15:25.835420] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-13T17:15:25.835468] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:15:25.835510] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-13T17:15:25.905728] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-13T17:15:25.932727] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-13T17:15:26.003816] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-13T17:15:26.009155] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.4s. Estimated remaining: 4h 45m 54s. Rate: 7.9 symbols/min [2025-10-13T17:15:26.336731] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:26.383920] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-13T17:15:26.466580] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:26.501702] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:26.502013] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-13T17:15:26.545313] [DEBUG] [LOCAL ] AON: Loaded 45735 existing records from primary storage. [2025-10-13T17:15:26.545627] [INFO ] [MAIN ] AON: Loaded 45735 existing records. [2025-10-13T17:15:26.729138] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:26.729622] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-13T17:15:26.729719] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-13T17:15:26.730057] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-13T17:15:26.730098] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-13T17:15:26.820801] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:15:26.824138] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-13T17:15:27.165443] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:27.165866] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-13T17:15:27.517061] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T17:15:27.520794] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-13T17:15:27.685966] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T17:15:27.692094] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-13T17:15:27.756462] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T17:15:28.334362] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T17:15:28.417933] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-13T17:15:28.540787] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T17:15:28.763908] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:15:29.217938] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-13T17:15:29.386948] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T17:15:30.018110] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-13T17:15:30.598146] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:15:30.817909] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-13T17:15:31.617898] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-13T17:15:31.717809] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T17:15:31.986854] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T17:15:32.417920] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-13T17:15:32.597676] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T17:15:33.217911] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-13T17:15:33.666378] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T17:15:34.017924] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-13T17:15:34.316301] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T17:15:34.817932] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-13T17:15:35.121983] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T17:15:35.618006] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-13T17:15:35.625488] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T17:15:36.418047] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-13T17:15:36.906520] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T17:15:37.217914] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-13T17:15:37.419844] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T17:15:38.018025] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-13T17:15:38.687600] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T17:15:38.817944] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-13T17:15:39.617890] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-13T17:15:39.646693] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T17:15:39.944314] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T17:15:40.417933] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-13T17:15:40.549762] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T17:15:41.217937] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-13T17:15:42.017912] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-13T17:15:42.151122] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T17:15:42.306053] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T17:15:42.817982] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-13T17:15:43.481190] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T17:15:43.617932] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-13T17:15:44.420794] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-13T17:15:44.423431] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T17:15:44.668018] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T17:15:45.217946] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-13T17:15:45.593861] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T17:15:46.017929] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-13T17:15:46.484962] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T17:15:46.817945] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-13T17:15:47.120562] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T17:15:47.570531] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T17:15:47.617896] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-13T17:15:48.417905] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-13T17:15:48.649605] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-13T17:15:49.218005] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-13T17:15:49.705693] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T17:15:50.017936] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-13T17:15:50.636779] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T17:15:50.640155] [INFO ] [REMOTE ] ANVS: Full fetch complete (36501 records). [2025-10-13T17:15:50.640260] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-13T17:15:50.823111] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-13T17:15:51.007171] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-13T17:15:51.007243] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-13T17:15:51.007712] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-13T17:15:51.007777] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-13T17:15:51.008553] [DEBUG] [LOCAL ] ANVS: Trimmed 36501 records to 23559 (keeping 200 days of data) [2025-10-13T17:15:51.146761] [DEBUG] [LOCAL ] ANVS: Primary data saved (23559 records). [2025-10-13T17:15:51.146892] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-13T17:15:51.147024] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. ANVS took 27.6s. Estimated remaining: 4h 51m 10s. Rate: 7.7 symbols/min [2025-10-13T17:15:51.315785] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:51.359047] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T17:15:51.358253] [DEBUG] [LOCAL ] AORT: Loaded 29573 existing records from primary storage. [2025-10-13T17:15:51.366019] [INFO ] [MAIN ] AORT: Loaded 29573 existing records. [2025-10-13T17:15:51.538912] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:51.539171] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-13T17:15:51.539224] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-13T17:15:51.539786] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-13T17:15:51.539858] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-13T17:15:51.618783] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-13T17:15:51.906225] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T17:15:51.910552] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:52.417932] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-13T17:15:52.959046] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T17:15:52.963018] [INFO ] [REMOTE ] AOD: Full fetch complete (44518 records). [2025-10-13T17:15:52.963139] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-13T17:15:53.223031] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-13T17:15:53.345140] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-13T17:15:53.345286] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-13T17:15:53.345901] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-13T17:15:53.346053] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-13T17:15:53.359126] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T17:15:53.365011] [DEBUG] [LOCAL ] AOD: Trimmed 44518 records to 30694 (keeping 200 days of data) [2025-10-13T17:15:53.545695] [DEBUG] [LOCAL ] AOD: Primary data saved (30694 records). [2025-10-13T17:15:53.545834] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-13T17:15:53.546682] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AOD took 30.0s. Estimated remaining: 4h 49m 24s. Rate: 7.8 symbols/min [2025-10-13T17:15:53.711148] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:53.756037] [DEBUG] [LOCAL ] AOS: Loaded 49405 existing records from primary storage. [2025-10-13T17:15:53.756344] [INFO ] [MAIN ] AOS: Loaded 49405 existing records. [2025-10-13T17:15:53.931983] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:53.932229] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-13T17:15:53.932277] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-13T17:15:53.932571] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-13T17:15:53.932627] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-13T17:15:54.027703] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-13T17:15:54.278040] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:54.774237] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T17:15:54.817916] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-13T17:15:54.966286] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T17:15:54.968105] [INFO ] [REMOTE ] AOMR: Full fetch complete (23162 records). [2025-10-13T17:15:54.968355] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-13T17:15:55.356836] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-13T17:15:55.356956] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-13T17:15:55.357474] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-13T17:15:55.357546] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-13T17:15:55.358355] [DEBUG] [LOCAL ] AOMR: Trimmed 23162 records to 16492 (keeping 200 days of data) [2025-10-13T17:15:55.466354] [DEBUG] [LOCAL ] AOMR: Primary data saved (16492 records). [2025-10-13T17:15:55.466571] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-13T17:15:55.466692] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AOMR took 31.9s. Estimated remaining: 4h 47m 31s. Rate: 7.8 symbols/min [2025-10-13T17:15:55.623235] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-13T17:15:55.672109] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:15:55.683023] [DEBUG] [LOCAL ] AP: Loaded 7276 existing records from primary storage. [2025-10-13T17:15:55.683317] [INFO ] [MAIN ] AP: Loaded 7276 existing records. [2025-10-13T17:15:55.884690] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:15:55.885172] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-13T17:15:55.885290] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-13T17:15:55.885617] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-13T17:15:55.885714] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-13T17:15:56.101590] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T17:15:56.328865] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:15:56.417937] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-13T17:15:57.109063] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T17:15:57.217896] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-13T17:15:57.760841] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T17:15:58.017953] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-13T17:15:58.676845] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T17:15:58.817926] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-13T17:15:59.070766] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T17:15:59.617935] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-13T17:16:00.140377] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:16:00.417920] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-13T17:16:00.843165] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T17:16:00.985748] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T17:16:01.217930] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-13T17:16:02.017935] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-13T17:16:02.817919] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-13T17:16:02.934121] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T17:16:03.284077] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T17:16:03.488820] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T17:16:03.617926] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-13T17:16:04.417997] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-13T17:16:04.978752] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T17:16:05.218002] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-13T17:16:06.017962] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-13T17:16:06.242988] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T17:16:06.604490] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T17:16:06.817897] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-13T17:16:07.617905] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-13T17:16:07.689243] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T17:16:08.417895] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-13T17:16:08.493339] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T17:16:08.657113] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T17:16:09.217928] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-13T17:16:10.017905] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-13T17:16:10.096213] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:16:10.621583] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T17:16:10.730414] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:16:10.817908] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-13T17:16:11.617976] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-13T17:16:12.114107] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T17:16:12.120160] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T17:16:12.417944] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-13T17:16:13.217924] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-13T17:16:13.651496] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T17:16:14.018006] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-13T17:16:14.527066] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T17:16:14.531524] [INFO ] [REMOTE ] AON: Full fetch complete (64556 records). [2025-10-13T17:16:14.531679] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-13T17:16:14.823040] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-13T17:16:14.947052] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-13T17:16:14.947161] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-13T17:16:14.947828] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-13T17:16:14.947891] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-13T17:16:14.949817] [DEBUG] [LOCAL ] AON: Trimmed 64556 records to 45124 (keeping 200 days of data) [2025-10-13T17:16:15.236789] [DEBUG] [LOCAL ] AON: Primary data saved (45124 records). [2025-10-13T17:16:15.237018] [INFO ] [MAIN ] AON: Full history saved. [2025-10-13T17:16:15.237183] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AON took 49.2s. Estimated remaining: 4h 51m 0s. Rate: 7.7 symbols/min [2025-10-13T17:16:15.422975] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:16:15.462246] [DEBUG] [LOCAL ] APAM: Loaded 36563 existing records from primary storage. [2025-10-13T17:16:15.462535] [INFO ] [MAIN ] APAM: Loaded 36563 existing records. [2025-10-13T17:16:15.653240] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:16:15.621037] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-13T17:16:15.653541] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-13T17:16:15.654779] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-13T17:16:15.655236] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-13T17:16:15.655388] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-13T17:16:15.988257] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T17:16:16.062110] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:16:16.125443] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T17:16:16.370850] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T17:16:16.417916] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-13T17:16:17.046954] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-13T17:16:17.217927] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-13T17:16:18.018024] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-13T17:16:18.817939] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-13T17:16:18.828629] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T17:16:19.617976] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-13T17:16:19.767817] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-13T17:16:20.036309] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T17:16:20.417934] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-13T17:16:21.217928] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-13T17:16:21.598376] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T17:16:21.718104] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-13T17:16:21.721692] [INFO ] [REMOTE ] AORT: Full fetch complete (41946 records). [2025-10-13T17:16:21.721888] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-13T17:16:21.723233] [FATAL] [VALIDATOR ] AORT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:16:21.723456] [FATAL] [MAIN ] AORT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:16:21.723523] [WARN ] [MAIN ] AORT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:16:21.723601] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-13T17:16:21.723724] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-13T17:16:21.723786] [INFO ] [LOCAL ] AORT: Starting deletion of derivative data. [2025-10-13T17:16:21.723973] [DEBUG] [LOCAL ] AORT: Deleted derivative data file. [2025-10-13T17:16:21.724083] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AORT took 30.6s. Estimated remaining: 4h 50m 30s. Rate: 7.7 symbols/min [2025-10-13T17:16:21.893618] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:16:21.939064] [DEBUG] [LOCAL ] APD: Loaded 45975 existing records from primary storage. [2025-10-13T17:16:21.939362] [INFO ] [MAIN ] APD: Loaded 45975 existing records. [2025-10-13T17:16:22.018954] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-13T17:16:22.049399] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T17:16:22.133584] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:16:22.133844] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-13T17:16:22.133895] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-13T17:16:22.134212] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-13T17:16:22.134287] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-13T17:16:22.490989] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:16:22.817949] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-13T17:16:23.469747] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T17:16:23.618011] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-13T17:16:24.417951] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-13T17:16:24.478463] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:16:24.996130] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T17:16:25.216616] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T17:16:25.218936] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-13T17:16:26.017954] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-13T17:16:26.695943] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T17:16:26.817925] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-13T17:16:26.866565] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T17:16:27.617965] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-13T17:16:28.417958] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-13T17:16:28.554477] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T17:16:28.873587] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T17:16:28.874584] [INFO ] [REMOTE ] AP: Full fetch complete (8955 records). [2025-10-13T17:16:28.874687] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-13T17:16:28.875079] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:16:28.875164] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:16:28.875208] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:16:28.875247] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-13T17:16:28.875301] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-13T17:16:28.875336] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-10-13T17:16:28.875462] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-10-13T17:16:28.875525] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AP took 33.4s. Estimated remaining: 4h 50m 11s. Rate: 7.7 symbols/min [2025-10-13T17:16:29.050064] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:16:29.101903] [DEBUG] [LOCAL ] APG: Loaded 51201 existing records from primary storage. [2025-10-13T17:16:29.102230] [INFO ] [MAIN ] APG: Loaded 51201 existing records. [2025-10-13T17:16:29.218406] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-13T17:16:29.281500] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T17:16:29.307140] [INFO ] [REMOTE ] AOS: Full fetch complete (70366 records). [2025-10-13T17:16:29.311369] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:16:29.311721] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-13T17:16:29.311965] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-13T17:16:29.312285] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-13T17:16:29.313263] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-13T17:16:29.313183] [FATAL] [VALIDATOR ] AOS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:16:29.313521] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-13T17:16:29.313453] [FATAL] [MAIN ] AOS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:16:29.348078] [WARN ] [MAIN ] AOS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:16:29.373837] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-13T17:16:29.389749] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-13T17:16:29.396054] [INFO ] [LOCAL ] AOS: Starting deletion of derivative data. [2025-10-13T17:16:29.422312] [DEBUG] [LOCAL ] AOS: Deleted derivative data file. [2025-10-13T17:16:29.425611] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. AOS took 35.9s. Estimated remaining: 4h 47m 57s. Rate: 7.8 symbols/min [2025-10-13T17:16:29.810995] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:16:29.821425] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-10-13T17:16:29.821493] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-10-13T17:16:29.844791] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-13T17:16:29.857359] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-13T17:16:29.864888] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-13T17:16:29.880206] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-13T17:16:29.898923] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:16:30.023126] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-13T17:16:30.260725] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:16:30.817958] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-13T17:16:30.920429] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T17:16:31.551450] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T17:16:31.617915] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-13T17:16:32.068033] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T17:16:32.417940] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-13T17:16:33.062371] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T17:16:33.217946] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-13T17:16:34.017985] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-13T17:16:34.261385] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T17:16:34.732052] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T17:16:34.817915] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-13T17:16:35.395624] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:16:35.618031] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-13T17:16:36.139693] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T17:16:36.417931] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-13T17:16:37.217932] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-13T17:16:37.369389] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T17:16:37.635198] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:16:38.017982] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-13T17:16:38.817979] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-13T17:16:38.853207] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T17:16:39.451296] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T17:16:39.617927] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-13T17:16:40.417914] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-13T17:16:40.526453] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T17:16:41.217955] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-13T17:16:41.360357] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:16:42.017921] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-13T17:16:42.170718] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T17:16:42.559769] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T17:16:42.817943] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-13T17:16:43.538354] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T17:16:43.617900] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-13T17:16:44.417923] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-13T17:16:44.541260] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T17:16:45.111054] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:16:45.217922] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-13T17:16:46.017921] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-13T17:16:46.155420] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T17:16:46.817909] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-13T17:16:47.052002] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T17:16:47.086152] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T17:16:47.617950] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-13T17:16:48.417946] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-13T17:16:48.576883] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:16:49.214739] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T17:16:49.225513] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-13T17:16:49.790681] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T17:16:49.794878] [INFO ] [REMOTE ] APAM: Full fetch complete (51866 records). [2025-10-13T17:16:49.795123] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-13T17:16:50.024628] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-13T17:16:50.196049] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-13T17:16:50.196178] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-13T17:16:50.196828] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-13T17:16:50.196894] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-13T17:16:50.198389] [DEBUG] [LOCAL ] APAM: Trimmed 51866 records to 36096 (keeping 200 days of data) [2025-10-13T17:16:50.414316] [DEBUG] [LOCAL ] APAM: Primary data saved (36096 records). [2025-10-13T17:16:50.414460] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-13T17:16:50.414542] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APAM took 35.2s. Estimated remaining: 4h 51m 40s. Rate: 7.7 symbols/min [2025-10-13T17:16:50.586877] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:16:50.637572] [DEBUG] [LOCAL ] APLE: Loaded 52694 existing records from primary storage. [2025-10-13T17:16:50.637944] [INFO ] [MAIN ] APLE: Loaded 52694 existing records. [2025-10-13T17:16:50.821362] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:16:50.821497] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-13T17:16:50.823306] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-13T17:16:50.823494] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-13T17:16:50.824137] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-13T17:16:50.824408] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-13T17:16:51.185296] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:16:51.248083] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:16:51.617892] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-13T17:16:52.417892] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-13T17:16:52.453058] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T17:16:53.217953] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-13T17:16:53.478206] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T17:16:54.018078] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-13T17:16:54.517063] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-13T17:16:54.706858] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (4.68 seconds). [2025-10-13T17:16:54.817892] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-13T17:16:55.468752] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:16:55.617908] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-13T17:16:56.417919] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-13T17:16:56.617145] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (3.40 seconds). [2025-10-13T17:16:57.183607] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T17:16:57.217893] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-13T17:16:57.719092] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T17:16:58.018059] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-13T17:16:58.373443] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (3.56 seconds). [2025-10-13T17:16:58.817892] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-13T17:16:58.896725] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T17:16:59.309051] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T17:16:59.314217] [INFO ] [REMOTE ] APD: Full fetch complete (66925 records). [2025-10-13T17:16:59.314323] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-13T17:16:59.623010] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-13T17:16:59.759124] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-13T17:16:59.759248] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-13T17:16:59.759991] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-13T17:16:59.760059] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-13T17:16:59.761686] [DEBUG] [LOCAL ] APD: Trimmed 66925 records to 45325 (keeping 200 days of data) [2025-10-13T17:17:00.049477] [DEBUG] [LOCAL ] APD: Primary data saved (45325 records). [2025-10-13T17:17:00.049613] [INFO ] [MAIN ] APD: Full history saved. [2025-10-13T17:17:00.050474] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APD took 38.3s. Estimated remaining: 4h 52m 4s. Rate: 7.7 symbols/min [2025-10-13T17:17:00.228939] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:00.285711] [DEBUG] [LOCAL ] APO: Loaded 54163 existing records from primary storage. [2025-10-13T17:17:00.286049] [INFO ] [MAIN ] APO: Loaded 54163 existing records. [2025-10-13T17:17:00.426803] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-13T17:17:00.467965] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:00.469262] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-13T17:17:00.469376] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-13T17:17:00.470140] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-13T17:17:00.470204] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-13T17:17:00.610459] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T17:17:00.705119] [INFO ] [REMOTE ] APG: Full fetch complete (71842 records). [2025-10-13T17:17:00.721717] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-13T17:17:01.001071] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:01.226584] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-13T17:17:01.284003] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-13T17:17:01.284132] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-13T17:17:01.285179] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-13T17:17:01.285253] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-13T17:17:01.287062] [DEBUG] [LOCAL ] APG: Trimmed 71842 records to 50584 (keeping 200 days of data) [2025-10-13T17:17:01.614054] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T17:17:01.642492] [DEBUG] [LOCAL ] APG: Primary data saved (50584 records). [2025-10-13T17:17:01.642595] [INFO ] [MAIN ] APG: Full history saved. [2025-10-13T17:17:01.642688] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APG took 32.8s. Estimated remaining: 4h 50m 10s. Rate: 7.7 symbols/min [2025-10-13T17:17:01.806333] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:01.814738] [DEBUG] [LOCAL ] APOS: Loaded 7591 existing records from primary storage. [2025-10-13T17:17:01.814923] [INFO ] [MAIN ] APOS: Loaded 7591 existing records. [2025-10-13T17:17:01.987154] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:01.987359] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-13T17:17:01.987406] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-13T17:17:01.987560] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-13T17:17:01.987597] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-13T17:17:02.018726] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-13T17:17:02.342012] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:02.383481] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T17:17:02.817949] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-13T17:17:03.385054] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T17:17:03.434477] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-13T17:17:03.617952] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-13T17:17:03.786698] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T17:17:04.320981] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T17:17:04.417954] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-13T17:17:05.064447] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T17:17:05.217989] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-13T17:17:06.017928] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-13T17:17:06.817954] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-13T17:17:07.617993] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-13T17:17:07.664274] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:17:08.149964] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-13T17:17:08.351401] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-13T17:17:08.417970] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-13T17:17:08.689508] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T17:17:09.175479] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-13T17:17:09.217958] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-13T17:17:10.012855] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T17:17:10.017872] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-13T17:17:10.817925] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-13T17:17:10.830801] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T17:17:11.617923] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-13T17:17:12.417967] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-13T17:17:12.665249] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T17:17:12.670628] [INFO ] [REMOTE ] APH: Full fetch complete (77692 records). [2025-10-13T17:17:12.670758] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-13T17:17:13.057893] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-13T17:17:13.058097] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-13T17:17:13.058981] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-13T17:17:13.059062] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-13T17:17:13.060704] [DEBUG] [LOCAL ] APH: Trimmed 77692 records to 53691 (keeping 200 days of data) [2025-10-13T17:17:13.191517] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T17:17:13.217917] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-13T17:17:13.432635] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-13T17:17:13.432795] [INFO ] [MAIN ] APH: Full history saved. [2025-10-13T17:17:13.432868] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APH took 44.0s. Estimated remaining: 4h 51m 10s. Rate: 7.7 symbols/min [2025-10-13T17:17:13.600360] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:13.649231] [DEBUG] [LOCAL ] APTV: Loaded 52790 existing records from primary storage. [2025-10-13T17:17:13.649536] [INFO ] [MAIN ] APTV: Loaded 52790 existing records. [2025-10-13T17:17:13.820680] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:13.820889] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-13T17:17:13.820934] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-13T17:17:13.821397] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-13T17:17:13.821458] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-13T17:17:14.026591] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-13T17:17:14.177198] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:14.204722] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T17:17:14.715181] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T17:17:14.777313] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:17:14.817889] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-13T17:17:15.617949] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-13T17:17:16.417918] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-13T17:17:16.537348] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T17:17:16.906822] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-13T17:17:17.217979] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-13T17:17:17.530010] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T17:17:18.017961] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-13T17:17:18.817911] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-13T17:17:18.977148] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T17:17:19.453043] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T17:17:19.617904] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-13T17:17:20.426085] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-13T17:17:20.446625] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-13T17:17:20.484432] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T17:17:20.485579] [INFO ] [REMOTE ] APOS: Full fetch complete (10343 records). [2025-10-13T17:17:20.485680] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-13T17:17:20.486138] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:17:20.486223] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:17:20.486266] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:17:20.486304] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-13T17:17:20.486358] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-13T17:17:20.486397] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-13T17:17:20.486552] [DEBUG] [LOCAL ] APOS: Deleted derivative data file. [2025-10-13T17:17:20.486663] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APOS took 18.8s. Estimated remaining: 4h 50m 50s. Rate: 7.7 symbols/min [2025-10-13T17:17:20.654879] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:20.655090] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-13T17:17:20.655128] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-13T17:17:20.655244] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-13T17:17:20.655285] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-13T17:17:20.655347] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-13T17:17:20.655382] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-13T17:17:21.039620] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:21.217911] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-13T17:17:22.017964] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-13T17:17:22.299088] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T17:17:22.817927] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-13T17:17:23.059559] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T17:17:23.510597] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T17:17:23.617936] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-13T17:17:24.417998] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-13T17:17:24.654690] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:17:24.943385] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T17:17:25.218036] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-13T17:17:26.017940] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-13T17:17:26.159957] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:17:26.817919] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-13T17:17:27.101418] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:17:27.382724] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:17:27.617924] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-13T17:17:28.417953] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-13T17:17:28.696486] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T17:17:29.217956] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-13T17:17:29.406314] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T17:17:29.771904] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T17:17:30.017980] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-13T17:17:30.642138] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:17:30.817968] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-13T17:17:31.617970] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-13T17:17:31.713247] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T17:17:31.718189] [INFO ] [REMOTE ] APLE: Full fetch complete (74075 records). [2025-10-13T17:17:31.718322] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-13T17:17:31.719194] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:17:31.719283] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:17:31.719326] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:17:31.719364] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-13T17:17:31.719424] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-13T17:17:31.719459] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-10-13T17:17:31.719614] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-10-13T17:17:31.719734] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APLE took 41.3s. Estimated remaining: 4h 51m 39s. Rate: 7.7 symbols/min [2025-10-13T17:17:31.884856] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:31.890786] [DEBUG] [LOCAL ] AQNB: Loaded 4197 existing records from primary storage. [2025-10-13T17:17:31.890972] [INFO ] [MAIN ] AQNB: Loaded 4197 existing records. [2025-10-13T17:17:32.064759] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:32.064988] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-13T17:17:32.065034] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-13T17:17:32.065207] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-13T17:17:32.065264] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-13T17:17:32.421617] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-13T17:17:32.427090] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:32.508792] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:17:33.217958] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-13T17:17:33.428384] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T17:17:34.017969] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-13T17:17:34.336521] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T17:17:34.817914] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-13T17:17:34.917097] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:17:35.594391] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T17:17:35.617890] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-13T17:17:36.362329] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T17:17:36.417903] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-13T17:17:37.065625] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T17:17:37.217951] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-13T17:17:37.842754] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T17:17:38.017910] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-13T17:17:38.143743] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T17:17:38.564119] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T17:17:38.817966] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-13T17:17:39.617986] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-13T17:17:40.417939] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-13T17:17:40.507528] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:17:40.873997] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T17:17:41.217954] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-13T17:17:41.635245] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-13T17:17:41.641763] [INFO ] [REMOTE ] APO: Full fetch complete (77291 records). [2025-10-13T17:17:41.641976] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-13T17:17:41.947032] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-13T17:17:42.023051] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-13T17:17:42.077672] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-13T17:17:42.077828] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-13T17:17:42.078766] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-13T17:17:42.078845] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-13T17:17:42.081085] [DEBUG] [LOCAL ] APO: Trimmed 77291 records to 53387 (keeping 200 days of data) [2025-10-13T17:17:42.450374] [DEBUG] [LOCAL ] APO: Primary data saved (53387 records). [2025-10-13T17:17:42.450617] [INFO ] [MAIN ] APO: Full history saved. [2025-10-13T17:17:42.451753] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. APO took 42.4s. Estimated remaining: 4h 52m 20s. Rate: 7.6 symbols/min [2025-10-13T17:17:42.639556] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:42.704011] [DEBUG] [LOCAL ] AR: Loaded 54366 existing records from primary storage. [2025-10-13T17:17:42.704464] [INFO ] [MAIN ] AR: Loaded 54366 existing records. [2025-10-13T17:17:42.823092] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-13T17:17:42.895540] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:42.895947] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-13T17:17:42.895996] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-13T17:17:42.896423] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-13T17:17:42.896480] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-13T17:17:43.262900] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:43.510037] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T17:17:43.617931] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-13T17:17:43.881067] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T17:17:44.417951] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-13T17:17:45.218016] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-13T17:17:45.460589] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T17:17:45.609205] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-13T17:17:46.017953] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-13T17:17:46.132551] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T17:17:46.138450] [INFO ] [REMOTE ] APTV: Full fetch complete (75809 records). [2025-10-13T17:17:46.138602] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-13T17:17:46.547977] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-13T17:17:46.551472] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-13T17:17:46.552513] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-13T17:17:46.552586] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-13T17:17:46.554230] [DEBUG] [LOCAL ] APTV: Trimmed 75809 records to 52009 (keeping 200 days of data) [2025-10-13T17:17:46.819067] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-13T17:17:46.864779] [DEBUG] [LOCAL ] APTV: Primary data saved (52009 records). [2025-10-13T17:17:46.864950] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-13T17:17:46.865112] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. APTV took 33.4s. Estimated remaining: 4h 51m 15s. Rate: 7.7 symbols/min [2025-10-13T17:17:47.031791] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:47.031992] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-13T17:17:47.032030] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-13T17:17:47.032168] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-13T17:17:47.032209] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-13T17:17:47.032256] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-13T17:17:47.032335] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-13T17:17:47.386108] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:47.393267] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-13T17:17:47.617952] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-13T17:17:47.664261] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:17:48.417955] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-13T17:17:49.164747] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T17:17:49.217929] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-13T17:17:49.577386] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-13T17:17:49.579858] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T17:17:50.017938] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-13T17:17:50.817928] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-13T17:17:51.617903] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-13T17:17:51.686333] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:17:52.213068] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T17:17:52.417934] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-13T17:17:52.837307] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-13T17:17:53.217974] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-13T17:17:53.751790] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T17:17:53.753058] [INFO ] [REMOTE ] AQNB: Full fetch complete (5555 records). [2025-10-13T17:17:53.753133] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-13T17:17:54.023550] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-13T17:17:54.109615] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T17:17:54.193514] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-13T17:17:54.193599] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-13T17:17:54.193794] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-13T17:17:54.193857] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-13T17:17:54.194248] [DEBUG] [LOCAL ] AQNB: Trimmed 5555 records to 4117 (keeping 200 days of data) [2025-10-13T17:17:54.223102] [DEBUG] [LOCAL ] AQNB: Primary data saved (4117 records). [2025-10-13T17:17:54.223229] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-13T17:17:54.223315] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQNB took 22.5s. Estimated remaining: 4h 51m 0s. Rate: 7.7 symbols/min [2025-10-13T17:17:54.399418] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:17:54.415907] [DEBUG] [LOCAL ] ARDC: Loaded 15383 existing records from primary storage. [2025-10-13T17:17:54.416145] [INFO ] [MAIN ] ARDC: Loaded 15383 existing records. [2025-10-13T17:17:54.594631] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:17:54.595099] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-13T17:17:54.595166] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-13T17:17:54.595689] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-13T17:17:54.595749] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-13T17:17:54.823105] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-13T17:17:54.963110] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:17:55.617934] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-13T17:17:55.831703] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T17:17:56.417998] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-13T17:17:56.615579] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T17:17:56.861598] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T17:17:57.217938] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-13T17:17:57.892478] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T17:17:58.017903] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-13T17:17:58.205544] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T17:17:58.817974] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-13T17:17:59.617895] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-13T17:18:00.013817] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-13T17:18:00.020056] [INFO ] [REMOTE ] AQN: Full fetch complete (75214 records). [2025-10-13T17:18:00.020244] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-13T17:18:00.417924] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-13T17:18:00.466623] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-13T17:18:00.466827] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-13T17:18:00.467722] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-13T17:18:00.467790] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-13T17:18:00.469683] [DEBUG] [LOCAL ] AQN: Trimmed 75214 records to 51791 (keeping 200 days of data) [2025-10-13T17:18:00.738535] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T17:18:00.854820] [DEBUG] [LOCAL ] AQN: Primary data saved (51791 records). [2025-10-13T17:18:00.855014] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-13T17:18:00.855104] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AQN took 40.4s. Estimated remaining: 4h 50m 33s. Rate: 7.7 symbols/min [2025-10-13T17:18:01.034410] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:01.067672] [DEBUG] [LOCAL ] ARDT: Loaded 28107 existing records from primary storage. [2025-10-13T17:18:01.068047] [INFO ] [MAIN ] ARDT: Loaded 28107 existing records. [2025-10-13T17:18:01.236942] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-13T17:18:01.243064] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:18:01.289821] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:18:01.290317] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-13T17:18:01.290436] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-13T17:18:01.302022] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-13T17:18:01.302251] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-13T17:18:01.396333] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T17:18:01.722736] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:02.017947] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-13T17:18:02.766168] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T17:18:02.817938] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-13T17:18:03.210716] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-13T17:18:03.617960] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-13T17:18:03.783300] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T17:18:04.417959] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-13T17:18:05.217916] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-13T17:18:05.323691] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T17:18:05.608798] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-13T17:18:06.017993] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-13T17:18:06.249266] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:18:06.817968] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-13T17:18:07.617903] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-13T17:18:07.755614] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:18:08.417904] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-13T17:18:08.638512] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T17:18:08.867667] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T17:18:09.217990] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-13T17:18:09.981587] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T17:18:10.017884] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-13T17:18:10.817920] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-13T17:18:11.154638] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T17:18:11.617965] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-13T17:18:11.665891] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T17:18:11.696710] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T17:18:12.417950] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-13T17:18:12.468392] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T17:18:13.217975] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-13T17:18:13.866312] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T17:18:14.018036] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-13T17:18:14.213998] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T17:18:14.817967] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-13T17:18:15.419975] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T17:18:15.556023] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T17:18:15.617930] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-13T17:18:16.417979] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-13T17:18:16.965455] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T17:18:17.217974] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-13T17:18:17.280297] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T17:18:18.017993] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-13T17:18:18.817898] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-13T17:18:18.885085] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T17:18:19.120336] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T17:18:19.617947] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-13T17:18:20.417898] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-13T17:18:20.495215] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:18:20.593203] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T17:18:21.217917] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-13T17:18:21.368579] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T17:18:22.017973] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-13T17:18:22.817919] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-13T17:18:22.861533] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T17:18:22.869165] [INFO ] [REMOTE ] AR: Full fetch complete (77548 records). [2025-10-13T17:18:22.869281] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-13T17:18:23.269351] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-13T17:18:23.269890] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-13T17:18:23.270726] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-13T17:18:23.270790] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-13T17:18:23.272399] [DEBUG] [LOCAL ] AR: Trimmed 77548 records to 53587 (keeping 200 days of data) [2025-10-13T17:18:23.371203] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T17:18:23.376108] [INFO ] [REMOTE ] ARDC: Full fetch complete (21183 records). [2025-10-13T17:18:23.376498] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-13T17:18:23.377844] [FATAL] [VALIDATOR ] ARDC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:18:23.378724] [FATAL] [MAIN ] ARDC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:18:23.378828] [WARN ] [MAIN ] ARDC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:18:23.381518] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-13T17:18:23.382154] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-13T17:18:23.382501] [INFO ] [LOCAL ] ARDC: Starting deletion of derivative data. [2025-10-13T17:18:23.383129] [DEBUG] [LOCAL ] ARDC: Deleted derivative data file. [2025-10-13T17:18:23.383230] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 29.2s. Estimated remaining: 4h 54m 22s. Rate: 7.6 symbols/min [2025-10-13T17:18:23.565769] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:23.627611] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-13T17:18:23.718169] [DEBUG] [LOCAL ] ARE: Loaded 51530 existing records from primary storage. [2025-10-13T17:18:23.719482] [INFO ] [MAIN ] ARE: Loaded 51530 existing records. [2025-10-13T17:18:23.971453] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:18:23.972887] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-13T17:18:23.973280] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-13T17:18:23.975757] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-13T17:18:23.976468] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-13T17:18:24.107289] [DEBUG] [LOCAL ] AR: Primary data saved (53587 records). [2025-10-13T17:18:24.113388] [INFO ] [MAIN ] AR: Full history saved. [2025-10-13T17:18:24.129856] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. AR took 41.7s. Estimated remaining: 4h 52m 20s. Rate: 7.6 symbols/min [2025-10-13T17:18:24.361612] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T17:18:24.459840] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-13T17:18:24.577706] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:24.605894] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:24.653923] [DEBUG] [LOCAL ] ARES: Loaded 50417 existing records from primary storage. [2025-10-13T17:18:24.654219] [INFO ] [MAIN ] ARES: Loaded 50417 existing records. [2025-10-13T17:18:24.837359] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:18:24.837600] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-13T17:18:24.837677] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-13T17:18:24.838168] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-13T17:18:24.838224] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-13T17:18:25.184957] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:25.217908] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-13T17:18:25.329766] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:18:25.470851] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T17:18:26.017916] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-13T17:18:26.752198] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T17:18:26.817916] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-13T17:18:27.617909] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-13T17:18:27.871974] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T17:18:28.337869] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:18:28.417925] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-13T17:18:29.091784] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T17:18:29.096892] [INFO ] [REMOTE ] ARCO: Full fetch complete (64828 records). [2025-10-13T17:18:29.096999] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-13T17:18:29.097626] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:18:29.097734] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:18:29.097777] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:18:29.097816] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-13T17:18:29.097871] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-13T17:18:29.097907] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-13T17:18:29.097946] [DEBUG] [LOCAL ] ARCO: No derivative data file found to delete. [2025-10-13T17:18:29.098574] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARCO took 42.2s. Estimated remaining: 4h 51m 26s. Rate: 7.7 symbols/min [2025-10-13T17:18:29.223088] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-13T17:18:29.271005] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:29.316956] [DEBUG] [LOCAL ] ARI: Loaded 44298 existing records from primary storage. [2025-10-13T17:18:29.317251] [INFO ] [MAIN ] ARI: Loaded 44298 existing records. [2025-10-13T17:18:29.495265] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:18:29.495524] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-13T17:18:29.495573] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-13T17:18:29.495897] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-13T17:18:29.495956] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-13T17:18:29.842289] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:29.994359] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T17:18:30.017889] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-13T17:18:30.817914] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-13T17:18:30.862710] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T17:18:31.617923] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-13T17:18:31.828342] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:18:32.256092] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T17:18:32.417960] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-13T17:18:32.888943] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T17:18:33.217971] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-13T17:18:33.676069] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:18:33.679573] [INFO ] [REMOTE ] ARDT: Full fetch complete (41556 records). [2025-10-13T17:18:33.679678] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-13T17:18:34.023131] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-13T17:18:34.080335] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-13T17:18:34.080453] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-13T17:18:34.081128] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-13T17:18:34.081195] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-13T17:18:34.082637] [DEBUG] [LOCAL ] ARDT: Trimmed 41556 records to 27696 (keeping 200 days of data) [2025-10-13T17:18:34.266269] [DEBUG] [LOCAL ] ARDT: Primary data saved (27696 records). [2025-10-13T17:18:34.266474] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-13T17:18:34.266582] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARDT took 33.4s. Estimated remaining: 4h 50m 36s. Rate: 7.7 symbols/min [2025-10-13T17:18:34.465206] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:34.508825] [DEBUG] [LOCAL ] ARIS: Loaded 43096 existing records from primary storage. [2025-10-13T17:18:34.509256] [INFO ] [MAIN ] ARIS: Loaded 43096 existing records. [2025-10-13T17:18:34.707426] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:18:34.707970] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-13T17:18:34.708166] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-13T17:18:34.708521] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-13T17:18:34.708609] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-13T17:18:34.818749] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-13T17:18:35.114745] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:35.120259] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T17:18:35.335681] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T17:18:35.617969] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-13T17:18:36.308167] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T17:18:36.417924] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-13T17:18:37.138557] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T17:18:37.217905] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-13T17:18:38.017897] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-13T17:18:38.567871] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-13T17:18:38.714469] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:18:38.817880] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-13T17:18:39.419003] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T17:18:39.617919] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-13T17:18:40.417904] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-13T17:18:40.506997] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:18:41.225479] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-13T17:18:41.228567] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T17:18:42.017888] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-13T17:18:42.062252] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T17:18:42.817901] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-13T17:18:42.909071] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T17:18:43.617937] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-13T17:18:43.680894] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T17:18:44.099434] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T17:18:44.417972] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-13T17:18:45.217933] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-13T17:18:46.017973] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-13T17:18:46.109341] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-13T17:18:46.356875] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T17:18:46.817961] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-13T17:18:47.617953] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-13T17:18:47.929909] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-13T17:18:48.249079] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T17:18:48.418033] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-13T17:18:48.931771] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (2.91 seconds). [2025-10-13T17:18:49.217940] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-13T17:18:49.650752] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-13T17:18:49.959510] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T17:18:50.017889] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-13T17:18:50.817971] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-13T17:18:51.618024] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-13T17:18:51.741452] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T17:18:52.045930] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-13T17:18:52.367328] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T17:18:52.417924] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-13T17:18:53.183986] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T17:18:53.217928] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-13T17:18:54.022334] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-13T17:18:54.029152] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T17:18:54.572619] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T17:18:54.817906] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-13T17:18:55.424553] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T17:18:55.433380] [INFO ] [REMOTE ] ARES: Full fetch complete (70989 records). [2025-10-13T17:18:55.433722] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-13T17:18:55.623601] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-13T17:18:55.884544] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-13T17:18:55.884720] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-13T17:18:55.885565] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-13T17:18:55.885722] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-13T17:18:55.887342] [DEBUG] [LOCAL ] ARES: Trimmed 70989 records to 49688 (keeping 200 days of data) [2025-10-13T17:18:56.021396] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T17:18:56.247609] [DEBUG] [LOCAL ] ARES: Primary data saved (49688 records). [2025-10-13T17:18:56.247784] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-13T17:18:56.247905] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 32.1s. Estimated remaining: 4h 54m 9s. Rate: 7.6 symbols/min [2025-10-13T17:18:56.425768] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-13T17:18:56.428954] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:18:56.429851] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-13T17:18:56.429901] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-13T17:18:56.430019] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-13T17:18:56.430062] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-13T17:18:56.430103] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-13T17:18:56.430140] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-13T17:18:56.838745] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:18:56.915753] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-13T17:18:57.217925] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-13T17:18:57.978848] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T17:18:58.017893] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-13T17:18:58.515006] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T17:18:58.817969] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-13T17:18:59.269103] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T17:18:59.618004] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-13T17:19:00.417953] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-13T17:19:00.496043] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T17:19:01.219637] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-13T17:19:01.222457] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T17:19:01.907091] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T17:19:01.912312] [INFO ] [REMOTE ] ARI: Full fetch complete (62487 records). [2025-10-13T17:19:01.912550] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-13T17:19:02.023117] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-13T17:19:02.333098] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-13T17:19:02.333226] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-13T17:19:02.334037] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-13T17:19:02.334107] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-13T17:19:02.335978] [DEBUG] [LOCAL ] ARI: Trimmed 62487 records to 43711 (keeping 200 days of data) [2025-10-13T17:19:02.625940] [DEBUG] [LOCAL ] ARI: Primary data saved (43711 records). [2025-10-13T17:19:02.626121] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-13T17:19:02.627024] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARI took 33.5s. Estimated remaining: 4h 53m 37s. Rate: 7.6 symbols/min [2025-10-13T17:19:02.814614] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:02.817961] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-13T17:19:02.873636] [DEBUG] [LOCAL ] ARMK: Loaded 51094 existing records from primary storage. [2025-10-13T17:19:02.874090] [INFO ] [MAIN ] ARMK: Loaded 51094 existing records. [2025-10-13T17:19:03.020156] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:19:03.108494] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:03.108793] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-13T17:19:03.108849] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-13T17:19:03.109373] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-13T17:19:03.109434] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-13T17:19:03.476709] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:03.617932] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-13T17:19:03.775270] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T17:19:04.130612] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T17:19:04.417947] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-13T17:19:05.079201] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T17:19:05.084799] [INFO ] [REMOTE ] ARIS: Full fetch complete (61350 records). [2025-10-13T17:19:05.084904] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-13T17:19:05.223046] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-13T17:19:05.496311] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-10-13T17:19:05.496395] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-10-13T17:19:05.497060] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-10-13T17:19:05.497122] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-10-13T17:19:05.498538] [DEBUG] [LOCAL ] ARIS: Trimmed 61350 records to 42525 (keeping 200 days of data) [2025-10-13T17:19:05.755875] [DEBUG] [LOCAL ] ARIS: Primary data saved (42525 records). [2025-10-13T17:19:05.756009] [INFO ] [MAIN ] ARIS: Full history saved. [2025-10-13T17:19:05.756089] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARIS took 31.5s. Estimated remaining: 4h 52m 16s. Rate: 7.6 symbols/min [2025-10-13T17:19:05.922747] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:05.967558] [DEBUG] [LOCAL ] AROC: Loaded 49688 existing records from primary storage. [2025-10-13T17:19:05.967917] [INFO ] [MAIN ] AROC: Loaded 49688 existing records. [2025-10-13T17:19:06.029565] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-13T17:19:06.194193] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:06.196495] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T17:19:06.196698] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-13T17:19:06.206040] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-13T17:19:06.207096] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-13T17:19:06.207161] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-13T17:19:06.722981] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:06.817977] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-13T17:19:07.039369] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T17:19:07.045730] [INFO ] [REMOTE ] ARE: Full fetch complete (72746 records). [2025-10-13T17:19:07.045932] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-13T17:19:07.601755] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-13T17:19:07.601892] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-13T17:19:07.602741] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-13T17:19:07.602808] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-13T17:19:07.604513] [DEBUG] [LOCAL ] ARE: Trimmed 72746 records to 50891 (keeping 200 days of data) [2025-10-13T17:19:07.663687] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-13T17:19:07.877809] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T17:19:07.982065] [DEBUG] [LOCAL ] ARE: Primary data saved (50891 records). [2025-10-13T17:19:07.982206] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-13T17:19:07.982295] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARE took 44.6s. Estimated remaining: 4h 50m 42s. Rate: 7.7 symbols/min [2025-10-13T17:19:08.158832] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:08.207624] [DEBUG] [LOCAL ] ARR: Loaded 52847 existing records from primary storage. [2025-10-13T17:19:08.207966] [INFO ] [MAIN ] ARR: Loaded 52847 existing records. [2025-10-13T17:19:08.386008] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:08.386320] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-13T17:19:08.386382] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-13T17:19:08.395053] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-13T17:19:08.409247] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-13T17:19:08.423236] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-13T17:19:08.484298] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T17:19:08.774929] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:09.217981] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-13T17:19:10.000260] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-13T17:19:10.017911] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-13T17:19:10.084927] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T17:19:10.791665] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T17:19:10.817911] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-13T17:19:11.578453] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T17:19:11.617879] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-13T17:19:11.908964] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T17:19:12.417982] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-13T17:19:13.177845] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:19:13.217933] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-13T17:19:14.017987] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-13T17:19:14.626203] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T17:19:14.774865] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-13T17:19:14.817885] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-13T17:19:15.587553] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:19:15.617935] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-13T17:19:16.417931] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-13T17:19:16.512032] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:19:17.219377] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-13T17:19:17.225108] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T17:19:17.944855] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:19:18.017893] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-13T17:19:18.762005] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T17:19:18.817992] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-13T17:19:19.551841] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:19:19.617946] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-13T17:19:20.417913] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-13T17:19:20.573886] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T17:19:20.967064] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T17:19:21.217942] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-13T17:19:22.017962] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-13T17:19:22.387024] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T17:19:22.608083] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:19:22.817917] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-13T17:19:23.474612] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T17:19:23.617928] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-13T17:19:24.016522] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T17:19:24.021585] [INFO ] [REMOTE ] ARLO: Full fetch complete (62905 records). [2025-10-13T17:19:24.021772] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-13T17:19:24.425048] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-13T17:19:24.427092] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-13T17:19:24.427207] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-13T17:19:24.428220] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-13T17:19:24.428421] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-13T17:19:24.430150] [DEBUG] [LOCAL ] ARLO: Trimmed 62905 records to 43759 (keeping 200 days of data) [2025-10-13T17:19:24.706830] [DEBUG] [LOCAL ] ARLO: Primary data saved (43759 records). [2025-10-13T17:19:24.707056] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-13T17:19:24.707165] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARLO took 28.5s. Estimated remaining: 4h 52m 48s. Rate: 7.6 symbols/min [2025-10-13T17:19:24.886951] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:24.930155] [DEBUG] [LOCAL ] ARW: Loaded 33344 existing records from primary storage. [2025-10-13T17:19:24.930535] [INFO ] [MAIN ] ARW: Loaded 33344 existing records. [2025-10-13T17:19:25.134375] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:25.134942] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-13T17:19:25.135117] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-13T17:19:25.135564] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-13T17:19:25.135635] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-13T17:19:25.228814] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-13T17:19:25.476023] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T17:19:25.588707] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:26.017980] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-13T17:19:26.049017] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T17:19:26.818012] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-13T17:19:27.188129] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:19:27.617977] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-13T17:19:27.672213] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T17:19:28.026147] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T17:19:28.417956] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-13T17:19:29.088195] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T17:19:29.217973] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-13T17:19:29.733001] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T17:19:30.017993] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-13T17:19:30.800690] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T17:19:30.817880] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-13T17:19:31.378545] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:19:31.617978] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-13T17:19:32.284566] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T17:19:32.417939] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-13T17:19:33.217903] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-13T17:19:33.451112] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T17:19:33.565745] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T17:19:34.017946] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-13T17:19:34.753385] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T17:19:34.759010] [INFO ] [REMOTE ] AROC: Full fetch complete (71009 records). [2025-10-13T17:19:34.759221] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-13T17:19:34.825275] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-13T17:19:35.160948] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-13T17:19:35.161048] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-13T17:19:35.161857] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-13T17:19:35.161922] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-13T17:19:35.163674] [DEBUG] [LOCAL ] AROC: Trimmed 71009 records to 48999 (keeping 200 days of data) [2025-10-13T17:19:35.479019] [DEBUG] [LOCAL ] AROC: Primary data saved (48999 records). [2025-10-13T17:19:35.479232] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-13T17:19:35.479344] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. AROC took 29.7s. Estimated remaining: 4h 53m 24s. Rate: 7.6 symbols/min [2025-10-13T17:19:35.618379] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-13T17:19:35.667636] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:35.668136] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-13T17:19:35.668221] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-13T17:19:35.668347] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-13T17:19:35.668392] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-13T17:19:35.668435] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-13T17:19:35.668470] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-13T17:19:35.975029] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T17:19:36.127089] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:36.417991] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-13T17:19:36.640283] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:19:36.640855] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-13T17:19:36.640975] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:19:36.641045] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-13T17:19:36.641116] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:19:36.641204] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-13T17:19:36.641307] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-13T17:19:36.641354] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-13T17:19:36.641397] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-13T17:19:36.641450] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. ARX took 1.2s. Estimated remaining: 4h 51m 35s. Rate: 7.6 symbols/min [2025-10-13T17:19:36.816614] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:36.817987] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-10-13T17:19:36.818089] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-10-13T17:19:36.818278] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-13T17:19:36.818503] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-13T17:19:36.818583] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-10-13T17:19:36.818766] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-13T17:19:36.971522] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-13T17:19:37.223073] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-13T17:19:37.257121] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:37.301730] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T17:19:38.017925] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-13T17:19:38.817973] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-13T17:19:39.213379] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-13T17:19:39.617952] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-13T17:19:39.817983] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T17:19:40.417971] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-13T17:19:40.477288] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T17:19:41.217978] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-13T17:19:41.610501] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T17:19:41.828293] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T17:19:42.017961] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-13T17:19:42.659833] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:19:42.665364] [INFO ] [REMOTE ] ARMK: Full fetch complete (72699 records). [2025-10-13T17:19:42.665480] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-13T17:19:42.823084] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-13T17:19:43.076402] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-13T17:19:43.076520] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-13T17:19:43.077351] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-13T17:19:43.077421] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-13T17:19:43.079504] [DEBUG] [LOCAL ] ARMK: Trimmed 72699 records to 50343 (keeping 200 days of data) [2025-10-13T17:19:43.420553] [DEBUG] [LOCAL ] ARMK: Primary data saved (50343 records). [2025-10-13T17:19:43.421056] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-13T17:19:43.421164] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARMK took 40.8s. Estimated remaining: 4h 51m 11s. Rate: 7.6 symbols/min [2025-10-13T17:19:43.567667] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:19:43.630307] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-13T17:19:43.637549] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:43.655770] [DEBUG] [LOCAL ] ASA: Loaded 15035 existing records from primary storage. [2025-10-13T17:19:43.656046] [INFO ] [MAIN ] ASA: Loaded 15035 existing records. [2025-10-13T17:19:43.836470] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:43.836826] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-13T17:19:43.836925] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-13T17:19:43.837325] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-13T17:19:43.837402] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-13T17:19:44.232202] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:44.417903] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-13T17:19:44.888473] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-13T17:19:45.134209] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T17:19:45.217921] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-13T17:19:45.328004] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T17:19:46.017942] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-13T17:19:46.325016] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T17:19:46.817964] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-13T17:19:47.618132] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T17:19:47.618272] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-13T17:19:47.785732] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T17:19:48.417957] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-13T17:19:48.972422] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T17:19:49.162322] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T17:19:49.217924] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-13T17:19:49.972169] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T17:19:50.017908] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-13T17:19:50.817935] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-13T17:19:51.617973] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-13T17:19:51.756160] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T17:19:52.417944] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-13T17:19:52.431365] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:19:52.461863] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T17:19:52.467530] [INFO ] [REMOTE ] ARR: Full fetch complete (75281 records). [2025-10-13T17:19:52.467731] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-13T17:19:52.857440] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-13T17:19:52.857792] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-13T17:19:52.858600] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-13T17:19:52.858704] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-13T17:19:52.861929] [DEBUG] [LOCAL ] ARR: Trimmed 75281 records to 52091 (keeping 200 days of data) [2025-10-13T17:19:53.174054] [DEBUG] [LOCAL ] ARR: Primary data saved (52091 records). [2025-10-13T17:19:53.174190] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-13T17:19:53.174268] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ARR took 45.2s. Estimated remaining: 4h 51m 31s. Rate: 7.6 symbols/min [2025-10-13T17:19:53.228211] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-13T17:19:53.345627] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:19:53.402267] [DEBUG] [LOCAL ] ASAN: Loaded 53501 existing records from primary storage. [2025-10-13T17:19:53.402566] [INFO ] [MAIN ] ASAN: Loaded 53501 existing records. [2025-10-13T17:19:53.581082] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:19:53.581309] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-13T17:19:53.581365] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-13T17:19:53.581951] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-13T17:19:53.582017] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-13T17:19:53.935632] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:19:53.959659] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T17:19:54.018006] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-13T17:19:54.106429] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T17:19:54.817945] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-13T17:19:55.617970] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-13T17:19:56.144796] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-13T17:19:56.237239] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T17:19:56.290975] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T17:19:56.417931] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-13T17:19:57.173284] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T17:19:57.217890] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-13T17:19:57.942259] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T17:19:58.017938] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-13T17:19:58.817960] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-13T17:19:59.065596] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T17:19:59.617942] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-13T17:20:00.424896] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-13T17:20:00.434052] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T17:20:01.030445] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T17:20:01.034626] [INFO ] [REMOTE ] ARW: Full fetch complete (48124 records). [2025-10-13T17:20:01.034832] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-13T17:20:01.228271] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-13T17:20:01.469960] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-13T17:20:01.470076] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-13T17:20:01.470732] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-13T17:20:01.470804] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-13T17:20:01.472403] [DEBUG] [LOCAL ] ARW: Trimmed 48124 records to 33011 (keeping 200 days of data) [2025-10-13T17:20:01.696340] [DEBUG] [LOCAL ] ARW: Primary data saved (33011 records). [2025-10-13T17:20:01.696555] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-13T17:20:01.697821] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. ARW took 37.0s. Estimated remaining: 4h 51m 32s. Rate: 7.6 symbols/min [2025-10-13T17:20:01.902903] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:20:01.962021] [DEBUG] [LOCAL ] ASB: Loaded 50308 existing records from primary storage. [2025-10-13T17:20:01.962503] [INFO ] [MAIN ] ASB: Loaded 50308 existing records. [2025-10-13T17:20:02.018705] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-13T17:20:02.173844] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:20:02.174218] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-13T17:20:02.174275] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-13T17:20:02.174755] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-13T17:20:02.174815] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-13T17:20:02.650931] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-13T17:20:02.655671] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:20:02.817956] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-13T17:20:02.940453] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T17:20:03.129995] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T17:20:03.133071] [INFO ] [REMOTE ] ASA: Full fetch complete (19744 records). [2025-10-13T17:20:03.133185] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-13T17:20:03.544482] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-13T17:20:03.544594] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-13T17:20:03.544972] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-13T17:20:03.545036] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-13T17:20:03.546080] [DEBUG] [LOCAL ] ASA: Trimmed 19744 records to 14963 (keeping 200 days of data) [2025-10-13T17:20:03.618039] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-13T17:20:03.642373] [DEBUG] [LOCAL ] ASA: Primary data saved (14963 records). [2025-10-13T17:20:03.642613] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-13T17:20:03.642748] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ASA took 20.2s. Estimated remaining: 4h 49m 58s. Rate: 7.6 symbols/min [2025-10-13T17:20:03.834415] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:20:03.840352] [DEBUG] [LOCAL ] ASBA: Loaded 3495 existing records from primary storage. [2025-10-13T17:20:03.840593] [INFO ] [MAIN ] ASBA: Loaded 3495 existing records. [2025-10-13T17:20:04.038889] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:20:04.039249] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-13T17:20:04.039306] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-13T17:20:04.039490] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-13T17:20:04.039528] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-13T17:20:04.423309] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-13T17:20:04.459822] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:20:04.641330] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T17:20:05.217894] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-13T17:20:05.327128] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T17:20:06.009579] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T17:20:06.020242] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-13T17:20:06.817989] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-13T17:20:06.862975] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:20:07.617897] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-13T17:20:07.892868] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T17:20:08.417902] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-13T17:20:08.500996] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T17:20:09.027913] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T17:20:09.217951] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-13T17:20:10.017950] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-13T17:20:10.253231] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:20:10.817900] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-13T17:20:10.887461] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T17:20:11.617929] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-13T17:20:11.757450] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:20:12.285442] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T17:20:12.417962] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-13T17:20:12.735124] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T17:20:13.217939] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-13T17:20:13.924991] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:20:14.017981] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-13T17:20:14.817960] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-13T17:20:15.096048] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T17:20:15.102815] [INFO ] [REMOTE ] AS: Full fetch complete (76583 records). [2025-10-13T17:20:15.103026] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-13T17:20:15.444445] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-13T17:20:15.528129] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-13T17:20:15.528327] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-13T17:20:15.529218] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-13T17:20:15.529436] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-13T17:20:15.558778] [DEBUG] [LOCAL ] AS: Trimmed 76583 records to 53163 (keeping 200 days of data) [2025-10-13T17:20:15.561063] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T17:20:15.622336] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-13T17:20:15.879337] [DEBUG] [LOCAL ] AS: Primary data saved (53163 records). [2025-10-13T17:20:15.879476] [INFO ] [MAIN ] AS: Full history saved. [2025-10-13T17:20:15.879546] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. AS took 39.2s. Estimated remaining: 4h 50m 54s. Rate: 7.6 symbols/min [2025-10-13T17:20:16.050932] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:20:16.089968] [DEBUG] [LOCAL ] ASC: Loaded 37942 existing records from primary storage. [2025-10-13T17:20:16.090311] [INFO ] [MAIN ] ASC: Loaded 37942 existing records. [2025-10-13T17:20:16.265344] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:20:16.265553] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-13T17:20:16.265599] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-13T17:20:16.266026] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-13T17:20:16.266078] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-13T17:20:16.426728] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-13T17:20:16.624281] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:20:17.087380] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:20:17.217936] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-13T17:20:17.512855] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T17:20:18.017991] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-13T17:20:18.817975] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-13T17:20:18.914828] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T17:20:19.596222] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-13T17:20:19.617896] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-13T17:20:20.417952] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-13T17:20:20.894393] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T17:20:20.898394] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-13T17:20:21.207122] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T17:20:21.217881] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-13T17:20:22.017923] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-13T17:20:22.731120] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T17:20:22.817887] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-13T17:20:23.592472] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:20:23.617899] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-13T17:20:24.320584] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T17:20:24.417975] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-13T17:20:25.137521] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:20:25.217948] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-13T17:20:25.832506] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T17:20:26.017996] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-13T17:20:26.464949] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T17:20:26.619841] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:20:26.817902] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-13T17:20:27.370352] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-13T17:20:27.617947] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-13T17:20:28.418020] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-13T17:20:28.985936] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T17:20:29.154715] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T17:20:29.160899] [INFO ] [REMOTE ] ASB: Full fetch complete (71772 records). [2025-10-13T17:20:29.161067] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-13T17:20:29.228252] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-13T17:20:29.582051] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-13T17:20:29.582188] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-13T17:20:29.583075] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-13T17:20:29.583140] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-13T17:20:29.585026] [DEBUG] [LOCAL ] ASB: Trimmed 71772 records to 49582 (keeping 200 days of data) [2025-10-13T17:20:29.784099] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T17:20:29.907874] [DEBUG] [LOCAL ] ASB: Primary data saved (49582 records). [2025-10-13T17:20:29.908077] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-13T17:20:29.908848] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASB took 28.2s. Estimated remaining: 4h 52m 14s. Rate: 7.6 symbols/min [2025-10-13T17:20:30.023104] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-13T17:20:30.091709] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:20:30.113834] [DEBUG] [LOCAL ] ASG: Loaded 19812 existing records from primary storage. [2025-10-13T17:20:30.114171] [INFO ] [MAIN ] ASG: Loaded 19812 existing records. [2025-10-13T17:20:30.300764] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:20:30.301076] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-13T17:20:30.301130] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-13T17:20:30.301421] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-13T17:20:30.301480] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-13T17:20:30.416984] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-13T17:20:30.676323] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:20:30.817935] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-13T17:20:31.380906] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T17:20:31.381832] [INFO ] [REMOTE ] ASBA: Full fetch complete (5214 records). [2025-10-13T17:20:31.381901] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-13T17:20:31.623196] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-13T17:20:31.735597] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-13T17:20:31.735690] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-13T17:20:31.735851] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-13T17:20:31.735891] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-13T17:20:31.736236] [DEBUG] [LOCAL ] ASBA: Trimmed 5214 records to 3450 (keeping 200 days of data) [2025-10-13T17:20:31.757694] [DEBUG] [LOCAL ] ASBA: Primary data saved (3450 records). [2025-10-13T17:20:31.757769] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-13T17:20:31.757838] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASBA took 28.1s. Estimated remaining: 4h 50m 40s. Rate: 7.6 symbols/min [2025-10-13T17:20:31.925745] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:20:31.949194] [DEBUG] [LOCAL ] ASGI: Loaded 23095 existing records from primary storage. [2025-10-13T17:20:31.949426] [INFO ] [MAIN ] ASGI: Loaded 23095 existing records. [2025-10-13T17:20:32.122281] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:20:32.122530] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-13T17:20:32.122600] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-13T17:20:32.122940] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-13T17:20:32.123020] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-13T17:20:32.423137] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-13T17:20:32.475899] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:20:32.655574] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:20:33.217937] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-13T17:20:33.605864] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-13T17:20:34.017898] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-13T17:20:34.279991] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T17:20:34.817998] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-13T17:20:35.494719] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:20:35.617931] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-13T17:20:35.811244] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T17:20:36.417939] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-13T17:20:36.820282] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T17:20:37.217964] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-13T17:20:38.017921] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-13T17:20:38.279260] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T17:20:38.447388] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T17:20:38.818024] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-13T17:20:39.043094] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T17:20:39.617900] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-13T17:20:39.707978] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T17:20:40.417960] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-13T17:20:41.217951] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-13T17:20:41.443339] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:20:41.492106] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T17:20:42.017942] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-13T17:20:42.376945] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:20:42.817984] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-13T17:20:43.617990] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-13T17:20:43.690675] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T17:20:43.696126] [INFO ] [REMOTE ] ASAN: Full fetch complete (76525 records). [2025-10-13T17:20:43.696251] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-13T17:20:44.095173] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-13T17:20:44.095313] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-13T17:20:44.096145] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-13T17:20:44.096227] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-13T17:20:44.097841] [DEBUG] [LOCAL ] ASAN: Trimmed 76525 records to 52724 (keeping 200 days of data) [2025-10-13T17:20:44.418791] [DEBUG] [LOCAL ] ASAN: Primary data saved (52724 records). [2025-10-13T17:20:44.418639] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-13T17:20:44.419200] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-13T17:20:44.438619] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASAN took 51.3s. Estimated remaining: 4h 51m 40s. Rate: 7.6 symbols/min [2025-10-13T17:20:44.443488] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T17:20:44.535663] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T17:20:45.217981] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-13T17:20:45.633095] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T17:20:46.017922] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-13T17:20:46.242804] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T17:20:46.817898] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-13T17:20:46.874393] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T17:20:47.617899] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-13T17:20:47.865453] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T17:20:48.417921] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-13T17:20:48.609384] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T17:20:49.217939] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-13T17:20:49.412393] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T17:20:50.017910] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-13T17:20:50.321199] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T17:20:50.817969] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-13T17:20:51.166728] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T17:20:51.617917] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-13T17:20:51.720550] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T17:20:51.722789] [INFO ] [REMOTE ] ASG: Full fetch complete (30895 records). [2025-10-13T17:20:51.722905] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-13T17:20:52.167893] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-13T17:20:52.167992] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-13T17:20:52.168500] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-13T17:20:52.168564] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-13T17:20:52.169520] [DEBUG] [LOCAL ] ASG: Trimmed 30895 records to 19522 (keeping 200 days of data) [2025-10-13T17:20:52.288744] [DEBUG] [LOCAL ] ASG: Primary data saved (19522 records). [2025-10-13T17:20:52.289025] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-13T17:20:52.289200] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASG took 22.4s. Estimated remaining: 4h 51m 31s. Rate: 7.6 symbols/min [2025-10-13T17:20:52.417934] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-13T17:20:52.991345] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T17:20:53.217932] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-13T17:20:53.568181] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T17:20:54.017913] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-13T17:20:54.603230] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T17:20:54.609582] [INFO ] [REMOTE ] ASC: Full fetch complete (56212 records). [2025-10-13T17:20:54.609894] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-13T17:20:55.136950] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T17:20:55.182978] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-13T17:20:55.231378] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-13T17:20:55.231483] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-13T17:20:55.232105] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-13T17:20:55.232169] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-13T17:20:55.233426] [DEBUG] [LOCAL ] ASC: Trimmed 56212 records to 37351 (keeping 200 days of data) [2025-10-13T17:20:55.463086] [DEBUG] [LOCAL ] ASC: Primary data saved (37351 records). [2025-10-13T17:20:55.463283] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-13T17:20:55.463393] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASC took 39.6s. Estimated remaining: 4h 50m 17s. Rate: 7.6 symbols/min [2025-10-13T17:20:56.346047] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T17:20:56.351797] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-13T17:20:57.431230] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T17:20:57.436637] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-13T17:20:58.440225] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T17:20:58.446784] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-13T17:20:59.588286] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:20:59.591001] [INFO ] [REMOTE ] ASGI: Full fetch complete (33306 records). [2025-10-13T17:20:59.591078] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-13T17:20:59.951554] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-13T17:20:59.951630] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-13T17:20:59.952060] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-13T17:20:59.952112] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-13T17:20:59.952906] [DEBUG] [LOCAL ] ASGI: Trimmed 33306 records to 22835 (keeping 200 days of data) [2025-10-13T17:21:00.092282] [DEBUG] [LOCAL ] ASGI: Primary data saved (22835 records). [2025-10-13T17:21:00.092402] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-13T17:21:00.092480] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGI took 28.3s. Estimated remaining: 4h 49m 25s. Rate: 7.6 symbols/min [2025-10-13T17:21:00.772940] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:00.738931] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:00.821452] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:00.818453] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:00.845815] [DEBUG] [LOCAL ] ASIX: Loaded 23212 existing records from primary storage. [2025-10-13T17:21:00.846165] [INFO ] [MAIN ] ASIX: Loaded 23212 existing records. [2025-10-13T17:21:01.001624] [DEBUG] [LOCAL ] ASGN: Loaded 36896 existing records from primary storage. [2025-10-13T17:21:01.013140] [DEBUG] [LOCAL ] ASH: Loaded 38182 existing records from primary storage. [2025-10-13T17:21:01.013311] [INFO ] [MAIN ] ASGN: Loaded 36896 existing records. [2025-10-13T17:21:01.049349] [INFO ] [MAIN ] ASH: Loaded 38182 existing records. [2025-10-13T17:21:01.216904] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:01.268930] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-13T17:21:01.283015] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-13T17:21:01.294418] [DEBUG] [LOCAL ] ASPN: Loaded 50499 existing records from primary storage. [2025-10-13T17:21:01.299872] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-13T17:21:01.335811] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-13T17:21:01.354397] [INFO ] [MAIN ] ASPN: Loaded 50499 existing records. [2025-10-13T17:21:01.604611] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:01.644425] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:01.668886] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-13T17:21:01.669130] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-13T17:21:01.697203] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-13T17:21:01.728509] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-13T17:21:01.751722] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-13T17:21:01.778087] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-13T17:21:01.787074] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:01.787188] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-13T17:21:01.787349] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-13T17:21:01.798355] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-13T17:21:01.818349] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-13T17:21:01.939856] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-13T17:21:02.067783] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-13T17:21:02.706051] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:02.745360] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-13T17:21:03.038424] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:03.074450] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-13T17:21:03.068899] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:03.081066] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-13T17:21:03.178035] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:03.178408] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-13T17:21:03.958862] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T17:21:03.962426] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-13T17:21:04.241697] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:21:04.250096] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-13T17:21:04.496706] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T17:21:04.505455] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-13T17:21:04.621744] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-13T17:21:04.625980] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-13T17:21:04.832906] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T17:21:04.843269] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-13T17:21:05.247818] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T17:21:05.251605] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-13T17:21:05.546725] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T17:21:05.576126] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T17:21:06.017915] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-13T17:21:06.327470] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T17:21:06.749292] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T17:21:06.817928] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-13T17:21:07.559141] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T17:21:07.617929] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-13T17:21:08.417932] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-13T17:21:08.623419] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T17:21:08.895701] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:21:09.217905] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-13T17:21:09.474813] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T17:21:10.017949] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-13T17:21:10.477784] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T17:21:10.818004] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-13T17:21:11.617962] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-13T17:21:11.744286] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T17:21:11.886143] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T17:21:12.417951] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-13T17:21:12.823627] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T17:21:13.217939] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-13T17:21:13.923432] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T17:21:14.017898] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-13T17:21:14.817918] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-13T17:21:14.972217] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T17:21:15.376201] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T17:21:15.617985] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-13T17:21:16.099574] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:21:16.417933] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-13T17:21:17.217962] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-13T17:21:17.495211] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T17:21:17.530758] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T17:21:18.017977] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-13T17:21:18.480149] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T17:21:18.817983] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-13T17:21:19.508464] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T17:21:19.617943] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-13T17:21:19.839993] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T17:21:20.418010] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-13T17:21:20.999709] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T17:21:21.217895] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-13T17:21:21.604532] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:21:22.017942] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-13T17:21:22.238285] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T17:21:22.817946] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-13T17:21:23.483792] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T17:21:23.617996] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-13T17:21:24.417963] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-13T17:21:25.217935] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-13T17:21:25.321361] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T17:21:25.781697] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T17:21:25.785847] [INFO ] [REMOTE ] ASH: Full fetch complete (55218 records). [2025-10-13T17:21:25.785945] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-13T17:21:26.025008] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-13T17:21:26.173206] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-13T17:21:26.173292] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-13T17:21:26.173921] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-13T17:21:26.173985] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-13T17:21:26.175194] [DEBUG] [LOCAL ] ASH: Trimmed 55218 records to 37545 (keeping 200 days of data) [2025-10-13T17:21:26.393742] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T17:21:26.426046] [DEBUG] [LOCAL ] ASH: Primary data saved (37545 records). [2025-10-13T17:21:26.426194] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-13T17:21:26.427051] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASH took 26.3s. Estimated remaining: 4h 53m 31s. Rate: 7.5 symbols/min [2025-10-13T17:21:26.600879] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:26.614393] [DEBUG] [LOCAL ] ASR: Loaded 9416 existing records from primary storage. [2025-10-13T17:21:26.614623] [INFO ] [MAIN ] ASR: Loaded 9416 existing records. [2025-10-13T17:21:26.787607] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:26.787830] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-13T17:21:26.787876] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-13T17:21:26.788060] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-13T17:21:26.788116] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-13T17:21:26.823009] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-13T17:21:27.143009] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:27.532529] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (4.71 seconds). [2025-10-13T17:21:27.617891] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-13T17:21:27.826886] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T17:21:27.914926] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T17:21:28.417913] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-13T17:21:28.796975] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T17:21:29.217953] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-13T17:21:29.267755] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T17:21:30.017935] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-13T17:21:30.602354] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T17:21:30.817899] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-13T17:21:30.880511] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T17:21:31.414295] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T17:21:31.617927] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-13T17:21:32.371138] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T17:21:32.417923] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-13T17:21:33.217994] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-13T17:21:33.857377] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T17:21:34.018005] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-13T17:21:34.817928] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-13T17:21:35.044391] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T17:21:35.047254] [INFO ] [REMOTE ] ASIX: Full fetch complete (30612 records). [2025-10-13T17:21:35.047334] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-13T17:21:35.413639] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-13T17:21:35.413760] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-13T17:21:35.414130] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-13T17:21:35.414171] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-13T17:21:35.414953] [DEBUG] [LOCAL ] ASIX: Trimmed 30612 records to 22959 (keeping 200 days of data) [2025-10-13T17:21:35.551633] [DEBUG] [LOCAL ] ASIX: Primary data saved (22959 records). [2025-10-13T17:21:35.551780] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-13T17:21:35.551857] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 35.4s. Estimated remaining: 4h 53m 38s. Rate: 7.5 symbols/min [2025-10-13T17:21:35.629500] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-13T17:21:35.703946] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-13T17:21:35.759530] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:35.766831] [INFO ] [REMOTE ] ASPN: Full fetch complete (72448 records). [2025-10-13T17:21:35.766575] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-13T17:21:35.767163] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-13T17:21:36.203335] [DEBUG] [LOCAL ] ASX: Loaded 53634 existing records from primary storage. [2025-10-13T17:21:36.203733] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-13T17:21:36.204034] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-13T17:21:36.204236] [INFO ] [MAIN ] ASX: Loaded 53634 existing records. [2025-10-13T17:21:36.205166] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-13T17:21:36.262981] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-13T17:21:36.319230] [DEBUG] [LOCAL ] ASPN: Trimmed 72448 records to 49849 (keeping 200 days of data) [2025-10-13T17:21:36.457031] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:36.457382] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-13T17:21:36.485277] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-13T17:21:36.489416] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-13T17:21:36.491030] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-13T17:21:36.492811] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-13T17:21:37.002660] [DEBUG] [LOCAL ] ASPN: Primary data saved (49849 records). [2025-10-13T17:21:37.002982] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-13T17:21:37.014221] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASPN took 36.9s. Estimated remaining: 4h 52m 2s. Rate: 7.6 symbols/min [2025-10-13T17:21:37.182059] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:37.222892] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-13T17:21:37.280575] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:37.282453] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T17:21:37.312145] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:21:37.352819] [DEBUG] [LOCAL ] ATEN: Loaded 39300 existing records from primary storage. [2025-10-13T17:21:37.353150] [INFO ] [MAIN ] ATEN: Loaded 39300 existing records. [2025-10-13T17:21:37.524226] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:37.524462] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-13T17:21:37.524509] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-13T17:21:37.524844] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-13T17:21:37.524909] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-13T17:21:37.870714] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:38.017903] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-13T17:21:38.818045] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-13T17:21:39.086844] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T17:21:39.159421] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T17:21:39.617955] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-13T17:21:39.764734] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T17:21:40.417966] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-13T17:21:41.217943] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-13T17:21:41.435156] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T17:21:41.540572] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-13T17:21:41.545220] [INFO ] [REMOTE ] ASGN: Full fetch complete (52823 records). [2025-10-13T17:21:41.545358] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-13T17:21:41.972018] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-13T17:21:41.972115] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-13T17:21:41.972711] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-13T17:21:41.972775] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-13T17:21:41.974008] [DEBUG] [LOCAL ] ASGN: Trimmed 52823 records to 36450 (keeping 200 days of data) [2025-10-13T17:21:42.020738] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-13T17:21:42.195181] [DEBUG] [LOCAL ] ASGN: Primary data saved (36450 records). [2025-10-13T17:21:42.195357] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-13T17:21:42.195760] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASGN took 42.1s. Estimated remaining: 4h 51m 17s. Rate: 7.6 symbols/min [2025-10-13T17:21:42.385621] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:42.420401] [DEBUG] [LOCAL ] ATGE: Loaded 31480 existing records from primary storage. [2025-10-13T17:21:42.420740] [INFO ] [MAIN ] ATGE: Loaded 31480 existing records. [2025-10-13T17:21:42.609197] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:42.609583] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-13T17:21:42.610061] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-13T17:21:42.610665] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-13T17:21:42.610730] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-13T17:21:42.740724] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:21:42.823255] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-13T17:21:43.005123] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:43.617918] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-13T17:21:43.860032] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T17:21:44.348807] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:21:44.417945] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-13T17:21:45.070933] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T17:21:45.217961] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-13T17:21:46.017954] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-13T17:21:46.325506] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T17:21:46.400903] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T17:21:46.771331] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T17:21:46.817969] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-13T17:21:47.617924] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-13T17:21:48.417889] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-13T17:21:48.469841] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T17:21:49.217905] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-13T17:21:49.250526] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T17:21:49.738396] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:21:50.017938] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-13T17:21:50.817921] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-13T17:21:51.125942] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T17:21:51.200040] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-13T17:21:51.617934] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-13T17:21:52.333821] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T17:21:52.417910] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-13T17:21:52.471453] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T17:21:53.217918] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-13T17:21:53.867174] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T17:21:54.017919] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-13T17:21:54.326213] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T17:21:54.817935] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-13T17:21:55.418393] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T17:21:55.617890] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-13T17:21:55.697081] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T17:21:56.417924] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-13T17:21:57.217955] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-13T17:21:57.326037] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T17:21:57.922687] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T17:21:57.924195] [INFO ] [REMOTE ] ASR: Full fetch complete (12337 records). [2025-10-13T17:21:57.924271] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-13T17:21:58.023243] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-13T17:21:58.109744] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T17:21:58.322169] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-13T17:21:58.322245] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-13T17:21:58.322500] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-13T17:21:58.322561] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-13T17:21:58.323038] [DEBUG] [LOCAL ] ASR: Trimmed 12337 records to 9350 (keeping 200 days of data) [2025-10-13T17:21:58.381536] [DEBUG] [LOCAL ] ASR: Primary data saved (9350 records). [2025-10-13T17:21:58.381683] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-13T17:21:58.381820] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ASR took 32.0s. Estimated remaining: 4h 52m 60s. Rate: 7.5 symbols/min [2025-10-13T17:21:58.548876] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:21:58.584743] [DEBUG] [LOCAL ] ATHM: Loaded 32282 existing records from primary storage. [2025-10-13T17:21:58.585002] [INFO ] [MAIN ] ATHM: Loaded 32282 existing records. [2025-10-13T17:21:58.760393] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:21:58.760597] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-13T17:21:58.760663] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-13T17:21:58.761040] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-13T17:21:58.761097] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-13T17:21:58.823328] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-13T17:21:59.117813] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:21:59.376767] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T17:21:59.617925] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-13T17:22:00.205990] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T17:22:00.417944] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-13T17:22:01.217902] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-13T17:22:01.423999] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:22:01.775824] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T17:22:02.017946] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-13T17:22:02.817914] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-13T17:22:03.324511] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-13T17:22:03.386601] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T17:22:03.617988] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-13T17:22:04.127718] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T17:22:04.417951] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-13T17:22:05.131088] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T17:22:05.217917] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-13T17:22:06.023036] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-13T17:22:06.039578] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T17:22:06.629908] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T17:22:06.633611] [INFO ] [REMOTE ] ATEN: Full fetch complete (56793 records). [2025-10-13T17:22:06.633770] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-13T17:22:06.820406] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-13T17:22:07.034753] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-13T17:22:07.034843] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-13T17:22:07.035474] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-13T17:22:07.035519] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-13T17:22:07.037080] [DEBUG] [LOCAL ] ATEN: Trimmed 56793 records to 38519 (keeping 200 days of data) [2025-10-13T17:22:07.176729] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T17:22:07.302568] [DEBUG] [LOCAL ] ATEN: Primary data saved (38519 records). [2025-10-13T17:22:07.302744] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-13T17:22:07.303676] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATEN took 30.3s. Estimated remaining: 4h 53m 4s. Rate: 7.5 symbols/min [2025-10-13T17:22:07.469264] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:07.478605] [DEBUG] [LOCAL ] ATHS: Loaded 6841 existing records from primary storage. [2025-10-13T17:22:07.478845] [INFO ] [MAIN ] ATHS: Loaded 6841 existing records. [2025-10-13T17:22:07.628272] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-13T17:22:07.661740] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:07.661990] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-13T17:22:07.662041] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-13T17:22:07.662204] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-13T17:22:07.662263] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-13T17:22:08.032592] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:08.417986] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-13T17:22:08.677707] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T17:22:08.896871] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T17:22:09.217951] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-13T17:22:09.236633] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T17:22:10.017956] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-13T17:22:10.661389] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T17:22:10.817967] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-13T17:22:11.015284] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-13T17:22:11.021131] [INFO ] [REMOTE ] ASX: Full fetch complete (76585 records). [2025-10-13T17:22:11.021299] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-13T17:22:11.418967] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-13T17:22:11.419050] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-13T17:22:11.419810] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-13T17:22:11.419873] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-13T17:22:11.421545] [DEBUG] [LOCAL ] ASX: Trimmed 76585 records to 52872 (keeping 200 days of data) [2025-10-13T17:22:11.516032] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T17:22:11.635010] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-13T17:22:11.746559] [DEBUG] [LOCAL ] ASX: Primary data saved (52872 records). [2025-10-13T17:22:11.746733] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-13T17:22:11.746822] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ASX took 36.2s. Estimated remaining: 4h 52m 10s. Rate: 7.5 symbols/min [2025-10-13T17:22:11.923128] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:11.971508] [DEBUG] [LOCAL ] ATI: Loaded 52075 existing records from primary storage. [2025-10-13T17:22:11.971861] [INFO ] [MAIN ] ATI: Loaded 52075 existing records. [2025-10-13T17:22:12.153482] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:12.153710] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-13T17:22:12.153781] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-13T17:22:12.154251] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-13T17:22:12.154307] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-13T17:22:12.426978] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-13T17:22:12.512677] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:13.031004] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:22:13.217918] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-13T17:22:13.607557] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T17:22:13.610528] [INFO ] [REMOTE ] ATGE: Full fetch complete (45893 records). [2025-10-13T17:22:13.610602] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-13T17:22:14.001515] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-13T17:22:14.001591] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-13T17:22:14.002109] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-13T17:22:14.002172] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-13T17:22:14.003083] [DEBUG] [LOCAL ] ATGE: Trimmed 45893 records to 31039 (keeping 200 days of data) [2025-10-13T17:22:14.052045] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-13T17:22:14.189196] [DEBUG] [LOCAL ] ATGE: Primary data saved (31039 records). [2025-10-13T17:22:14.189342] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-13T17:22:14.189422] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATGE took 32.0s. Estimated remaining: 4h 50m 50s. Rate: 7.6 symbols/min [2025-10-13T17:22:14.358856] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:14.359065] [DEBUG] [LOCAL ] ATKR: No existing data file found in primary storage. [2025-10-13T17:22:14.359138] [WARN ] [MAIN ] ATKR: No existing data found, performing full refresh instead. [2025-10-13T17:22:14.359366] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-13T17:22:14.359527] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-13T17:22:14.359611] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-10-13T17:22:14.359703] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-13T17:22:14.489417] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T17:22:14.759438] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:14.755011] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T17:22:14.817890] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-13T17:22:15.617912] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-13T17:22:16.231905] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-13T17:22:16.310012] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T17:22:16.417928] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-13T17:22:17.217970] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-13T17:22:17.903023] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T17:22:17.961333] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T17:22:18.017911] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-13T17:22:18.817937] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-13T17:22:19.581016] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T17:22:19.618337] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-13T17:22:19.619896] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T17:22:20.418001] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-13T17:22:21.217932] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-13T17:22:21.351331] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T17:22:21.595261] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T17:22:21.915105] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T17:22:22.018048] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-13T17:22:22.718970] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-13T17:22:22.817965] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-13T17:22:23.617952] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-13T17:22:24.269913] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T17:22:24.359772] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T17:22:24.417925] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-13T17:22:25.217951] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-13T17:22:26.018006] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-13T17:22:26.057613] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T17:22:26.780605] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:22:26.817942] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-13T17:22:27.174305] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:22:27.617955] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-13T17:22:28.295012] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T17:22:28.309676] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T17:22:28.311004] [INFO ] [REMOTE ] ATHS: Full fetch complete (9682 records). [2025-10-13T17:22:28.311083] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-13T17:22:28.420257] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-13T17:22:28.695684] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-13T17:22:28.695797] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-13T17:22:28.696089] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-13T17:22:28.696129] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-13T17:22:28.696608] [DEBUG] [LOCAL ] ATHS: Trimmed 9682 records to 6739 (keeping 200 days of data) [2025-10-13T17:22:28.740584] [DEBUG] [LOCAL ] ATHS: Primary data saved (6739 records). [2025-10-13T17:22:28.740793] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-13T17:22:28.740900] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHS took 21.4s. Estimated remaining: 4h 52m 8s. Rate: 7.5 symbols/min [2025-10-13T17:22:28.920248] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:28.968796] [DEBUG] [LOCAL ] ATMU: Loaded 39700 existing records from primary storage. [2025-10-13T17:22:28.969228] [INFO ] [MAIN ] ATMU: Loaded 39700 existing records. [2025-10-13T17:22:29.189460] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:29.190541] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-13T17:22:29.190595] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-13T17:22:29.190881] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-13T17:22:29.190940] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-13T17:22:29.224556] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-13T17:22:29.582424] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:29.598240] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:22:30.017935] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-13T17:22:30.817949] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-13T17:22:31.011764] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:22:31.066051] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T17:22:31.617926] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-13T17:22:32.419240] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-13T17:22:32.425562] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T17:22:33.218304] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-13T17:22:33.548294] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T17:22:33.583131] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:22:34.017952] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-13T17:22:34.378536] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T17:22:34.817927] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-13T17:22:35.617901] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-13T17:22:35.699056] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T17:22:36.103579] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T17:22:36.417923] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-13T17:22:37.048473] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T17:22:37.217928] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-13T17:22:37.908598] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:22:38.017901] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-13T17:22:38.247826] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T17:22:38.818009] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-13T17:22:39.617978] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-13T17:22:39.697530] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T17:22:40.200076] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T17:22:40.418000] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-13T17:22:40.965634] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T17:22:41.217899] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-13T17:22:41.575913] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T17:22:41.579101] [INFO ] [REMOTE ] ATHM: Full fetch complete (50057 records). [2025-10-13T17:22:41.579189] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-13T17:22:41.579800] [FATAL] [VALIDATOR ] ATHM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:22:41.579887] [FATAL] [MAIN ] ATHM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:22:41.579930] [WARN ] [MAIN ] ATHM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:22:41.579993] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-13T17:22:41.580080] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-13T17:22:41.580129] [INFO ] [LOCAL ] ATHM: Starting deletion of derivative data. [2025-10-13T17:22:41.580382] [DEBUG] [LOCAL ] ATHM: Deleted derivative data file. [2025-10-13T17:22:41.581283] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATHM took 43.2s. Estimated remaining: 4h 53m 3s. Rate: 7.5 symbols/min [2025-10-13T17:22:41.747625] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:41.794189] [DEBUG] [LOCAL ] ATO: Loaded 42368 existing records from primary storage. [2025-10-13T17:22:41.794503] [INFO ] [MAIN ] ATO: Loaded 42368 existing records. [2025-10-13T17:22:41.976381] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:41.976612] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-13T17:22:41.976692] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-13T17:22:41.977169] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-13T17:22:41.977225] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-13T17:22:42.023106] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-13T17:22:42.343859] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:42.671922] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T17:22:42.817891] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-13T17:22:43.337153] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T17:22:43.617995] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-13T17:22:44.046474] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T17:22:44.417918] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-13T17:22:45.217963] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-13T17:22:45.405560] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T17:22:46.017902] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-13T17:22:46.084384] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T17:22:46.782182] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T17:22:46.817877] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-13T17:22:47.398696] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T17:22:47.617918] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-13T17:22:48.170961] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T17:22:48.174422] [INFO ] [REMOTE ] ATKR: Full fetch complete (53189 records). [2025-10-13T17:22:48.174535] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-13T17:22:48.175228] [FATAL] [VALIDATOR ] ATKR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:22:48.175318] [FATAL] [MAIN ] ATKR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:22:48.175361] [WARN ] [MAIN ] ATKR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:22:48.175408] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-13T17:22:48.175502] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-10-13T17:22:48.175552] [INFO ] [LOCAL ] ATKR: Starting deletion of derivative data. [2025-10-13T17:22:48.175689] [DEBUG] [LOCAL ] ATKR: No derivative data file found to delete. [2025-10-13T17:22:48.175788] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 34.0s. Estimated remaining: 4h 52m 37s. Rate: 7.5 symbols/min [2025-10-13T17:22:48.346192] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:48.381495] [DEBUG] [LOCAL ] ATR: Loaded 31070 existing records from primary storage. [2025-10-13T17:22:48.381796] [INFO ] [MAIN ] ATR: Loaded 31070 existing records. [2025-10-13T17:22:48.424018] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-13T17:22:48.562234] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:48.562454] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-13T17:22:48.562501] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-13T17:22:48.563181] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-13T17:22:48.563240] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-13T17:22:48.947180] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:49.186479] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T17:22:49.191685] [INFO ] [REMOTE ] ATI: Full fetch complete (73815 records). [2025-10-13T17:22:49.191812] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-13T17:22:49.224080] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-13T17:22:49.603352] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-13T17:22:49.603562] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-13T17:22:49.604802] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-13T17:22:49.605019] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-13T17:22:49.607130] [DEBUG] [LOCAL ] ATI: Trimmed 73815 records to 51366 (keeping 200 days of data) [2025-10-13T17:22:49.720500] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:22:49.954837] [DEBUG] [LOCAL ] ATI: Primary data saved (51366 records). [2025-10-13T17:22:49.955037] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-13T17:22:49.955138] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATI took 38.2s. Estimated remaining: 4h 51m 10s. Rate: 7.6 symbols/min [2025-10-13T17:22:50.023263] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-13T17:22:50.134090] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:22:50.153249] [DEBUG] [LOCAL ] ATS: Loaded 17912 existing records from primary storage. [2025-10-13T17:22:50.153678] [INFO ] [MAIN ] ATS: Loaded 17912 existing records. [2025-10-13T17:22:50.345236] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:22:50.345834] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-13T17:22:50.345953] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-13T17:22:50.352401] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-13T17:22:50.352508] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-13T17:22:50.428461] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:22:50.737829] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:22:50.817936] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-13T17:22:51.488314] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T17:22:51.617916] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-13T17:22:52.417977] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-13T17:22:53.217957] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-13T17:23:05.032271] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (11.81 seconds). [2025-10-13T17:23:05.040969] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-13T17:23:05.411497] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (13.79 seconds). [2025-10-13T17:23:05.417505] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-13T17:23:06.712802] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (15.89 seconds). [2025-10-13T17:23:06.716741] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-13T17:23:06.934692] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T17:23:06.941441] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-13T17:23:07.545389] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:23:07.550126] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-13T17:23:08.043493] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T17:23:08.050211] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-13T17:23:08.115377] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T17:23:08.120245] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-13T17:23:08.443421] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (16.03 seconds). [2025-10-13T17:23:08.451783] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-13T17:23:08.942151] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T17:23:08.948496] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-13T17:23:09.124932] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T17:23:09.129391] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-13T17:23:09.352790] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (4.31 seconds). [2025-10-13T17:23:09.361513] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-13T17:23:09.786166] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T17:23:09.795829] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-13T17:23:10.031821] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T17:23:10.037368] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-13T17:23:10.343022] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T17:23:10.350045] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-13T17:23:10.611244] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T17:23:10.620682] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-13T17:23:10.776838] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T17:23:10.781408] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-13T17:23:11.369963] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T17:23:11.379079] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-13T17:23:11.685790] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T17:23:11.693281] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-13T17:23:11.704437] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T17:23:11.708750] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-13T17:23:12.136015] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T17:23:12.146098] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-13T17:23:12.403509] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T17:23:12.407170] [INFO ] [REMOTE ] ATMU: Full fetch complete (56312 records). [2025-10-13T17:23:12.407250] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-13T17:23:12.407922] [FATAL] [VALIDATOR ] ATMU: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:23:12.408005] [FATAL] [MAIN ] ATMU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:23:12.408090] [WARN ] [MAIN ] ATMU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:23:12.408133] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-13T17:23:12.408189] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-10-13T17:23:12.408227] [INFO ] [LOCAL ] ATMU: Starting deletion of derivative data. [2025-10-13T17:23:12.408378] [DEBUG] [LOCAL ] ATMU: Deleted derivative data file. [2025-10-13T17:23:12.408943] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATMU took 43.7s. Estimated remaining: 4h 54m 7s. Rate: 7.5 symbols/min [2025-10-13T17:23:12.585473] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:12.630818] [DEBUG] [LOCAL ] ATUS: Loaded 50199 existing records from primary storage. [2025-10-13T17:23:12.631171] [INFO ] [MAIN ] ATUS: Loaded 50199 existing records. [2025-10-13T17:23:12.834850] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:12.837434] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-13T17:23:12.837555] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-13T17:23:12.836730] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T17:23:12.843205] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-13T17:23:12.843925] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-13T17:23:12.856327] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-13T17:23:13.195134] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T17:23:13.224540] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-13T17:23:13.254150] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:13.255242] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-13T17:23:13.788713] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T17:23:13.793538] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-13T17:23:13.821870] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T17:23:13.832976] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-13T17:23:14.620679] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T17:23:14.624274] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-13T17:23:14.739001] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T17:23:14.817891] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-13T17:23:14.923712] [DEBUG] [REMOTE ] ATR: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-13T17:23:14.924065] [WARN ] [REMOTE ] ATR: No data returned for month 2025-09 [2025-10-13T17:23:14.924162] [FATAL] [REMOTE ] ATR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:23:14.924254] [FATAL] [MAIN ] ATR: Failed to fetch primary data. [2025-10-13T17:23:14.924334] [WARN ] [MAIN ] ATR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:23:14.924419] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-13T17:23:14.924497] [DEBUG] [LOCAL ] ATR: No primary data file found to delete. [2025-10-13T17:23:14.924550] [INFO ] [LOCAL ] ATR: Starting deletion of derivative data. [2025-10-13T17:23:14.924813] [DEBUG] [LOCAL ] ATR: Deleted derivative data file. [2025-10-13T17:23:14.924925] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATR took 26.7s. Estimated remaining: 4h 52m 49s. Rate: 7.5 symbols/min [2025-10-13T17:23:15.132231] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T17:23:15.130683] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:15.165394] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T17:23:15.225054] [DEBUG] [LOCAL ] AU: Loaded 53767 existing records from primary storage. [2025-10-13T17:23:15.225368] [INFO ] [MAIN ] AU: Loaded 53767 existing records. [2025-10-13T17:23:15.401453] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:15.401867] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-13T17:23:15.401945] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-13T17:23:15.403082] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-13T17:23:15.403142] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-13T17:23:15.507823] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T17:23:15.530745] [INFO ] [REMOTE ] ATS: Full fetch complete (25448 records). [2025-10-13T17:23:15.549229] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-13T17:23:15.570594] [FATAL] [VALIDATOR ] ATS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:23:15.586765] [FATAL] [MAIN ] ATS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:23:15.632479] [WARN ] [MAIN ] ATS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:23:15.626038] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-13T17:23:15.675405] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-13T17:23:15.688568] [DEBUG] [LOCAL ] ATS: No primary data file found to delete. [2025-10-13T17:23:15.692538] [INFO ] [LOCAL ] ATS: Starting deletion of derivative data. [2025-10-13T17:23:15.692902] [DEBUG] [LOCAL ] ATS: Deleted derivative data file. [2025-10-13T17:23:15.709142] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 25.8s. Estimated remaining: 4h 51m 10s. Rate: 7.5 symbols/min [2025-10-13T17:23:15.877743] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:15.962755] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:16.011283] [DEBUG] [LOCAL ] AUB: Loaded 46863 existing records from primary storage. [2025-10-13T17:23:16.011750] [INFO ] [MAIN ] AUB: Loaded 46863 existing records. [2025-10-13T17:23:16.201931] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:16.202221] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-13T17:23:16.202270] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-13T17:23:16.203491] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-13T17:23:16.203557] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-13T17:23:16.423102] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-13T17:23:16.574401] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:17.217950] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-13T17:23:17.251529] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:23:18.017926] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-13T17:23:18.703326] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-13T17:23:18.761285] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T17:23:18.817903] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-13T17:23:19.538261] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T17:23:19.617898] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-13T17:23:20.372877] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T17:23:20.417986] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-13T17:23:21.217902] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-13T17:23:21.698266] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T17:23:21.786095] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T17:23:22.017968] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-13T17:23:22.701769] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T17:23:22.817932] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-13T17:23:23.283764] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T17:23:23.617933] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-13T17:23:24.099353] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:23:24.417944] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-13T17:23:25.217968] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-13T17:23:25.344159] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T17:23:25.770462] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T17:23:26.018062] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-13T17:23:26.817992] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-13T17:23:26.990063] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T17:23:27.587066] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T17:23:27.617943] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-13T17:23:28.291462] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T17:23:28.417984] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-13T17:23:29.217948] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-13T17:23:29.655169] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-13T17:23:29.683043] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T17:23:29.687546] [INFO ] [REMOTE ] ATO: Full fetch complete (60103 records). [2025-10-13T17:23:29.687854] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-13T17:23:29.689000] [FATAL] [VALIDATOR ] ATO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:23:29.689098] [FATAL] [MAIN ] ATO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:23:29.689142] [WARN ] [MAIN ] ATO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:23:29.689186] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-13T17:23:29.689265] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-10-13T17:23:29.689322] [INFO ] [LOCAL ] ATO: Starting deletion of derivative data. [2025-10-13T17:23:29.689480] [DEBUG] [LOCAL ] ATO: Deleted derivative data file. [2025-10-13T17:23:29.690101] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATO took 48.1s. Estimated remaining: 4h 52m 18s. Rate: 7.5 symbols/min [2025-10-13T17:23:29.868543] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:29.878280] [DEBUG] [LOCAL ] AUNA: Loaded 5124 existing records from primary storage. [2025-10-13T17:23:29.878603] [INFO ] [MAIN ] AUNA: Loaded 5124 existing records. [2025-10-13T17:23:30.023106] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-13T17:23:30.063284] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:30.063554] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-13T17:23:30.063603] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-13T17:23:30.063943] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-13T17:23:30.064004] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-13T17:23:30.429251] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:30.470887] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T17:23:30.817981] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-13T17:23:31.617899] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-13T17:23:31.733756] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T17:23:32.188588] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T17:23:32.417945] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-13T17:23:33.217978] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-13T17:23:33.509260] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T17:23:34.018307] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-13T17:23:34.021511] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T17:23:34.728028] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:23:34.817885] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-13T17:23:35.617924] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-13T17:23:35.835521] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T17:23:36.417994] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-13T17:23:36.535080] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T17:23:36.809752] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T17:23:37.217915] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-13T17:23:38.017953] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-13T17:23:38.097942] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T17:23:38.344124] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T17:23:38.766966] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T17:23:38.817908] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-13T17:23:39.617952] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-13T17:23:40.256948] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:23:40.261874] [INFO ] [REMOTE ] AUB: Full fetch complete (65821 records). [2025-10-13T17:23:40.261981] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-13T17:23:40.439721] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-13T17:23:40.662072] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-13T17:23:40.662177] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-13T17:23:40.663125] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-13T17:23:40.663204] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-13T17:23:40.664873] [DEBUG] [LOCAL ] AUB: Trimmed 65821 records to 46091 (keeping 200 days of data) [2025-10-13T17:23:40.953633] [DEBUG] [LOCAL ] AUB: Primary data saved (46091 records). [2025-10-13T17:23:40.953870] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-13T17:23:40.953977] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUB took 25.2s. Estimated remaining: 4h 52m 50s. Rate: 7.5 symbols/min [2025-10-13T17:23:41.143181] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:41.182237] [DEBUG] [LOCAL ] AVA: Loaded 39567 existing records from primary storage. [2025-10-13T17:23:41.182717] [INFO ] [MAIN ] AVA: Loaded 39567 existing records. [2025-10-13T17:23:41.234471] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-13T17:23:41.267443] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:23:41.385694] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:41.386058] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-13T17:23:41.386121] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-13T17:23:41.387220] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-13T17:23:41.387299] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-13T17:23:41.793012] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:41.826099] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-13T17:23:42.017941] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-13T17:23:42.817956] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-13T17:23:42.875361] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T17:23:43.346629] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-13T17:23:43.617941] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-13T17:23:44.065253] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-13T17:23:44.417932] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-13T17:23:45.053541] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T17:23:45.217950] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-13T17:23:46.002460] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T17:23:46.017885] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-13T17:23:46.817925] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-13T17:23:46.863977] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T17:23:46.869817] [INFO ] [REMOTE ] ATUS: Full fetch complete (71057 records). [2025-10-13T17:23:46.869993] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-13T17:23:47.270019] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T17:23:47.314790] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-13T17:23:47.314894] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-13T17:23:47.315799] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-13T17:23:47.315869] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-13T17:23:47.317706] [DEBUG] [LOCAL ] ATUS: Trimmed 71057 records to 49722 (keeping 200 days of data) [2025-10-13T17:23:47.618740] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-13T17:23:47.625545] [DEBUG] [LOCAL ] ATUS: Primary data saved (49722 records). [2025-10-13T17:23:47.625823] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-13T17:23:47.626516] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. ATUS took 35.2s. Estimated remaining: 4h 52m 26s. Rate: 7.5 symbols/min [2025-10-13T17:23:47.852629] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:47.865173] [DEBUG] [LOCAL ] AVAL: Loaded 8816 existing records from primary storage. [2025-10-13T17:23:47.865505] [INFO ] [MAIN ] AVAL: Loaded 8816 existing records. [2025-10-13T17:23:48.057852] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:48.058161] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-13T17:23:48.058218] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-13T17:23:48.058740] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-13T17:23:48.058802] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-13T17:23:48.420694] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-13T17:23:48.448627] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:48.906082] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T17:23:48.917622] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T17:23:48.976878] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-13T17:23:49.217967] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-13T17:23:50.017957] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-13T17:23:50.487122] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-13T17:23:50.817928] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-13T17:23:51.125296] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-13T17:23:51.132910] [INFO ] [REMOTE ] AU: Full fetch complete (75922 records). [2025-10-13T17:23:51.133170] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-13T17:23:51.134270] [FATAL] [VALIDATOR ] AU: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:23:51.134361] [FATAL] [MAIN ] AU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:23:51.134403] [WARN ] [MAIN ] AU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:23:51.134444] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-13T17:23:51.134502] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-13T17:23:51.134539] [INFO ] [LOCAL ] AU: Starting deletion of derivative data. [2025-10-13T17:23:51.134768] [DEBUG] [LOCAL ] AU: Deleted derivative data file. [2025-10-13T17:23:51.134871] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AU took 36.2s. Estimated remaining: 4h 51m 23s. Rate: 7.5 symbols/min [2025-10-13T17:23:51.310799] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:23:51.350772] [DEBUG] [LOCAL ] AVB: Loaded 42671 existing records from primary storage. [2025-10-13T17:23:51.351095] [INFO ] [MAIN ] AVB: Loaded 42671 existing records. [2025-10-13T17:23:51.538338] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:23:51.538546] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-13T17:23:51.538593] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-13T17:23:51.539565] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-13T17:23:51.539625] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-13T17:23:51.623071] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-13T17:23:51.922183] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:23:52.092709] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T17:23:52.158258] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T17:23:52.417913] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-13T17:23:53.217934] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-13T17:23:53.764809] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T17:23:54.017941] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-13T17:23:54.712944] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T17:23:54.817885] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-13T17:23:54.831171] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T17:23:55.617931] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-13T17:23:56.132352] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T17:23:56.220593] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-13T17:23:56.418000] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-13T17:23:57.217996] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-13T17:23:57.964715] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T17:23:57.970582] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T17:23:58.017948] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-13T17:23:58.617572] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T17:23:58.817950] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-13T17:23:59.516187] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-13T17:23:59.617944] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-13T17:24:00.417917] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-13T17:24:00.429324] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T17:24:01.217957] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-13T17:24:01.977541] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:24:02.017996] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-13T17:24:02.193593] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T17:24:02.817965] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-13T17:24:03.365885] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T17:24:03.617951] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-13T17:24:04.177846] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-13T17:24:04.203796] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T17:24:04.417964] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-13T17:24:05.218003] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-13T17:24:05.930737] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T17:24:06.019855] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-13T17:24:06.027220] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:24:06.817977] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-13T17:24:07.425032] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T17:24:07.426672] [INFO ] [REMOTE ] AUNA: Full fetch complete (7803 records). [2025-10-13T17:24:07.426747] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-13T17:24:07.618632] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-13T17:24:07.821278] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-13T17:24:07.821403] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-13T17:24:07.821892] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-13T17:24:07.822071] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-13T17:24:07.822933] [DEBUG] [LOCAL ] AUNA: Trimmed 7803 records to 5088 (keeping 200 days of data) [2025-10-13T17:24:07.855727] [DEBUG] [LOCAL ] AUNA: Primary data saved (5088 records). [2025-10-13T17:24:07.856214] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-13T17:24:07.856352] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AUNA took 38.2s. Estimated remaining: 4h 53m 1s. Rate: 7.5 symbols/min [2025-10-13T17:24:07.993164] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-13T17:24:08.078253] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:08.078490] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-13T17:24:08.078557] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-13T17:24:08.078708] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-13T17:24:08.078763] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-13T17:24:08.078806] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-13T17:24:08.078838] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-13T17:24:08.379794] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T17:24:08.423295] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-13T17:24:08.467070] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:09.217966] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-13T17:24:09.779899] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T17:24:09.953004] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-13T17:24:10.017948] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-13T17:24:10.674780] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T17:24:10.817984] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-13T17:24:11.617958] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-13T17:24:12.253679] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T17:24:12.417990] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-13T17:24:12.982480] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T17:24:13.218875] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T17:24:13.218978] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-13T17:24:13.904622] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-13T17:24:14.017966] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-13T17:24:14.817992] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-13T17:24:15.013144] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:24:15.013515] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-13T17:24:15.013610] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:24:15.013697] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-13T17:24:15.013748] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:24:15.013819] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-13T17:24:15.013932] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-13T17:24:15.014029] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-13T17:24:15.014087] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-13T17:24:15.014140] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVBC took 7.2s. Estimated remaining: 4h 52m 43s. Rate: 7.5 symbols/min [2025-10-13T17:24:15.199902] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:15.223420] [DEBUG] [LOCAL ] AVD: Loaded 22475 existing records from primary storage. [2025-10-13T17:24:15.223754] [INFO ] [MAIN ] AVD: Loaded 22475 existing records. [2025-10-13T17:24:15.408382] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:15.408932] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-13T17:24:15.409032] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-13T17:24:15.409309] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-13T17:24:15.409370] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-13T17:24:15.623210] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-13T17:24:15.788997] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:15.823397] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T17:24:16.417992] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-13T17:24:16.952796] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T17:24:17.217939] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-13T17:24:17.251611] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T17:24:17.253773] [INFO ] [REMOTE ] AVAL: Full fetch complete (14823 records). [2025-10-13T17:24:17.253869] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-13T17:24:17.620552] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-13T17:24:17.620635] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-13T17:24:17.620957] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-13T17:24:17.621000] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-13T17:24:17.621458] [DEBUG] [LOCAL ] AVAL: Trimmed 14823 records to 8610 (keeping 200 days of data) [2025-10-13T17:24:17.673233] [DEBUG] [LOCAL ] AVAL: Primary data saved (8610 records). [2025-10-13T17:24:17.673350] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-13T17:24:17.673431] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVAL took 30.0s. Estimated remaining: 4h 51m 30s. Rate: 7.5 symbols/min [2025-10-13T17:24:17.843669] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:17.862341] [DEBUG] [LOCAL ] AVK: Loaded 18620 existing records from primary storage. [2025-10-13T17:24:17.862608] [INFO ] [MAIN ] AVK: Loaded 18620 existing records. [2025-10-13T17:24:18.024429] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-13T17:24:18.049690] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:18.050818] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-13T17:24:18.050868] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-13T17:24:18.051169] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-13T17:24:18.051226] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-13T17:24:18.438067] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T17:24:18.441175] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:18.817935] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-13T17:24:19.617939] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-13T17:24:19.713212] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:24:20.013310] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:24:20.417946] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-13T17:24:20.723700] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T17:24:21.218045] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-13T17:24:22.019144] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:24:22.018040] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-13T17:24:22.191232] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T17:24:22.817987] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-13T17:24:23.412763] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T17:24:23.418719] [INFO ] [REMOTE ] AVA: Full fetch complete (55446 records). [2025-10-13T17:24:23.418940] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-13T17:24:23.624545] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-13T17:24:23.847765] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-13T17:24:23.847884] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-13T17:24:23.848856] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-13T17:24:23.848925] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-13T17:24:23.850638] [DEBUG] [LOCAL ] AVA: Trimmed 55446 records to 38997 (keeping 200 days of data) [2025-10-13T17:24:24.097217] [DEBUG] [LOCAL ] AVA: Primary data saved (38997 records). [2025-10-13T17:24:24.097412] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-13T17:24:24.097510] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVA took 43.1s. Estimated remaining: 4h 51m 4s. Rate: 7.5 symbols/min [2025-10-13T17:24:24.280305] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:24.320264] [DEBUG] [LOCAL ] AVNS: Loaded 33979 existing records from primary storage. [2025-10-13T17:24:24.320713] [INFO ] [MAIN ] AVNS: Loaded 33979 existing records. [2025-10-13T17:24:24.425740] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-13T17:24:24.521788] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:24.522395] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-13T17:24:24.522485] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-13T17:24:24.522770] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-13T17:24:24.522829] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-13T17:24:24.776686] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-13T17:24:24.841261] [INFO ] [REMOTE ] AVB: Full fetch complete (58758 records). [2025-10-13T17:24:24.842965] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T17:24:24.848291] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-13T17:24:25.052015] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:25.223071] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-13T17:24:25.336615] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-13T17:24:25.336738] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-13T17:24:25.337382] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-13T17:24:25.337424] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-13T17:24:25.338871] [DEBUG] [LOCAL ] AVB: Trimmed 58758 records to 42176 (keeping 200 days of data) [2025-10-13T17:24:25.612264] [DEBUG] [LOCAL ] AVB: Primary data saved (42176 records). [2025-10-13T17:24:25.612377] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-13T17:24:25.612465] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVB took 34.5s. Estimated remaining: 4h 49m 39s. Rate: 7.6 symbols/min [2025-10-13T17:24:25.799548] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T17:24:25.798475] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:25.848513] [DEBUG] [LOCAL ] AVNT: Loaded 39655 existing records from primary storage. [2025-10-13T17:24:25.848886] [INFO ] [MAIN ] AVNT: Loaded 39655 existing records. [2025-10-13T17:24:26.022988] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-13T17:24:26.022920] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:26.024136] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-13T17:24:26.024209] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-13T17:24:26.024885] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-13T17:24:26.024974] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-13T17:24:26.381446] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:26.533882] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T17:24:26.817936] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-13T17:24:27.275120] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T17:24:27.617937] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-13T17:24:28.151585] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T17:24:28.417960] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-13T17:24:28.685683] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-13T17:24:29.217882] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-13T17:24:29.320258] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T17:24:29.963275] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T17:24:30.017890] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-13T17:24:30.817902] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-13T17:24:30.971177] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T17:24:31.617936] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-13T17:24:32.213391] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T17:24:32.417950] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-13T17:24:32.708239] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T17:24:33.217991] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-13T17:24:33.930585] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:24:34.017898] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-13T17:24:34.036753] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T17:24:34.817928] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-13T17:24:35.247187] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T17:24:35.617928] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-13T17:24:36.314739] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T17:24:36.417932] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-13T17:24:36.849980] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T17:24:37.137990] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T17:24:37.217927] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-13T17:24:38.017927] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-13T17:24:38.411676] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:24:38.817940] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-13T17:24:39.252392] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T17:24:39.617916] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-13T17:24:39.878386] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T17:24:40.417928] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-13T17:24:40.505314] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T17:24:40.507828] [INFO ] [REMOTE ] AVD: Full fetch complete (33048 records). [2025-10-13T17:24:40.507906] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-13T17:24:40.913477] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-13T17:24:40.913559] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-13T17:24:40.913990] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-13T17:24:40.914052] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-13T17:24:40.914821] [DEBUG] [LOCAL ] AVD: Trimmed 33048 records to 22083 (keeping 200 days of data) [2025-10-13T17:24:41.049088] [DEBUG] [LOCAL ] AVD: Primary data saved (22083 records). [2025-10-13T17:24:41.049257] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-13T17:24:41.049374] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVD took 26.0s. Estimated remaining: 4h 50m 59s. Rate: 7.5 symbols/min [2025-10-13T17:24:41.221797] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:41.221917] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-13T17:24:41.297700] [DEBUG] [LOCAL ] AVTR: Loaded 54340 existing records from primary storage. [2025-10-13T17:24:41.298257] [INFO ] [MAIN ] AVTR: Loaded 54340 existing records. [2025-10-13T17:24:41.488439] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:41.488752] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-13T17:24:41.488809] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-13T17:24:41.489125] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-13T17:24:41.489170] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-13T17:24:41.871813] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:41.896512] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T17:24:42.017916] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-13T17:24:42.105559] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T17:24:42.817953] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-13T17:24:43.065894] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T17:24:43.617929] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-13T17:24:44.130001] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T17:24:44.417965] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-13T17:24:44.809407] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T17:24:45.217990] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-13T17:24:46.017955] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-13T17:24:46.224373] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:24:46.225741] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T17:24:46.817933] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-13T17:24:47.617907] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-13T17:24:47.645413] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T17:24:47.827809] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T17:24:48.417953] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-13T17:24:49.130577] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T17:24:49.217920] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-13T17:24:49.731301] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T17:24:50.017969] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-13T17:24:50.355943] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T17:24:50.817949] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-13T17:24:51.326146] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T17:24:51.617991] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-13T17:24:52.171571] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T17:24:52.175807] [INFO ] [REMOTE ] AVNS: Full fetch complete (48276 records). [2025-10-13T17:24:52.175994] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-13T17:24:52.423735] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-13T17:24:52.586921] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-13T17:24:52.587033] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-13T17:24:52.587731] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-13T17:24:52.587798] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-13T17:24:52.588858] [DEBUG] [LOCAL ] AVNS: Trimmed 48276 records to 33586 (keeping 200 days of data) [2025-10-13T17:24:52.799393] [DEBUG] [LOCAL ] AVNS: Primary data saved (33586 records). [2025-10-13T17:24:52.799558] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-13T17:24:52.799678] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNS took 28.7s. Estimated remaining: 4h 51m 35s. Rate: 7.5 symbols/min [2025-10-13T17:24:52.972532] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:52.972843] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-13T17:24:52.972913] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-13T17:24:52.973140] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-13T17:24:52.973218] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-13T17:24:52.973340] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-13T17:24:52.973389] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-13T17:24:53.118941] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T17:24:53.223112] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-13T17:24:53.379976] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:54.017913] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-13T17:24:54.096785] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:24:54.504983] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T17:24:54.817948] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-13T17:24:55.246767] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T17:24:55.617953] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-13T17:24:56.208182] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:24:56.418033] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-13T17:24:57.098346] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T17:24:57.217948] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-13T17:24:57.569062] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T17:24:57.573111] [INFO ] [REMOTE ] AVK: Full fetch complete (26588 records). [2025-10-13T17:24:57.573216] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-13T17:24:57.970079] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-13T17:24:57.970209] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-13T17:24:57.970704] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-13T17:24:57.970766] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-13T17:24:57.972124] [DEBUG] [LOCAL ] AVK: Trimmed 26588 records to 18522 (keeping 200 days of data) [2025-10-13T17:24:58.024087] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-13T17:24:58.098339] [DEBUG] [LOCAL ] AVK: Primary data saved (18522 records). [2025-10-13T17:24:58.098537] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-13T17:24:58.098638] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVK took 40.4s. Estimated remaining: 4h 50m 56s. Rate: 7.5 symbols/min [2025-10-13T17:24:58.285369] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:24:58.314402] [DEBUG] [LOCAL ] AWF: Loaded 24541 existing records from primary storage. [2025-10-13T17:24:58.314772] [INFO ] [MAIN ] AWF: Loaded 24541 existing records. [2025-10-13T17:24:58.517717] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:24:58.518268] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-13T17:24:58.518427] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-13T17:24:58.518817] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-13T17:24:58.518957] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-13T17:24:58.695278] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T17:24:58.827112] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-13T17:24:58.944186] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:24:59.230873] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T17:24:59.235200] [INFO ] [REMOTE ] AVNT: Full fetch complete (56302 records). [2025-10-13T17:24:59.235294] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-13T17:24:59.618203] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-13T17:24:59.635948] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-13T17:24:59.636029] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-13T17:24:59.636741] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-13T17:24:59.636805] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-13T17:24:59.638618] [DEBUG] [LOCAL ] AVNT: Trimmed 56302 records to 39118 (keeping 200 days of data) [2025-10-13T17:24:59.884150] [DEBUG] [LOCAL ] AVNT: Primary data saved (39118 records). [2025-10-13T17:24:59.884312] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-13T17:24:59.884408] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVNT took 34.3s. Estimated remaining: 4h 49m 36s. Rate: 7.5 symbols/min [2025-10-13T17:25:00.061730] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:25:00.095927] [DEBUG] [LOCAL ] AWI: Loaded 25695 existing records from primary storage. [2025-10-13T17:25:00.096243] [INFO ] [MAIN ] AWI: Loaded 25695 existing records. [2025-10-13T17:25:00.276502] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:25:00.276923] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-13T17:25:00.277106] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-13T17:25:00.277467] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-13T17:25:00.277611] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-13T17:25:00.428129] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-13T17:25:00.682623] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:25:00.687267] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T17:25:01.092542] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T17:25:01.217967] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-13T17:25:02.017911] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-13T17:25:02.074415] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:25:02.277069] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T17:25:02.817997] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-13T17:25:03.618005] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-13T17:25:03.781508] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T17:25:04.356477] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T17:25:04.418235] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-13T17:25:04.773750] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:25:05.217990] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-13T17:25:06.018039] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-13T17:25:06.221765] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T17:25:06.291425] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:25:06.818078] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-13T17:25:07.123368] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T17:25:07.617972] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-13T17:25:08.417917] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-13T17:25:08.644378] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T17:25:08.698893] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T17:25:09.217921] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-13T17:25:09.311972] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T17:25:10.017916] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-13T17:25:10.401979] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T17:25:10.817954] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-13T17:25:11.393639] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T17:25:11.617966] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-13T17:25:12.417962] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-13T17:25:12.904916] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-13T17:25:13.185571] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:25:13.217968] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-13T17:25:13.833689] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T17:25:14.017944] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-13T17:25:14.776187] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T17:25:14.817931] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-13T17:25:15.206199] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:25:15.617960] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-13T17:25:16.413626] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T17:25:16.421885] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-13T17:25:16.864106] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T17:25:17.217983] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-13T17:25:18.017950] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-13T17:25:18.247446] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T17:25:18.526218] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T17:25:18.817948] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-13T17:25:19.134905] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T17:25:19.617943] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-13T17:25:20.287029] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T17:25:20.417885] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-13T17:25:21.217959] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-13T17:25:21.354278] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T17:25:21.881116] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T17:25:21.926189] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T17:25:22.017908] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-13T17:25:22.817957] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-13T17:25:23.088912] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T17:25:23.617899] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-13T17:25:24.041132] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:25:24.417922] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-13T17:25:24.595037] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T17:25:25.217949] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-13T17:25:25.771366] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T17:25:26.017997] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-13T17:25:26.561599] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T17:25:26.566595] [INFO ] [REMOTE ] AVTR: Full fetch complete (77055 records). [2025-10-13T17:25:26.566746] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-13T17:25:26.567603] [FATAL] [VALIDATOR ] AVTR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:25:26.567720] [FATAL] [MAIN ] AVTR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:25:26.567764] [WARN ] [MAIN ] AVTR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:25:26.567827] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-13T17:25:26.567884] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-13T17:25:26.567918] [INFO ] [LOCAL ] AVTR: Starting deletion of derivative data. [2025-10-13T17:25:26.568112] [DEBUG] [LOCAL ] AVTR: Deleted derivative data file. [2025-10-13T17:25:26.568972] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVTR took 45.5s. Estimated remaining: 4h 53m 4s. Rate: 7.4 symbols/min [2025-10-13T17:25:26.740010] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:25:26.793047] [DEBUG] [LOCAL ] AWK: Loaded 49396 existing records from primary storage. [2025-10-13T17:25:26.793371] [INFO ] [MAIN ] AWK: Loaded 49396 existing records. [2025-10-13T17:25:26.823194] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-13T17:25:26.976252] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:25:26.976537] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-13T17:25:26.976585] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-13T17:25:26.977250] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-13T17:25:26.977314] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-13T17:25:27.261930] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T17:25:27.374617] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:25:27.617941] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-13T17:25:28.416637] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T17:25:28.424442] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-13T17:25:28.782345] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T17:25:28.785498] [INFO ] [REMOTE ] AWF: Full fetch complete (35586 records). [2025-10-13T17:25:28.785678] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-13T17:25:29.180403] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-13T17:25:29.180490] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-13T17:25:29.180975] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-13T17:25:29.181038] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-13T17:25:29.182227] [DEBUG] [LOCAL ] AWF: Trimmed 35586 records to 24023 (keeping 200 days of data) [2025-10-13T17:25:29.240111] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-13T17:25:29.332792] [DEBUG] [LOCAL ] AWF: Primary data saved (24023 records). [2025-10-13T17:25:29.332931] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-13T17:25:29.333010] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 31.2s. Estimated remaining: 4h 51m 55s. Rate: 7.5 symbols/min [2025-10-13T17:25:29.502576] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:25:29.522669] [DEBUG] [LOCAL ] AWP: Loaded 21748 existing records from primary storage. [2025-10-13T17:25:29.522940] [INFO ] [MAIN ] AWP: Loaded 21748 existing records. [2025-10-13T17:25:29.664037] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T17:25:29.722181] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:25:29.722696] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-13T17:25:29.722753] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-13T17:25:29.723046] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-13T17:25:29.723103] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-13T17:25:30.023006] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-13T17:25:30.084451] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:25:30.817921] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-13T17:25:30.869177] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T17:25:30.873838] [INFO ] [REMOTE ] AVY: Full fetch complete (56381 records). [2025-10-13T17:25:30.873947] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-13T17:25:31.266864] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T17:25:31.315895] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-13T17:25:31.315634] [INFO ] [REMOTE ] AWI: Full fetch complete (35781 records). [2025-10-13T17:25:31.316103] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-13T17:25:31.316213] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-13T17:25:31.317271] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-13T17:25:31.317381] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-13T17:25:31.423788] [DEBUG] [LOCAL ] AVY: Trimmed 56381 records to 37819 (keeping 200 days of data) [2025-10-13T17:25:31.619472] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-13T17:25:31.963155] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-13T17:25:31.964989] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-13T17:25:31.966543] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-13T17:25:31.967697] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-13T17:25:31.979930] [DEBUG] [LOCAL ] AWI: Trimmed 35781 records to 25385 (keeping 200 days of data) [2025-10-13T17:25:32.068345] [DEBUG] [LOCAL ] AVY: Primary data saved (37819 records). [2025-10-13T17:25:32.068551] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-13T17:25:32.068678] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AVY took 39.3s. Estimated remaining: 4h 50m 47s. Rate: 7.5 symbols/min [2025-10-13T17:25:32.290508] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:25:32.343084] [DEBUG] [LOCAL ] AWI: Primary data saved (25385 records). [2025-10-13T17:25:32.343284] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-13T17:25:32.343378] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWI took 32.5s. Estimated remaining: 4h 49m 11s. Rate: 7.5 symbols/min [2025-10-13T17:25:32.393148] [DEBUG] [LOCAL ] AWR: Loaded 23017 existing records from primary storage. [2025-10-13T17:25:32.405604] [INFO ] [MAIN ] AWR: Loaded 23017 existing records. [2025-10-13T17:25:32.653372] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:25:32.729905] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:25:32.730591] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-13T17:25:32.730718] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-13T17:25:32.731072] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-13T17:25:32.731195] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-13T17:25:32.884996] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T17:25:32.908495] [DEBUG] [LOCAL ] AX: Loaded 28446 existing records from primary storage. [2025-10-13T17:25:32.930912] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T17:25:32.931561] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-13T17:25:32.947412] [INFO ] [MAIN ] AX: Loaded 28446 existing records. [2025-10-13T17:25:33.228044] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-13T17:25:33.380054] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:25:33.401073] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-13T17:25:33.404848] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-13T17:25:33.426893] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:25:33.426959] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-13T17:25:33.427175] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-13T17:25:33.792482] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:25:34.017997] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-13T17:25:34.525270] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T17:25:34.597059] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:25:34.817943] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-13T17:25:35.025303] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T17:25:35.617940] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-13T17:25:36.158186] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T17:25:36.417919] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-13T17:25:36.716917] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T17:25:37.217925] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-13T17:25:38.024805] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-13T17:25:38.044606] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T17:25:38.387481] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T17:25:38.688511] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:25:38.817924] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-13T17:25:39.617909] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-13T17:25:39.939992] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T17:25:40.417915] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-13T17:25:40.501116] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-13T17:25:41.217896] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-13T17:25:41.495132] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T17:25:42.017938] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-13T17:25:42.817906] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-13T17:25:43.125492] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T17:25:43.330021] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T17:25:43.617895] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-13T17:25:43.851426] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:25:44.417909] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-13T17:25:44.796410] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:25:45.217922] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-13T17:25:45.474055] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T17:25:46.017941] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-13T17:25:46.525319] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T17:25:46.817935] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-13T17:25:47.319461] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-13T17:25:47.617930] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-13T17:25:47.962122] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T17:25:48.417917] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-13T17:25:49.217962] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-13T17:25:49.347400] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T17:25:49.805217] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T17:25:50.017973] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-13T17:25:50.425751] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T17:25:50.817942] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-13T17:25:50.873993] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T17:25:51.617974] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-13T17:25:52.013266] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T17:25:52.417963] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-13T17:25:52.643451] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T17:25:53.217884] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-13T17:25:53.335762] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T17:25:54.017892] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-13T17:25:54.377210] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T17:25:54.817977] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-13T17:25:55.512318] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:25:55.617901] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-13T17:25:56.057712] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T17:25:56.417954] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-13T17:25:57.218004] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-13T17:25:57.380579] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:25:57.684680] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T17:25:58.017930] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-13T17:25:58.294202] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T17:25:58.817990] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-13T17:25:58.935396] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T17:25:59.617956] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-13T17:25:59.807688] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T17:26:00.417917] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-13T17:26:00.681585] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T17:26:01.217955] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-13T17:26:01.704215] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-13T17:26:02.017938] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-13T17:26:02.716995] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T17:26:02.817920] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-13T17:26:03.215013] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T17:26:03.218136] [INFO ] [REMOTE ] AX: Full fetch complete (42184 records). [2025-10-13T17:26:03.218238] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-13T17:26:03.592217] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-13T17:26:03.592339] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-13T17:26:03.592819] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-13T17:26:03.592880] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-13T17:26:03.593746] [DEBUG] [LOCAL ] AX: Trimmed 42184 records to 28013 (keeping 200 days of data) [2025-10-13T17:26:03.641172] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-13T17:26:03.756460] [DEBUG] [LOCAL ] AX: Primary data saved (28013 records). [2025-10-13T17:26:03.756619] [INFO ] [MAIN ] AX: Full history saved. [2025-10-13T17:26:03.756736] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AX took 31.4s. Estimated remaining: 4h 53m 28s. Rate: 7.4 symbols/min [2025-10-13T17:26:03.924485] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:03.977705] [DEBUG] [LOCAL ] AXL: Loaded 51267 existing records from primary storage. [2025-10-13T17:26:03.978766] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T17:26:03.982757] [INFO ] [MAIN ] AXL: Loaded 51267 existing records. [2025-10-13T17:26:04.025298] [INFO ] [REMOTE ] AWP: Full fetch complete (31899 records). [2025-10-13T17:26:04.057056] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-13T17:26:04.336944] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:04.352613] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-13T17:26:04.378149] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-13T17:26:04.410936] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-13T17:26:04.428412] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-13T17:26:04.428617] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-13T17:26:04.838151] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-13T17:26:04.847767] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-13T17:26:04.871188] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-13T17:26:04.897158] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-13T17:26:04.946105] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T17:26:04.958315] [DEBUG] [LOCAL ] AWP: Trimmed 31899 records to 21557 (keeping 200 days of data) [2025-10-13T17:26:05.022718] [INFO ] [REMOTE ] AWR: Full fetch complete (32203 records). [2025-10-13T17:26:05.028925] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:05.076215] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-13T17:26:05.217906] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-13T17:26:05.553435] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-13T17:26:05.560472] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-13T17:26:05.561349] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-13T17:26:05.561436] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-13T17:26:05.564258] [DEBUG] [LOCAL ] AWP: Primary data saved (21557 records). [2025-10-13T17:26:05.564676] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-13T17:26:05.564806] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWP took 36.2s. Estimated remaining: 4h 52m 9s. Rate: 7.5 symbols/min [2025-10-13T17:26:05.564924] [DEBUG] [LOCAL ] AWR: Trimmed 32203 records to 22779 (keeping 200 days of data) [2025-10-13T17:26:05.869453] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:05.944454] [DEBUG] [LOCAL ] AWR: Primary data saved (22779 records). [2025-10-13T17:26:05.944704] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-13T17:26:05.944911] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AWR took 33.8s. Estimated remaining: 4h 50m 35s. Rate: 7.5 symbols/min [2025-10-13T17:26:06.082716] [DEBUG] [LOCAL ] AXP: Loaded 53949 existing records from primary storage. [2025-10-13T17:26:06.147579] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:06.098941] [INFO ] [MAIN ] AXP: Loaded 53949 existing records. [2025-10-13T17:26:06.148201] [DEBUG] [LOCAL ] AXR: No existing data file found in primary storage. [2025-10-13T17:26:06.159819] [WARN ] [MAIN ] AXR: No existing data found, performing full refresh instead. [2025-10-13T17:26:06.192095] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-13T17:26:06.204112] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-13T17:26:06.217953] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-13T17:26:06.239848] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-13T17:26:06.454520] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:06.460042] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-13T17:26:06.465979] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-13T17:26:06.512595] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-13T17:26:06.527471] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-13T17:26:06.626231] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-13T17:26:06.792432] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-13T17:26:07.016191] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:07.026490] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-13T17:26:07.270572] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:07.273052] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-13T17:26:07.617955] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-13T17:26:07.804432] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T17:26:08.206801] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T17:26:08.212082] [INFO ] [REMOTE ] AWK: Full fetch complete (70692 records). [2025-10-13T17:26:08.212260] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-13T17:26:08.423033] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-13T17:26:08.611106] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-13T17:26:08.611192] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-13T17:26:08.611931] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-13T17:26:08.611995] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-13T17:26:08.616474] [DEBUG] [LOCAL ] AWK: Trimmed 70692 records to 48619 (keeping 200 days of data) [2025-10-13T17:26:08.928593] [DEBUG] [LOCAL ] AWK: Primary data saved (48619 records). [2025-10-13T17:26:08.928816] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-13T17:26:08.929607] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AWK took 42.4s. Estimated remaining: 4h 49m 32s. Rate: 7.5 symbols/min [2025-10-13T17:26:09.032244] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:26:09.103232] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:09.140610] [DEBUG] [LOCAL ] AXS: Loaded 39207 existing records from primary storage. [2025-10-13T17:26:09.140957] [INFO ] [MAIN ] AXS: Loaded 39207 existing records. [2025-10-13T17:26:09.223079] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-13T17:26:09.318485] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:09.318804] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-13T17:26:09.318853] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-13T17:26:09.319198] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-13T17:26:09.319255] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-13T17:26:09.676227] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:09.756064] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-13T17:26:10.017924] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-13T17:26:10.817944] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-13T17:26:10.866731] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:26:11.507403] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T17:26:11.617959] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-13T17:26:12.417960] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-13T17:26:12.736954] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-13T17:26:12.795451] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:26:12.882376] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T17:26:13.217951] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-13T17:26:13.718758] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T17:26:14.017961] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-13T17:26:14.626445] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-13T17:26:14.817926] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-13T17:26:15.617929] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-13T17:26:16.279205] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T17:26:16.417929] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-13T17:26:16.525450] [DEBUG] [REMOTE ] AXP: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-13T17:26:16.526271] [WARN ] [REMOTE ] AXP: No data returned for month 2025-02 [2025-10-13T17:26:16.526385] [FATAL] [REMOTE ] AXP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:26:16.526498] [FATAL] [MAIN ] AXP: Failed to fetch primary data. [2025-10-13T17:26:16.526563] [WARN ] [MAIN ] AXP: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:26:16.526669] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-13T17:26:16.526844] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-10-13T17:26:16.526909] [INFO ] [LOCAL ] AXP: Starting deletion of derivative data. [2025-10-13T17:26:16.527631] [DEBUG] [LOCAL ] AXP: Deleted derivative data file. [2025-10-13T17:26:16.529005] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXP took 11.0s. Estimated remaining: 4h 49m 19s. Rate: 7.5 symbols/min [2025-10-13T17:26:17.217948] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-13T17:26:17.219008] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T17:26:17.656058] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T17:26:18.017970] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-13T17:26:18.554074] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T17:26:18.817961] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-13T17:26:19.277921] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T17:26:19.617971] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-13T17:26:20.417898] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-13T17:26:21.093824] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T17:26:21.122333] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:26:21.217955] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-13T17:26:21.787379] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T17:26:22.017917] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-13T17:26:22.556384] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T17:26:22.557166] [INFO ] [REMOTE ] AXR: Full fetch complete (4431 records). [2025-10-13T17:26:22.557235] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-13T17:26:22.557764] [FATAL] [VALIDATOR ] AXR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:26:22.557828] [FATAL] [MAIN ] AXR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:26:22.557866] [WARN ] [MAIN ] AXR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:26:22.557903] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-13T17:26:22.557957] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-13T17:26:22.557993] [INFO ] [LOCAL ] AXR: Starting deletion of derivative data. [2025-10-13T17:26:22.558082] [DEBUG] [LOCAL ] AXR: No derivative data file found to delete. [2025-10-13T17:26:22.558149] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXR took 16.6s. Estimated remaining: 4h 48m 50s. Rate: 7.5 symbols/min [2025-10-13T17:26:22.818039] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-13T17:26:23.617950] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-13T17:26:24.351313] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T17:26:24.417953] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-13T17:26:25.247330] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T17:26:25.256056] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-13T17:26:26.441243] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T17:26:26.452881] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-13T17:26:26.876926] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T17:26:26.885324] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-13T17:26:28.166272] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T17:26:28.177619] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-13T17:26:28.308541] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:26:28.418003] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-13T17:26:29.697360] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T17:26:29.706486] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-13T17:26:29.774516] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T17:26:30.017972] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-13T17:26:31.182869] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T17:26:31.192993] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-13T17:26:31.308198] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T17:26:31.617945] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-13T17:26:32.371254] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T17:26:32.417889] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-13T17:26:32.856049] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T17:26:33.217937] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-13T17:26:33.764296] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T17:26:34.017973] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-13T17:26:34.917367] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T17:26:34.922800] [INFO ] [REMOTE ] AXL: Full fetch complete (72821 records). [2025-10-13T17:26:34.922968] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-13T17:26:35.329615] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-13T17:26:35.329818] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-13T17:26:35.330626] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-13T17:26:35.330731] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-13T17:26:35.342465] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T17:26:35.347311] [DEBUG] [LOCAL ] AXL: Trimmed 72821 records to 50550 (keeping 200 days of data) [2025-10-13T17:26:35.347828] [INFO ] [REMOTE ] AXS: Full fetch complete (55646 records). [2025-10-13T17:26:35.347919] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-13T17:26:36.005357] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-13T17:26:36.020460] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-13T17:26:36.022035] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-13T17:26:36.022400] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-13T17:26:36.040490] [DEBUG] [LOCAL ] AXL: Primary data saved (50550 records). [2025-10-13T17:26:36.040593] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-13T17:26:36.040726] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXL took 32.3s. Estimated remaining: 4h 49m 42s. Rate: 7.5 symbols/min [2025-10-13T17:26:36.037603] [DEBUG] [LOCAL ] AXS: Trimmed 55646 records to 38639 (keeping 200 days of data) [2025-10-13T17:26:36.310391] [DEBUG] [LOCAL ] AXS: Primary data saved (38639 records). [2025-10-13T17:26:36.310546] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-13T17:26:36.310630] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXS took 27.4s. Estimated remaining: 4h 48m 10s. Rate: 7.5 symbols/min [2025-10-13T17:26:36.866521] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:37.006310] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:37.039048] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:37.074931] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:26:37.104183] [DEBUG] [LOCAL ] AYI: Loaded 25627 existing records from primary storage. [2025-10-13T17:26:37.112410] [INFO ] [MAIN ] AYI: Loaded 25627 existing records. [2025-10-13T17:26:37.167529] [DEBUG] [LOCAL ] AZO: Loaded 11422 existing records from primary storage. [2025-10-13T17:26:37.194450] [INFO ] [MAIN ] AZO: Loaded 11422 existing records. [2025-10-13T17:26:37.223128] [DEBUG] [LOCAL ] AZZ: Loaded 22750 existing records from primary storage. [2025-10-13T17:26:37.269134] [INFO ] [MAIN ] AZZ: Loaded 22750 existing records. [2025-10-13T17:26:37.503275] [DEBUG] [LOCAL ] AXTA: Loaded 52953 existing records from primary storage. [2025-10-13T17:26:37.583990] [INFO ] [MAIN ] AXTA: Loaded 52953 existing records. [2025-10-13T17:26:37.690820] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:37.801981] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-13T17:26:37.813150] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:37.822500] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:37.838400] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-13T17:26:37.854636] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-13T17:26:37.843998] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-13T17:26:37.864872] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-13T17:26:37.864732] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-13T17:26:37.865577] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-13T17:26:37.865985] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-13T17:26:37.865725] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-13T17:26:37.865848] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-13T17:26:37.906322] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-13T17:26:37.892573] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-13T17:26:38.179823] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:26:38.216492] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-13T17:26:38.221884] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-13T17:26:38.277925] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-13T17:26:38.313583] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-13T17:26:39.323001] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:39.416318] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-13T17:26:39.406669] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:39.455127] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-13T17:26:39.466556] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:39.484281] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-13T17:26:39.586757] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:26:39.587129] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-13T17:26:40.437818] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T17:26:40.441865] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-13T17:26:40.608856] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T17:26:40.613040] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-13T17:26:40.769241] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T17:26:40.774578] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-13T17:26:41.203115] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T17:26:41.213816] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-13T17:26:41.266891] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:26:41.269765] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-13T17:26:41.647976] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T17:26:41.907668] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T17:26:41.949309] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T17:26:42.017925] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-13T17:26:42.631541] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T17:26:42.722768] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T17:26:42.817945] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-13T17:26:43.617968] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-13T17:26:43.815477] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T17:26:44.417973] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-13T17:26:44.600384] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T17:26:45.182818] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T17:26:45.217944] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-13T17:26:46.017928] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-13T17:26:46.641822] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T17:26:46.818038] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-13T17:26:47.619526] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T17:26:47.619686] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-13T17:26:48.198687] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T17:26:48.310222] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T17:26:48.417959] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-13T17:26:49.217912] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-13T17:26:49.425231] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T17:26:50.017929] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-13T17:26:50.409028] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T17:26:50.817960] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-13T17:26:51.181540] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:26:51.617952] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-13T17:26:51.758420] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-13T17:26:52.417931] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-13T17:26:53.217937] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-13T17:26:53.383942] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T17:26:53.436324] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T17:26:53.818119] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T17:26:54.017966] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-13T17:26:54.818000] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-13T17:26:55.240486] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T17:26:55.617943] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-13T17:26:56.418002] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-13T17:26:56.555213] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:26:56.576373] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T17:26:57.217913] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-13T17:26:57.525167] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T17:26:58.017898] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-13T17:26:58.319254] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T17:26:58.514961] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-13T17:26:58.817944] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-13T17:26:59.617944] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-13T17:27:00.417966] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-13T17:27:00.543739] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T17:27:00.697621] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T17:27:01.217920] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-13T17:27:01.309674] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T17:27:02.017951] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-13T17:27:02.608222] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T17:27:02.817921] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-13T17:27:03.617900] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-13T17:27:03.719736] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T17:27:03.776858] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T17:27:04.354883] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T17:27:04.356817] [INFO ] [REMOTE ] AZO: Full fetch complete (15954 records). [2025-10-13T17:27:04.356923] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-13T17:27:04.423041] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-13T17:27:04.751409] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-13T17:27:04.751520] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-13T17:27:04.751984] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-13T17:27:04.752047] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-13T17:27:04.752591] [DEBUG] [LOCAL ] AZO: Trimmed 15954 records to 11208 (keeping 200 days of data) [2025-10-13T17:27:04.821173] [DEBUG] [LOCAL ] AZO: Primary data saved (11208 records). [2025-10-13T17:27:04.821316] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-13T17:27:04.821396] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. AZO took 28.5s. Estimated remaining: 4h 51m 44s. Rate: 7.4 symbols/min [2025-10-13T17:27:04.986590] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:04.986895] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-13T17:27:04.987823] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-13T17:27:04.987974] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-13T17:27:04.988055] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-13T17:27:04.988130] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-13T17:27:04.988204] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-13T17:27:05.223041] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-13T17:27:05.342179] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:05.753570] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T17:27:05.757083] [INFO ] [REMOTE ] AYI: Full fetch complete (36969 records). [2025-10-13T17:27:05.757197] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-13T17:27:06.023135] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-13T17:27:06.156357] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-13T17:27:06.156469] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-13T17:27:06.157051] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-13T17:27:06.157116] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-13T17:27:06.158243] [DEBUG] [LOCAL ] AYI: Trimmed 36969 records to 25068 (keeping 200 days of data) [2025-10-13T17:27:06.317935] [DEBUG] [LOCAL ] AYI: Primary data saved (25068 records). [2025-10-13T17:27:06.318118] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-13T17:27:06.318211] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AYI took 30.0s. Estimated remaining: 4h 50m 25s. Rate: 7.5 symbols/min [2025-10-13T17:27:06.452960] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T17:27:06.513474] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:06.567144] [DEBUG] [LOCAL ] BA: Loaded 54570 existing records from primary storage. [2025-10-13T17:27:06.567503] [INFO ] [MAIN ] BA: Loaded 54570 existing records. [2025-10-13T17:27:06.753162] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:06.753431] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-13T17:27:06.753488] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-13T17:27:06.753890] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-13T17:27:06.753948] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-13T17:27:06.827577] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-13T17:27:07.111846] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:07.616794] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T17:27:07.627068] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-13T17:27:07.736467] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T17:27:07.739872] [INFO ] [REMOTE ] AZZ: Full fetch complete (31610 records). [2025-10-13T17:27:07.739948] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-13T17:27:08.101559] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-13T17:27:08.101681] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-13T17:27:08.102123] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-13T17:27:08.102165] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-13T17:27:08.103171] [DEBUG] [LOCAL ] AZZ: Trimmed 31610 records to 22566 (keeping 200 days of data) [2025-10-13T17:27:08.235836] [DEBUG] [LOCAL ] AZZ: Primary data saved (22566 records). [2025-10-13T17:27:08.235972] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-13T17:27:08.236051] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AZZ took 31.9s. Estimated remaining: 4h 49m 12s. Rate: 7.5 symbols/min [2025-10-13T17:27:08.401975] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:08.417925] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-13T17:27:08.458101] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-10-13T17:27:08.458419] [INFO ] [MAIN ] BABA: Loaded 54600 existing records. [2025-10-13T17:27:08.635475] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:08.635815] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-13T17:27:08.635875] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-13T17:27:08.636190] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-13T17:27:08.636250] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-13T17:27:08.979974] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:09.217881] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-13T17:27:10.017894] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-13T17:27:10.107312] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-13T17:27:10.149025] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T17:27:10.817947] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-13T17:27:11.407414] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T17:27:11.526511] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-13T17:27:11.617881] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-13T17:27:12.417981] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-13T17:27:13.223086] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-13T17:27:13.242129] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-13T17:27:13.574140] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T17:27:14.017931] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-13T17:27:14.174451] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-13T17:27:14.818187] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-13T17:27:14.825024] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:27:15.617954] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-13T17:27:15.843096] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:27:15.843421] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-13T17:27:15.843509] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:27:15.843592] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-13T17:27:15.843681] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:27:15.843752] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-13T17:27:15.843816] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-13T17:27:15.843869] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-13T17:27:15.843920] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-13T17:27:15.844004] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. B took 11.0s. Estimated remaining: 4h 48m 60s. Rate: 7.5 symbols/min [2025-10-13T17:27:16.028121] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:16.058310] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-13T17:27:16.113524] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-10-13T17:27:16.113897] [INFO ] [MAIN ] BAC: Loaded 54588 existing records. [2025-10-13T17:27:16.287398] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:16.287670] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-13T17:27:16.287730] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-13T17:27:16.288100] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-13T17:27:16.288162] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-13T17:27:16.423841] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-13T17:27:16.640761] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:17.217954] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-13T17:27:17.380501] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-13T17:27:18.017946] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-13T17:27:18.652974] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:27:18.658185] [INFO ] [REMOTE ] AXTA: Full fetch complete (74732 records). [2025-10-13T17:27:18.658347] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-13T17:27:18.659118] [FATAL] [VALIDATOR ] AXTA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:27:18.659211] [FATAL] [MAIN ] AXTA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:27:18.659254] [WARN ] [MAIN ] AXTA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:27:18.659293] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-13T17:27:18.659348] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-10-13T17:27:18.659384] [INFO ] [LOCAL ] AXTA: Starting deletion of derivative data. [2025-10-13T17:27:18.659558] [DEBUG] [LOCAL ] AXTA: Deleted derivative data file. [2025-10-13T17:27:18.659673] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. AXTA took 42.3s. Estimated remaining: 4h 47m 57s. Rate: 7.5 symbols/min [2025-10-13T17:27:18.834238] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:18.831004] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-13T17:27:18.886972] [DEBUG] [LOCAL ] BAH: Loaded 52445 existing records from primary storage. [2025-10-13T17:27:18.887323] [INFO ] [MAIN ] BAH: Loaded 52445 existing records. [2025-10-13T17:27:19.107495] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-13T17:27:19.102821] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:19.108028] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-13T17:27:19.119252] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-13T17:27:19.119932] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-13T17:27:19.120172] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-13T17:27:19.464081] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:19.617955] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-13T17:27:20.417964] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-13T17:27:20.788519] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-13T17:27:20.933323] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-13T17:27:21.217956] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-13T17:27:21.798037] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:27:21.895747] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-13T17:27:22.017972] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-13T17:27:22.817953] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-13T17:27:23.592349] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-13T17:27:23.617908] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-13T17:27:23.848757] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T17:27:24.417979] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-13T17:27:25.217986] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-13T17:27:25.691663] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-10-13T17:27:25.809427] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-13T17:27:26.017977] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-13T17:27:26.505519] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T17:27:26.693470] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-13T17:27:26.817919] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-13T17:27:27.617952] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-13T17:27:28.184270] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-13T17:27:28.417946] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-13T17:27:29.217942] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-13T17:27:29.349422] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-13T17:27:29.393024] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T17:27:30.017918] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-13T17:27:30.817994] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-13T17:27:30.940008] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-13T17:27:31.532542] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:27:31.617984] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-13T17:27:31.664985] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-13T17:27:32.417938] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-13T17:27:33.188459] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T17:27:33.217920] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-13T17:27:33.278408] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-13T17:27:34.017925] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-13T17:27:34.737167] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-13T17:27:34.817947] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-13T17:27:35.620988] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-13T17:27:35.634366] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-13T17:27:36.252692] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T17:27:36.417895] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-13T17:27:36.464399] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-13T17:27:37.217956] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-13T17:27:38.017973] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-13T17:27:38.114603] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T17:27:38.473160] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-13T17:27:38.817920] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-13T17:27:39.463937] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-13T17:27:39.617905] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-13T17:27:40.363965] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:27:40.417893] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-13T17:27:40.592564] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-13T17:27:41.217939] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-13T17:27:42.012631] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T17:27:42.022850] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-13T17:27:42.187800] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-13T17:27:42.741185] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T17:27:42.746886] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-10-13T17:27:42.747071] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-13T17:27:42.822998] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-13T17:27:43.139625] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-13T17:27:43.139750] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-13T17:27:43.140526] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-13T17:27:43.140568] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-13T17:27:43.142198] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 53790 (keeping 200 days of data) [2025-10-13T17:27:43.470706] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-13T17:27:43.470842] [INFO ] [MAIN ] BA: Full history saved. [2025-10-13T17:27:43.470919] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BA took 37.2s. Estimated remaining: 4h 50m 46s. Rate: 7.4 symbols/min [2025-10-13T17:27:43.639775] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:43.637145] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-13T17:27:43.640053] [DEBUG] [LOCAL ] BAK: No existing data file found in primary storage. [2025-10-13T17:27:43.640177] [WARN ] [MAIN ] BAK: No existing data found, performing full refresh instead. [2025-10-13T17:27:43.640389] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-13T17:27:43.640521] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-13T17:27:43.640615] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-10-13T17:27:43.640742] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-13T17:27:44.000188] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:44.034331] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-13T17:27:44.417960] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-13T17:27:44.438196] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T17:27:44.443279] [INFO ] [REMOTE ] BAH: Full fetch complete (74573 records). [2025-10-13T17:27:44.443408] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-13T17:27:44.444242] [FATAL] [VALIDATOR ] BAH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:27:44.444334] [FATAL] [MAIN ] BAH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:27:44.444377] [WARN ] [MAIN ] BAH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:27:44.444445] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-13T17:27:44.444749] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-13T17:27:44.445004] [INFO ] [LOCAL ] BAH: Starting deletion of derivative data. [2025-10-13T17:27:44.445293] [DEBUG] [LOCAL ] BAH: Deleted derivative data file. [2025-10-13T17:27:44.445448] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAH took 25.8s. Estimated remaining: 4h 49m 24s. Rate: 7.5 symbols/min [2025-10-13T17:27:44.635613] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:44.691828] [DEBUG] [LOCAL ] BALL: Loaded 52599 existing records from primary storage. [2025-10-13T17:27:44.692233] [INFO ] [MAIN ] BALL: Loaded 52599 existing records. [2025-10-13T17:27:44.875389] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:44.875692] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-13T17:27:44.875766] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-13T17:27:44.876161] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-13T17:27:44.876229] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-13T17:27:45.227301] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-13T17:27:45.260489] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:46.001844] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-13T17:27:46.017881] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-13T17:27:46.080064] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:27:46.817986] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-13T17:27:47.617961] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-13T17:27:47.927603] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-13T17:27:48.341089] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-13T17:27:48.412539] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:27:48.422927] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-13T17:27:49.148179] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:27:49.217957] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-13T17:27:50.017931] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-13T17:27:50.614862] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:27:50.703310] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-13T17:27:50.709289] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-13T17:27:50.709458] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-13T17:27:50.823057] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-13T17:27:51.128942] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-13T17:27:51.129046] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-13T17:27:51.129962] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-13T17:27:51.130032] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-13T17:27:51.132129] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-10-13T17:27:51.493567] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-13T17:27:51.493783] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-13T17:27:51.493892] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAC took 35.6s. Estimated remaining: 4h 49m 6s. Rate: 7.5 symbols/min [2025-10-13T17:27:51.623135] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-13T17:27:51.677420] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:51.677622] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-13T17:27:51.677708] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-13T17:27:51.677835] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-13T17:27:51.677878] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-13T17:27:51.677928] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-13T17:27:51.678027] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-13T17:27:52.054232] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:52.417935] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-13T17:27:52.568789] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T17:27:52.730725] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-13T17:27:52.736919] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-13T17:27:52.737118] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-13T17:27:53.149912] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-13T17:27:53.150274] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-13T17:27:53.151284] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-13T17:27:53.159865] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-13T17:27:53.179292] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:27:53.179487] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-10-13T17:27:53.247545] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-13T17:27:53.566936] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-13T17:27:53.567119] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-13T17:27:53.567856] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BABA took 45.3s. Estimated remaining: 4h 47m 56s. Rate: 7.5 symbols/min [2025-10-13T17:27:53.826622] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T17:27:53.830266] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:27:53.899913] [DEBUG] [LOCAL ] BAM: Loaded 52777 existing records from primary storage. [2025-10-13T17:27:53.900349] [INFO ] [MAIN ] BAM: Loaded 52777 existing records. [2025-10-13T17:27:54.023142] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-13T17:27:54.110569] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:27:54.110804] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-13T17:27:54.110858] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-13T17:27:54.111133] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-13T17:27:54.111190] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-13T17:27:54.456046] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:27:54.762191] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:27:54.817912] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-13T17:27:55.617921] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-13T17:27:55.687335] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T17:27:56.115710] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:27:56.417913] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-13T17:27:56.856149] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T17:27:57.217962] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-13T17:27:58.017905] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-13T17:27:58.291127] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T17:27:58.818037] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-13T17:27:59.097114] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:27:59.428216] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T17:27:59.617986] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-13T17:28:00.273858] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:28:00.417980] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-13T17:28:00.889910] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-13T17:28:01.218028] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-13T17:28:02.017922] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-13T17:28:02.192298] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:28:02.549374] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T17:28:02.817947] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-13T17:28:03.618028] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-13T17:28:04.154506] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-13T17:28:04.350588] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T17:28:04.417963] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-13T17:28:05.030912] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T17:28:05.218000] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-13T17:28:06.024151] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-13T17:28:06.030163] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T17:28:06.434562] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T17:28:06.630291] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T17:28:06.817946] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-13T17:28:07.618025] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-13T17:28:08.417973] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-13T17:28:08.538363] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T17:28:09.136501] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T17:28:09.184951] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:28:09.217928] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-13T17:28:10.017954] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-13T17:28:10.817974] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-13T17:28:11.057375] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:28:11.100035] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-13T17:28:11.617944] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-13T17:28:12.118190] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T17:28:12.123075] [INFO ] [REMOTE ] BAK: Full fetch complete (57007 records). [2025-10-13T17:28:12.123216] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-13T17:28:12.423153] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-13T17:28:12.468026] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T17:28:12.565590] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-13T17:28:12.565718] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-13T17:28:12.566503] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-13T17:28:12.566570] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-13T17:28:12.568453] [DEBUG] [LOCAL ] BAK: Trimmed 57007 records to 39338 (keeping 200 days of data) [2025-10-13T17:28:12.792380] [DEBUG] [LOCAL ] BAK: Primary data saved (39338 records). [2025-10-13T17:28:12.792550] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-13T17:28:12.792689] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BAK took 29.3s. Estimated remaining: 4h 49m 44s. Rate: 7.5 symbols/min [2025-10-13T17:28:12.968873] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:13.027314] [DEBUG] [LOCAL ] BANC: Loaded 52050 existing records from primary storage. [2025-10-13T17:28:13.027765] [INFO ] [MAIN ] BANC: Loaded 52050 existing records. [2025-10-13T17:28:13.223902] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:13.224076] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-13T17:28:13.226979] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-13T17:28:13.227096] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-13T17:28:13.228170] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-13T17:28:13.228246] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-13T17:28:13.605267] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:14.017949] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-13T17:28:14.284270] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T17:28:14.532245] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T17:28:14.817909] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-13T17:28:14.965107] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:28:15.617935] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-13T17:28:16.242807] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T17:28:16.417938] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-13T17:28:16.490945] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T17:28:17.217961] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-13T17:28:17.280305] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T17:28:18.017959] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-13T17:28:18.131157] [DEBUG] [REMOTE ] BAM: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-13T17:28:18.131530] [WARN ] [REMOTE ] BAM: No data returned for month 2025-05 [2025-10-13T17:28:18.131624] [FATAL] [REMOTE ] BAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:28:18.131751] [FATAL] [MAIN ] BAM: Failed to fetch primary data. [2025-10-13T17:28:18.131819] [WARN ] [MAIN ] BAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:28:18.131894] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-13T17:28:18.131964] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-10-13T17:28:18.132001] [INFO ] [LOCAL ] BAM: Starting deletion of derivative data. [2025-10-13T17:28:18.132240] [DEBUG] [LOCAL ] BAM: Deleted derivative data file. [2025-10-13T17:28:18.133437] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BAM took 24.6s. Estimated remaining: 4h 49m 8s. Rate: 7.5 symbols/min [2025-10-13T17:28:18.310173] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:18.342712] [DEBUG] [LOCAL ] BAP: Loaded 26295 existing records from primary storage. [2025-10-13T17:28:18.343044] [INFO ] [MAIN ] BAP: Loaded 26295 existing records. [2025-10-13T17:28:18.532275] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:18.532474] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-13T17:28:18.532524] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-13T17:28:18.532881] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-13T17:28:18.532990] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-13T17:28:18.818868] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-13T17:28:18.917073] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:18.950334] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T17:28:19.617945] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-13T17:28:20.297860] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T17:28:20.304565] [INFO ] [REMOTE ] BALL: Full fetch complete (75377 records). [2025-10-13T17:28:20.304747] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-13T17:28:20.423038] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-13T17:28:20.752217] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-13T17:28:20.752341] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-13T17:28:20.753607] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-13T17:28:20.753974] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-13T17:28:20.774471] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T17:28:20.774620] [DEBUG] [LOCAL ] BALL: Trimmed 75377 records to 51851 (keeping 200 days of data) [2025-10-13T17:28:21.124823] [DEBUG] [LOCAL ] BALL: Primary data saved (51851 records). [2025-10-13T17:28:21.125766] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-13T17:28:21.125450] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T17:28:21.126053] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BALL took 36.7s. Estimated remaining: 4h 48m 9s. Rate: 7.5 symbols/min [2025-10-13T17:28:21.163273] [INFO ] [REMOTE ] BALY: Full fetch complete (16538 records). [2025-10-13T17:28:21.204222] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-13T17:28:21.223498] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-13T17:28:21.435964] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:21.526271] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T17:28:21.526614] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:28:21.526978] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:28:21.527078] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-13T17:28:21.527178] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-13T17:28:21.527242] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-13T17:28:21.527296] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-13T17:28:21.527369] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BALY took 30.0s. Estimated remaining: 4h 46m 44s. Rate: 7.5 symbols/min [2025-10-13T17:28:21.720082] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:21.733385] [DEBUG] [LOCAL ] BARK: Loaded 38560 existing records from primary storage. [2025-10-13T17:28:21.733912] [INFO ] [MAIN ] BARK: Loaded 38560 existing records. [2025-10-13T17:28:21.936095] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:21.936697] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-13T17:28:21.936802] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-13T17:28:21.937389] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-13T17:28:21.953513] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-13T17:28:22.030426] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-13T17:28:22.103489] [DEBUG] [LOCAL ] BAX: Loaded 54283 existing records from primary storage. [2025-10-13T17:28:22.109486] [INFO ] [MAIN ] BAX: Loaded 54283 existing records. [2025-10-13T17:28:22.508309] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:22.529264] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-13T17:28:22.547941] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-13T17:28:22.587719] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-13T17:28:22.587624] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:22.587908] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-13T17:28:22.822600] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-13T17:28:22.992069] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:23.019844] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T17:28:23.306117] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T17:28:23.617941] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-13T17:28:24.336503] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:28:24.418038] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-13T17:28:25.096796] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T17:28:25.217931] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-13T17:28:26.018036] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-13T17:28:26.235428] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T17:28:26.806861] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T17:28:26.817979] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-13T17:28:27.030142] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T17:28:27.617903] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-13T17:28:28.417960] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-13T17:28:28.579536] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T17:28:28.632514] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T17:28:29.217940] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-13T17:28:29.943604] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:28:30.017965] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-13T17:28:30.817961] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-13T17:28:30.884351] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T17:28:31.617939] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-13T17:28:31.754695] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:28:31.991955] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T17:28:32.417946] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-13T17:28:33.110149] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T17:28:33.217956] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-13T17:28:33.476871] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T17:28:34.017944] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-13T17:28:34.817925] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-13T17:28:35.002113] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T17:28:35.470860] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T17:28:35.617952] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-13T17:28:36.264084] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T17:28:36.417942] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-13T17:28:37.127134] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T17:28:37.217951] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-13T17:28:38.017920] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-13T17:28:38.199814] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T17:28:38.818213] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-13T17:28:38.855850] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T17:28:39.239004] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T17:28:39.617946] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-13T17:28:40.417905] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-13T17:28:40.538587] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T17:28:40.589391] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T17:28:41.217937] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-13T17:28:41.874475] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T17:28:42.017923] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-13T17:28:42.392261] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T17:28:42.817964] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-13T17:28:43.617954] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-13T17:28:43.859409] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:28:44.417930] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-13T17:28:44.499621] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:28:44.827322] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T17:28:45.217972] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-13T17:28:46.017938] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-13T17:28:46.069045] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T17:28:46.817920] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-13T17:28:47.042018] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T17:28:47.048485] [INFO ] [REMOTE ] BANC: Full fetch complete (74343 records). [2025-10-13T17:28:47.048748] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-13T17:28:47.498954] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T17:28:47.503314] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-13T17:28:47.509243] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-13T17:28:47.511451] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-13T17:28:47.511620] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-13T17:28:47.514048] [DEBUG] [LOCAL ] BANC: Trimmed 74343 records to 51326 (keeping 200 days of data) [2025-10-13T17:28:47.618038] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-13T17:28:47.860751] [DEBUG] [LOCAL ] BANC: Primary data saved (51326 records). [2025-10-13T17:28:47.860939] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-13T17:28:47.861036] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BANC took 35.1s. Estimated remaining: 4h 49m 41s. Rate: 7.4 symbols/min [2025-10-13T17:28:48.036964] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:48.099750] [DEBUG] [LOCAL ] BB: Loaded 53713 existing records from primary storage. [2025-10-13T17:28:48.100589] [INFO ] [MAIN ] BB: Loaded 53713 existing records. [2025-10-13T17:28:48.281425] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T17:28:48.322870] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:48.323780] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-13T17:28:48.323845] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-13T17:28:48.324331] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-13T17:28:48.324382] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-13T17:28:48.427428] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-13T17:28:48.705909] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:48.725191] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T17:28:49.217991] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-13T17:28:49.890812] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T17:28:50.017930] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-13T17:28:50.344941] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T17:28:50.347959] [INFO ] [REMOTE ] BAP: Full fetch complete (37306 records). [2025-10-13T17:28:50.348089] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-13T17:28:50.733674] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-13T17:28:50.733812] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-13T17:28:50.734362] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-13T17:28:50.734410] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-13T17:28:50.735540] [DEBUG] [LOCAL ] BAP: Trimmed 37306 records to 25796 (keeping 200 days of data) [2025-10-13T17:28:50.829977] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-13T17:28:50.910263] [DEBUG] [LOCAL ] BAP: Primary data saved (25796 records). [2025-10-13T17:28:50.910422] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-13T17:28:50.910510] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BAP took 32.8s. Estimated remaining: 4h 48m 42s. Rate: 7.5 symbols/min [2025-10-13T17:28:51.077380] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:51.130719] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-10-13T17:28:51.131083] [INFO ] [MAIN ] BBAI: Loaded 54600 existing records. [2025-10-13T17:28:51.314411] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:51.314703] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-13T17:28:51.314763] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-13T17:28:51.315094] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-13T17:28:51.315196] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-13T17:28:51.618922] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-13T17:28:51.688959] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:51.720024] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T17:28:52.417958] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-13T17:28:52.734796] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T17:28:53.218047] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-13T17:28:53.813057] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-13T17:28:53.818585] [INFO ] [REMOTE ] BAX: Full fetch complete (77441 records). [2025-10-13T17:28:53.818767] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-13T17:28:54.023736] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-13T17:28:54.265471] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-13T17:28:54.266040] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-13T17:28:54.267034] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-13T17:28:54.267104] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-13T17:28:54.269557] [DEBUG] [LOCAL ] BAX: Trimmed 77441 records to 53520 (keeping 200 days of data) [2025-10-13T17:28:54.628694] [DEBUG] [LOCAL ] BAX: Primary data saved (53520 records). [2025-10-13T17:28:54.628889] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-13T17:28:54.628985] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BAX took 33.1s. Estimated remaining: 4h 47m 51s. Rate: 7.5 symbols/min [2025-10-13T17:28:54.817968] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:54.865446] [DEBUG] [LOCAL ] BBAR: Loaded 42518 existing records from primary storage. [2025-10-13T17:28:54.865872] [INFO ] [MAIN ] BBAR: Loaded 42518 existing records. [2025-10-13T17:28:55.056495] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:28:55.057383] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-13T17:28:55.057875] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-13T17:28:55.058593] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-13T17:28:55.058776] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-13T17:28:55.264552] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T17:28:55.318091] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-13T17:28:55.472499] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (3.05 seconds). [2025-10-13T17:28:55.589797] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:28:55.610154] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T17:28:55.617903] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-13T17:28:56.417990] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-13T17:28:57.217976] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-13T17:28:57.574276] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-13T17:28:57.639077] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T17:28:58.017943] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-13T17:28:58.109732] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-13T17:28:58.645884] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T17:28:58.817935] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-13T17:28:59.133866] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-13T17:28:59.137843] [INFO ] [REMOTE ] BARK: Full fetch complete (56024 records). [2025-10-13T17:28:59.137948] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-13T17:28:59.522272] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-13T17:28:59.522357] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-13T17:28:59.523036] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-13T17:28:59.523101] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-13T17:28:59.524376] [DEBUG] [LOCAL ] BARK: Trimmed 56024 records to 38175 (keeping 200 days of data) [2025-10-13T17:28:59.618204] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-13T17:28:59.743276] [DEBUG] [LOCAL ] BARK: Primary data saved (38175 records). [2025-10-13T17:28:59.743464] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-13T17:28:59.743561] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BARK took 38.6s. Estimated remaining: 4h 47m 15s. Rate: 7.5 symbols/min [2025-10-13T17:28:59.914085] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:28:59.964260] [DEBUG] [LOCAL ] BBD: Loaded 54018 existing records from primary storage. [2025-10-13T17:28:59.964623] [INFO ] [MAIN ] BBD: Loaded 54018 existing records. [2025-10-13T17:29:00.179453] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:29:00.179747] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-13T17:29:00.179801] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-13T17:29:00.180392] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-13T17:29:00.180451] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-13T17:29:00.424468] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-13T17:29:00.538162] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:01.217902] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-13T17:29:01.713217] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-13T17:29:01.755230] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-10-13T17:29:02.017940] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-13T17:29:02.201281] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T17:29:02.750401] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T17:29:02.817981] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-13T17:29:03.617957] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-13T17:29:04.304524] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T17:29:04.417954] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-13T17:29:04.729198] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-13T17:29:05.217909] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-13T17:29:05.292981] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:29:05.921315] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:29:06.017950] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-13T17:29:06.817910] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-13T17:29:07.091540] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T17:29:07.617920] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-13T17:29:08.309225] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T17:29:08.417922] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-13T17:29:08.490602] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-13T17:29:09.217924] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-13T17:29:09.681935] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-13T17:29:09.776395] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:29:10.017911] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-13T17:29:10.817924] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-13T17:29:10.897902] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T17:29:11.617902] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-13T17:29:11.878408] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T17:29:12.417972] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-13T17:29:13.195068] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T17:29:13.217885] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-13T17:29:13.467824] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-13T17:29:14.017939] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-13T17:29:14.586592] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-13T17:29:14.772025] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T17:29:14.817903] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-13T17:29:15.617969] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-13T17:29:16.278877] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T17:29:16.417926] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-13T17:29:16.588297] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-13T17:29:17.217914] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-13T17:29:17.485201] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T17:29:17.906910] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T17:29:18.017930] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-13T17:29:18.817972] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-13T17:29:19.594723] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T17:29:19.599947] [INFO ] [REMOTE ] BBAR: Full fetch complete (61089 records). [2025-10-13T17:29:19.600070] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-13T17:29:19.632749] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-13T17:29:20.006919] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-13T17:29:20.007080] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-13T17:29:20.007835] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-13T17:29:20.007919] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-13T17:29:20.009524] [DEBUG] [LOCAL ] BBAR: Trimmed 61089 records to 42127 (keeping 200 days of data) [2025-10-13T17:29:20.139562] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-13T17:29:20.315083] [DEBUG] [LOCAL ] BBAR: Primary data saved (42127 records). [2025-10-13T17:29:20.315237] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-13T17:29:20.315322] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 25.7s. Estimated remaining: 4h 49m 11s. Rate: 7.4 symbols/min [2025-10-13T17:29:20.423193] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-13T17:29:20.490610] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:20.521043] [DEBUG] [LOCAL ] BBDC: Loaded 33535 existing records from primary storage. [2025-10-13T17:29:20.521336] [INFO ] [MAIN ] BBDC: Loaded 33535 existing records. [2025-10-13T17:29:20.731405] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:29:20.732178] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-13T17:29:20.732279] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-13T17:29:20.735404] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-13T17:29:20.735353] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T17:29:20.735549] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-13T17:29:21.109634] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:21.217933] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-13T17:29:21.637230] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-13T17:29:22.017911] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-13T17:29:22.823619] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-13T17:29:22.830342] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T17:29:23.158399] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-13T17:29:23.617946] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-13T17:29:24.037412] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-13T17:29:24.274164] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T17:29:24.417953] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-13T17:29:25.197403] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T17:29:25.217891] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-13T17:29:26.017976] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-13T17:29:26.456369] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-13T17:29:26.462413] [INFO ] [REMOTE ] BB: Full fetch complete (76972 records). [2025-10-13T17:29:26.463254] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-13T17:29:26.837739] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-13T17:29:26.882499] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-13T17:29:26.882963] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-13T17:29:26.883966] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-13T17:29:26.884080] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-13T17:29:26.914700] [DEBUG] [LOCAL ] BB: Trimmed 76972 records to 52937 (keeping 200 days of data) [2025-10-13T17:29:26.938440] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T17:29:27.068249] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T17:29:27.305666] [DEBUG] [LOCAL ] BB: Primary data saved (52937 records). [2025-10-13T17:29:27.305859] [INFO ] [MAIN ] BB: Full history saved. [2025-10-13T17:29:27.305961] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BB took 39.4s. Estimated remaining: 4h 48m 52s. Rate: 7.4 symbols/min [2025-10-13T17:29:27.481976] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:27.489146] [DEBUG] [LOCAL ] BBDO: Loaded 5077 existing records from primary storage. [2025-10-13T17:29:27.489405] [INFO ] [MAIN ] BBDO: Loaded 5077 existing records. [2025-10-13T17:29:27.623049] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-13T17:29:27.728938] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:29:27.729204] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-13T17:29:27.729254] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-13T17:29:27.729486] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-13T17:29:27.729543] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-13T17:29:28.098891] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:28.417953] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-13T17:29:29.217951] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-13T17:29:29.303583] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T17:29:29.563392] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T17:29:29.655188] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-10-13T17:29:30.017949] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-13T17:29:30.587200] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T17:29:30.611520] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:29:30.817942] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-13T17:29:31.617933] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-13T17:29:32.417964] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-13T17:29:32.684576] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T17:29:32.933484] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-13T17:29:33.038328] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T17:29:33.217895] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-13T17:29:34.017961] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-13T17:29:34.817966] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-13T17:29:34.974340] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T17:29:34.980196] [INFO ] [REMOTE ] BBD: Full fetch complete (77111 records). [2025-10-13T17:29:34.980347] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-13T17:29:35.377330] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-13T17:29:35.377487] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-13T17:29:35.378761] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-13T17:29:35.378827] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-13T17:29:35.380457] [DEBUG] [LOCAL ] BBD: Trimmed 77111 records to 53253 (keeping 200 days of data) [2025-10-13T17:29:35.618349] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T17:29:35.619636] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-13T17:29:35.730200] [DEBUG] [LOCAL ] BBD: Primary data saved (53253 records). [2025-10-13T17:29:35.730352] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-13T17:29:35.730430] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBD took 36.0s. Estimated remaining: 4h 48m 48s. Rate: 7.4 symbols/min [2025-10-13T17:29:35.898142] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:35.915675] [DEBUG] [LOCAL ] BBN: Loaded 18236 existing records from primary storage. [2025-10-13T17:29:35.915915] [INFO ] [MAIN ] BBN: Loaded 18236 existing records. [2025-10-13T17:29:36.094051] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:29:36.094274] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-13T17:29:36.094322] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-13T17:29:36.094536] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-13T17:29:36.094593] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-13T17:29:36.322725] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T17:29:36.423065] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-13T17:29:36.481182] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:37.217930] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-13T17:29:37.464686] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-13T17:29:37.471305] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-13T17:29:37.471503] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-13T17:29:37.648722] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T17:29:37.928888] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-13T17:29:37.929010] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-13T17:29:37.930041] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-13T17:29:37.930110] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-13T17:29:37.932119] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-13T17:29:38.023088] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-13T17:29:38.267240] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-13T17:29:38.267393] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-13T17:29:38.268225] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBAI took 47.4s. Estimated remaining: 4h 47m 46s. Rate: 7.5 symbols/min [2025-10-13T17:29:38.459445] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:38.460489] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-13T17:29:38.460580] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-13T17:29:38.461265] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T17:29:38.461567] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-13T17:29:38.467373] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-13T17:29:38.468324] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-13T17:29:38.468370] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-13T17:29:38.788897] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T17:29:38.821338] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-13T17:29:38.854731] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:39.556892] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T17:29:39.617949] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-13T17:29:39.817252] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:29:39.817705] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-13T17:29:39.817824] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:29:39.817882] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-13T17:29:39.817918] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:29:39.817958] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-13T17:29:39.818060] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-13T17:29:39.818122] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-13T17:29:39.818166] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-13T17:29:39.818221] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBT took 1.5s. Estimated remaining: 4h 46m 35s. Rate: 7.5 symbols/min [2025-10-13T17:29:40.016168] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:40.026763] [DEBUG] [LOCAL ] BBU: Loaded 5254 existing records from primary storage. [2025-10-13T17:29:40.027056] [INFO ] [MAIN ] BBU: Loaded 5254 existing records. [2025-10-13T17:29:40.256212] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:29:40.256488] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-13T17:29:40.256540] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-13T17:29:40.256785] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-13T17:29:40.256846] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-13T17:29:40.423237] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-13T17:29:40.763340] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:41.166525] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T17:29:41.217939] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-13T17:29:41.711731] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-13T17:29:42.017952] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-13T17:29:42.612426] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-13T17:29:42.817983] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-13T17:29:43.375825] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T17:29:43.617932] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-13T17:29:44.171248] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-13T17:29:44.417993] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-13T17:29:45.037852] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T17:29:45.039274] [INFO ] [REMOTE ] BBDO: Full fetch complete (7530 records). [2025-10-13T17:29:45.039347] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-13T17:29:45.222897] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-13T17:29:45.415673] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-13T17:29:45.415775] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-13T17:29:45.416057] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-13T17:29:45.416100] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-13T17:29:45.416514] [DEBUG] [LOCAL ] BBDO: Trimmed 7530 records to 5048 (keeping 200 days of data) [2025-10-13T17:29:45.452361] [DEBUG] [LOCAL ] BBDO: Primary data saved (5048 records). [2025-10-13T17:29:45.452637] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-13T17:29:45.452781] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBDO took 18.1s. Estimated remaining: 4h 46m 4s. Rate: 7.5 symbols/min [2025-10-13T17:29:45.626517] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:29:45.626742] [DEBUG] [LOCAL ] BBUC: No existing data file found in primary storage. [2025-10-13T17:29:45.626794] [WARN ] [MAIN ] BBUC: No existing data found, performing full refresh instead. [2025-10-13T17:29:45.626995] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-13T17:29:45.627039] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-13T17:29:45.627082] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-13T17:29:45.627114] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-13T17:29:46.002059] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:29:46.017955] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-13T17:29:46.174779] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T17:29:46.526376] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-13T17:29:46.817963] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-13T17:29:47.617943] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-13T17:29:47.750815] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T17:29:48.339636] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T17:29:48.417923] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-13T17:29:49.029554] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T17:29:49.217909] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-13T17:29:49.963755] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T17:29:50.017963] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-13T17:29:50.693574] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T17:29:50.817984] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-13T17:29:51.617944] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-13T17:29:51.981494] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T17:29:52.417922] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-13T17:29:52.867082] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T17:29:53.015888] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-13T17:29:53.217952] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-13T17:29:54.017937] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-13T17:29:54.196724] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T17:29:54.817890] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-13T17:29:55.221213] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T17:29:55.617924] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-13T17:29:55.752554] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T17:29:56.418108] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-13T17:29:56.892073] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T17:29:57.100814] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T17:29:57.217952] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-13T17:29:57.908070] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T17:29:58.017951] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-13T17:29:58.817905] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-13T17:29:59.037233] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T17:29:59.604880] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T17:29:59.617879] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-13T17:30:00.409312] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T17:30:00.417878] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-13T17:30:01.210684] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T17:30:01.212847] [INFO ] [REMOTE ] BBUC: Full fetch complete (18467 records). [2025-10-13T17:30:01.212962] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-13T17:30:01.213594] [FATAL] [VALIDATOR ] BBUC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:30:01.213706] [FATAL] [MAIN ] BBUC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:30:01.213757] [WARN ] [MAIN ] BBUC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:30:01.213797] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-13T17:30:01.213853] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-13T17:30:01.213890] [INFO ] [LOCAL ] BBUC: Starting deletion of derivative data. [2025-10-13T17:30:01.213929] [DEBUG] [LOCAL ] BBUC: No derivative data file found to delete. [2025-10-13T17:30:01.214021] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBUC took 15.8s. Estimated remaining: 4h 47m 11s. Rate: 7.5 symbols/min [2025-10-13T17:30:01.225354] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-13T17:30:01.409879] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:01.457779] [DEBUG] [LOCAL ] BBVA: Loaded 49892 existing records from primary storage. [2025-10-13T17:30:01.458227] [INFO ] [MAIN ] BBVA: Loaded 49892 existing records. [2025-10-13T17:30:01.637086] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:01.637334] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-13T17:30:01.637380] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-13T17:30:01.637713] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-13T17:30:01.637784] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-13T17:30:01.997194] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:02.017905] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-13T17:30:02.062721] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T17:30:02.817942] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-13T17:30:03.617943] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-13T17:30:03.767070] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T17:30:04.034119] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:30:04.417963] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-13T17:30:04.915826] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T17:30:05.217952] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-13T17:30:05.323548] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T17:30:05.616446] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-13T17:30:06.017976] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-13T17:30:06.817944] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-13T17:30:06.907868] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T17:30:07.617927] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-13T17:30:08.417952] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-13T17:30:08.454904] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:30:08.669039] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T17:30:09.218073] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-13T17:30:09.706383] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T17:30:09.706257] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T17:30:09.714183] [INFO ] [REMOTE ] BBDC: Full fetch complete (48630 records). [2025-10-13T17:30:09.714282] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-13T17:30:10.023161] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-13T17:30:10.143017] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-13T17:30:10.143100] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-13T17:30:10.143688] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-13T17:30:10.143751] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-13T17:30:10.144756] [DEBUG] [LOCAL ] BBDC: Trimmed 48630 records to 33121 (keeping 200 days of data) [2025-10-13T17:30:10.339088] [DEBUG] [LOCAL ] BBDC: Primary data saved (33121 records). [2025-10-13T17:30:10.339236] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-13T17:30:10.339345] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBDC took 50.0s. Estimated remaining: 4h 47m 13s. Rate: 7.5 symbols/min [2025-10-13T17:30:10.513207] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:10.541385] [DEBUG] [LOCAL ] BBW: Loaded 27623 existing records from primary storage. [2025-10-13T17:30:10.546075] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-13T17:30:10.546477] [INFO ] [MAIN ] BBW: Loaded 27623 existing records. [2025-10-13T17:30:10.729698] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:10.729941] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-13T17:30:10.729989] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-13T17:30:10.730284] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-13T17:30:10.730355] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-13T17:30:10.823217] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-13T17:30:11.083120] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:11.617943] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-13T17:30:12.318860] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:30:12.417918] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-13T17:30:12.669285] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T17:30:13.217956] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-13T17:30:14.017946] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-13T17:30:14.466352] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T17:30:14.506992] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T17:30:14.537751] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-13T17:30:14.817958] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-13T17:30:15.570800] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T17:30:15.617936] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-13T17:30:16.417921] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-13T17:30:16.672007] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T17:30:16.673928] [INFO ] [REMOTE ] BBN: Full fetch complete (25738 records). [2025-10-13T17:30:16.674000] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-13T17:30:17.044105] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-13T17:30:17.044194] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-13T17:30:17.044782] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-13T17:30:17.044847] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-13T17:30:17.045892] [DEBUG] [LOCAL ] BBN: Trimmed 25738 records to 18055 (keeping 200 days of data) [2025-10-13T17:30:17.164492] [DEBUG] [LOCAL ] BBN: Primary data saved (18055 records). [2025-10-13T17:30:17.164637] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-13T17:30:17.164765] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBN took 41.4s. Estimated remaining: 4h 46m 54s. Rate: 7.5 symbols/min [2025-10-13T17:30:17.223751] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-13T17:30:17.365138] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:17.427991] [DEBUG] [LOCAL ] BBWI: Loaded 54362 existing records from primary storage. [2025-10-13T17:30:17.428417] [INFO ] [MAIN ] BBWI: Loaded 54362 existing records. [2025-10-13T17:30:17.624980] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:17.625223] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-13T17:30:17.625273] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-13T17:30:17.625759] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-13T17:30:17.625818] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-13T17:30:17.912191] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T17:30:18.005230] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:18.017883] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-13T17:30:18.163816] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T17:30:18.818053] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-13T17:30:19.565759] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T17:30:19.617966] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-13T17:30:19.906843] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T17:30:20.417988] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-13T17:30:21.147242] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T17:30:21.149120] [INFO ] [REMOTE ] BBU: Full fetch complete (7069 records). [2025-10-13T17:30:21.149202] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-13T17:30:21.219714] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-13T17:30:21.551939] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-13T17:30:21.552075] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-13T17:30:21.552391] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-13T17:30:21.552625] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-13T17:30:21.553636] [DEBUG] [LOCAL ] BBU: Trimmed 7069 records to 5248 (keeping 200 days of data) [2025-10-13T17:30:21.636634] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T17:30:21.652564] [DEBUG] [LOCAL ] BBU: Primary data saved (5248 records). [2025-10-13T17:30:21.652783] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-13T17:30:21.652896] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBU took 41.8s. Estimated remaining: 4h 46m 12s. Rate: 7.5 symbols/min [2025-10-13T17:30:21.833996] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:21.902696] [DEBUG] [LOCAL ] BBY: Loaded 54230 existing records from primary storage. [2025-10-13T17:30:21.903248] [INFO ] [MAIN ] BBY: Loaded 54230 existing records. [2025-10-13T17:30:22.023120] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-13T17:30:22.105782] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:22.106370] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-13T17:30:22.106507] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-13T17:30:22.106968] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-13T17:30:22.107032] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-13T17:30:22.317884] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T17:30:22.534725] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:22.817961] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-13T17:30:23.617909] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-13T17:30:23.682789] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T17:30:24.417912] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-13T17:30:24.624559] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:30:25.011726] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T17:30:25.217943] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-13T17:30:26.016040] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T17:30:26.024888] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-13T17:30:26.817961] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-13T17:30:26.929590] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T17:30:27.617905] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-13T17:30:27.702953] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T17:30:28.417897] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-13T17:30:28.503676] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T17:30:29.227759] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-13T17:30:29.252827] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T17:30:30.027742] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-13T17:30:30.050057] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T17:30:30.256540] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:30:30.817943] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-13T17:30:31.617921] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-13T17:30:31.960129] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T17:30:31.993779] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T17:30:32.417951] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-13T17:30:33.217986] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-13T17:30:33.330735] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:30:34.017898] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-13T17:30:34.290020] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T17:30:34.817899] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-13T17:30:35.012667] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T17:30:35.617942] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-13T17:30:36.014241] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T17:30:36.294699] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T17:30:36.417995] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-13T17:30:36.787844] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T17:30:37.218037] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-13T17:30:38.017912] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-13T17:30:38.266975] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T17:30:38.295610] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T17:30:38.817920] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-13T17:30:39.617905] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-13T17:30:39.799993] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T17:30:40.324352] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T17:30:40.417912] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-13T17:30:41.217907] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-13T17:30:41.325136] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T17:30:41.957558] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T17:30:41.961605] [INFO ] [REMOTE ] BBW: Full fetch complete (39760 records). [2025-10-13T17:30:41.961734] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-13T17:30:42.026790] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-13T17:30:42.350099] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-13T17:30:42.350194] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-13T17:30:42.350798] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-13T17:30:42.350875] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-13T17:30:42.351707] [DEBUG] [LOCAL ] BBW: Trimmed 39760 records to 27362 (keeping 200 days of data) [2025-10-13T17:30:42.517067] [DEBUG] [LOCAL ] BBW: Primary data saved (27362 records). [2025-10-13T17:30:42.517200] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-13T17:30:42.517293] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBW took 32.2s. Estimated remaining: 4h 48m 5s. Rate: 7.4 symbols/min [2025-10-13T17:30:42.691412] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:42.732311] [DEBUG] [LOCAL ] BC: Loaded 44741 existing records from primary storage. [2025-10-13T17:30:42.732619] [INFO ] [MAIN ] BC: Loaded 44741 existing records. [2025-10-13T17:30:42.843787] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-13T17:30:42.929577] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:42.930038] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-13T17:30:42.930093] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-13T17:30:42.930492] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-13T17:30:42.930552] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-13T17:30:43.072517] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T17:30:43.144200] [INFO ] [REMOTE ] BBVA: Full fetch complete (71581 records). [2025-10-13T17:30:43.198620] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-13T17:30:43.464604] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:43.621513] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-13T17:30:43.748063] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-13T17:30:43.748168] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-13T17:30:43.748970] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-13T17:30:43.749036] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-13T17:30:43.750588] [DEBUG] [LOCAL ] BBVA: Trimmed 71581 records to 49136 (keeping 200 days of data) [2025-10-13T17:30:44.006084] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T17:30:44.100540] [DEBUG] [LOCAL ] BBVA: Primary data saved (49136 records). [2025-10-13T17:30:44.100749] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-13T17:30:44.100851] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBVA took 42.9s. Estimated remaining: 4h 46m 57s. Rate: 7.5 symbols/min [2025-10-13T17:30:44.289352] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:44.289577] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-10-13T17:30:44.289616] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-10-13T17:30:44.289757] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-13T17:30:44.289798] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-13T17:30:44.289841] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-10-13T17:30:44.289874] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-13T17:30:44.426718] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-13T17:30:44.659715] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:44.874957] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-13T17:30:44.941907] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T17:30:45.217982] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-13T17:30:46.017913] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-13T17:30:46.313128] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T17:30:46.799762] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T17:30:46.817891] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-13T17:30:47.617985] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-13T17:30:47.778239] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T17:30:48.152699] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T17:30:48.417946] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-13T17:30:49.084138] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T17:30:49.217961] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-13T17:30:50.017937] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-13T17:30:50.241578] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T17:30:50.447706] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T17:30:50.817941] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-13T17:30:51.244857] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T17:30:51.617944] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-13T17:30:52.295811] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T17:30:52.417911] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-13T17:30:53.217990] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-13T17:30:53.488578] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T17:30:53.520914] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T17:30:54.017963] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-13T17:30:54.700822] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T17:30:54.817953] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-13T17:30:55.617928] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-13T17:30:55.966963] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T17:30:55.975875] [INFO ] [REMOTE ] BBWI: Full fetch complete (77446 records). [2025-10-13T17:30:55.976092] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-13T17:30:56.418226] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-13T17:30:56.439935] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-13T17:30:56.440158] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-13T17:30:56.441365] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-13T17:30:56.441635] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-13T17:30:56.483337] [DEBUG] [LOCAL ] BBWI: Trimmed 77446 records to 53583 (keeping 200 days of data) [2025-10-13T17:30:56.483162] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T17:30:56.824969] [DEBUG] [LOCAL ] BBWI: Primary data saved (53583 records). [2025-10-13T17:30:56.825134] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-13T17:30:56.825219] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BBWI took 39.7s. Estimated remaining: 4h 47m 32s. Rate: 7.4 symbols/min [2025-10-13T17:30:56.991194] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:57.019900] [DEBUG] [LOCAL ] BCC: Loaded 28719 existing records from primary storage. [2025-10-13T17:30:57.020219] [INFO ] [MAIN ] BCC: Loaded 28719 existing records. [2025-10-13T17:30:57.200156] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:57.200571] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-13T17:30:57.200669] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-13T17:30:57.201081] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-13T17:30:57.201142] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-13T17:30:57.231779] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-13T17:30:57.366605] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T17:30:57.407451] [INFO ] [REMOTE ] BBY: Full fetch complete (77243 records). [2025-10-13T17:30:57.449231] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-13T17:30:57.733663] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:58.032036] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-13T17:30:58.056232] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-13T17:30:58.057333] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-13T17:30:58.058313] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-13T17:30:58.065810] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-13T17:30:58.079508] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T17:30:58.088408] [DEBUG] [LOCAL ] BBY: Trimmed 77243 records to 53453 (keeping 200 days of data) [2025-10-13T17:30:58.420091] [DEBUG] [LOCAL ] BBY: Primary data saved (53453 records). [2025-10-13T17:30:58.420241] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-13T17:30:58.421025] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BBY took 36.8s. Estimated remaining: 4h 46m 24s. Rate: 7.5 symbols/min [2025-10-13T17:30:58.587698] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:30:58.644777] [DEBUG] [LOCAL ] BCE: Loaded 52976 existing records from primary storage. [2025-10-13T17:30:58.645102] [INFO ] [MAIN ] BCE: Loaded 52976 existing records. [2025-10-13T17:30:58.819524] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-13T17:30:58.824158] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:30:58.826168] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-13T17:30:58.826379] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-13T17:30:58.826780] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-13T17:30:58.827074] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-13T17:30:59.150033] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T17:30:59.243605] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:30:59.257323] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T17:30:59.617930] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-13T17:31:00.191044] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T17:31:00.417963] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-13T17:31:00.917126] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T17:31:01.218028] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-13T17:31:02.017975] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-13T17:31:02.110570] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T17:31:02.776686] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T17:31:02.817985] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-13T17:31:03.200061] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:31:03.617946] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-13T17:31:04.233171] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:31:04.417933] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-13T17:31:05.146399] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:31:05.217932] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-13T17:31:05.977036] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:31:06.017930] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-13T17:31:06.644063] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T17:31:06.817975] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-13T17:31:07.296562] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T17:31:07.617928] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-13T17:31:08.305456] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T17:31:08.417967] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-13T17:31:09.014150] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:31:09.217967] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-13T17:31:10.017924] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-13T17:31:10.116343] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T17:31:10.193733] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T17:31:10.817911] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-13T17:31:11.500119] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T17:31:11.617904] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-13T17:31:12.010598] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:31:12.417942] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-13T17:31:13.178491] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T17:31:13.217924] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-13T17:31:13.803909] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T17:31:13.807702] [INFO ] [REMOTE ] BCAT: Full fetch complete (49899 records). [2025-10-13T17:31:13.807831] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-13T17:31:14.027412] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-13T17:31:14.185081] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-13T17:31:14.185175] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-13T17:31:14.185765] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-13T17:31:14.185827] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-13T17:31:14.186856] [DEBUG] [LOCAL ] BCAT: Trimmed 49899 records to 34066 (keeping 200 days of data) [2025-10-13T17:31:14.396208] [DEBUG] [LOCAL ] BCAT: Primary data saved (34066 records). [2025-10-13T17:31:14.396360] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-13T17:31:14.396433] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCAT took 30.3s. Estimated remaining: 4h 47m 30s. Rate: 7.4 symbols/min [2025-10-13T17:31:14.566085] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:31:14.596244] [DEBUG] [LOCAL ] BCH: Loaded 30383 existing records from primary storage. [2025-10-13T17:31:14.596569] [INFO ] [MAIN ] BCH: Loaded 30383 existing records. [2025-10-13T17:31:14.783051] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T17:31:14.813939] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:31:14.825307] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-13T17:31:14.826843] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-13T17:31:14.826944] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-13T17:31:14.827941] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-13T17:31:14.828044] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-13T17:31:15.174965] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:31:15.617888] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-13T17:31:15.842527] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:31:15.868428] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T17:31:16.417919] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-13T17:31:16.754822] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:31:16.758952] [INFO ] [REMOTE ] BC: Full fetch complete (63629 records). [2025-10-13T17:31:16.759063] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-13T17:31:17.156005] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-13T17:31:17.156094] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-13T17:31:17.156967] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-13T17:31:17.157032] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-13T17:31:17.158362] [DEBUG] [LOCAL ] BC: Trimmed 63629 records to 44145 (keeping 200 days of data) [2025-10-13T17:31:17.218794] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-13T17:31:17.393473] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T17:31:17.450895] [DEBUG] [LOCAL ] BC: Primary data saved (44145 records). [2025-10-13T17:31:17.451049] [INFO ] [MAIN ] BC: Full history saved. [2025-10-13T17:31:17.451156] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BC took 34.9s. Estimated remaining: 4h 46m 35s. Rate: 7.5 symbols/min [2025-10-13T17:31:17.616738] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:31:17.640956] [DEBUG] [LOCAL ] BCO: Loaded 26031 existing records from primary storage. [2025-10-13T17:31:17.641236] [INFO ] [MAIN ] BCO: Loaded 26031 existing records. [2025-10-13T17:31:17.813273] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:31:17.813498] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-13T17:31:17.813542] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-13T17:31:17.813818] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-13T17:31:17.813874] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-13T17:31:18.027322] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-13T17:31:18.161953] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:31:18.817948] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-13T17:31:19.022269] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T17:31:19.337314] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T17:31:19.617929] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-13T17:31:20.063238] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T17:31:20.417922] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-13T17:31:21.217948] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-13T17:31:21.463535] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:31:21.535976] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T17:31:22.017984] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-13T17:31:22.213366] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T17:31:22.817974] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-13T17:31:23.617913] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-13T17:31:23.872434] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T17:31:23.873424] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T17:31:24.417930] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-13T17:31:24.913305] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T17:31:24.918810] [INFO ] [REMOTE ] BCC: Full fetch complete (40786 records). [2025-10-13T17:31:24.919016] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-13T17:31:24.919893] [FATAL] [VALIDATOR ] BCC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:31:24.920002] [FATAL] [MAIN ] BCC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:31:24.920065] [WARN ] [MAIN ] BCC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:31:24.920154] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-13T17:31:24.920255] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-10-13T17:31:24.920316] [INFO ] [LOCAL ] BCC: Starting deletion of derivative data. [2025-10-13T17:31:24.920949] [DEBUG] [LOCAL ] BCC: Deleted derivative data file. [2025-10-13T17:31:24.921294] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCC took 28.1s. Estimated remaining: 4h 46m 22s. Rate: 7.5 symbols/min [2025-10-13T17:31:25.197045] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:31:25.218028] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-13T17:31:25.281264] [DEBUG] [LOCAL ] BCS: Loaded 54222 existing records from primary storage. [2025-10-13T17:31:25.282585] [INFO ] [MAIN ] BCS: Loaded 54222 existing records. [2025-10-13T17:31:25.567201] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:31:25.567819] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-13T17:31:25.568175] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-13T17:31:25.574798] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-13T17:31:25.590484] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-13T17:31:25.608568] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T17:31:26.023276] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-13T17:31:26.175559] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:31:26.300603] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T17:31:26.817954] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-13T17:31:27.617928] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-13T17:31:27.669863] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T17:31:28.417967] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-13T17:31:28.595406] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T17:31:28.734483] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T17:31:29.217916] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-13T17:31:29.724352] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T17:31:30.017916] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-13T17:31:30.174082] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T17:31:30.817929] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-13T17:31:31.295763] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T17:31:31.300808] [INFO ] [REMOTE ] BCE: Full fetch complete (75553 records). [2025-10-13T17:31:31.300986] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-13T17:31:31.302078] [FATAL] [VALIDATOR ] BCE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:31:31.302208] [FATAL] [MAIN ] BCE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:31:31.302263] [WARN ] [MAIN ] BCE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:31:31.302330] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-13T17:31:31.302421] [DEBUG] [LOCAL ] BCE: No primary data file found to delete. [2025-10-13T17:31:31.302479] [INFO ] [LOCAL ] BCE: Starting deletion of derivative data. [2025-10-13T17:31:31.302709] [DEBUG] [LOCAL ] BCE: Deleted derivative data file. [2025-10-13T17:31:31.303512] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCE took 32.9s. Estimated remaining: 4h 45m 59s. Rate: 7.5 symbols/min [2025-10-13T17:31:31.497318] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:31:31.533551] [DEBUG] [LOCAL ] BCSF: Loaded 28477 existing records from primary storage. [2025-10-13T17:31:31.533890] [INFO ] [MAIN ] BCSF: Loaded 28477 existing records. [2025-10-13T17:31:31.623051] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-13T17:31:31.711250] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:31:31.711511] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-13T17:31:31.711559] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-13T17:31:31.711865] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-13T17:31:31.711935] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-13T17:31:32.069871] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:31:32.137683] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T17:31:32.417928] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-13T17:31:33.035501] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T17:31:33.204849] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T17:31:33.217944] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-13T17:31:34.017976] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-13T17:31:34.374490] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T17:31:34.817993] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-13T17:31:35.617956] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-13T17:31:35.901753] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T17:31:36.375259] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T17:31:36.417920] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-13T17:31:36.789153] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T17:31:37.217984] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-13T17:31:37.559678] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T17:31:38.017924] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-13T17:31:38.571784] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T17:31:38.817967] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-13T17:31:39.175317] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:31:39.617943] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-13T17:31:39.789960] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T17:31:40.417973] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-13T17:31:40.752230] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T17:31:41.217916] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-13T17:31:41.502340] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T17:31:42.017963] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-13T17:31:42.817917] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-13T17:31:43.213421] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T17:31:43.257335] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-13T17:31:43.617943] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-13T17:31:44.009464] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T17:31:44.417989] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-13T17:31:45.218042] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-13T17:31:45.573715] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:31:45.832887] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T17:31:46.017971] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-13T17:31:46.538195] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T17:31:46.817929] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-13T17:31:47.336160] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T17:31:47.617889] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-13T17:31:47.738109] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T17:31:48.417953] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-13T17:31:48.866799] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T17:31:49.217902] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-13T17:31:49.433922] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T17:31:50.017974] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-13T17:31:50.796758] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T17:31:50.817880] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-13T17:31:51.128470] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T17:31:51.617914] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-13T17:31:52.417961] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-13T17:31:52.712800] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T17:31:52.921936] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T17:31:52.925968] [INFO ] [REMOTE ] BCH: Full fetch complete (41345 records). [2025-10-13T17:31:52.926066] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-13T17:31:53.223024] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-13T17:31:53.308405] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-13T17:31:53.308496] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-13T17:31:53.309039] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-13T17:31:53.309104] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-13T17:31:53.310068] [DEBUG] [LOCAL ] BCH: Trimmed 41345 records to 30043 (keeping 200 days of data) [2025-10-13T17:31:53.480487] [DEBUG] [LOCAL ] BCH: Primary data saved (30043 records). [2025-10-13T17:31:53.480625] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-13T17:31:53.480741] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCH took 39.1s. Estimated remaining: 4h 47m 59s. Rate: 7.4 symbols/min [2025-10-13T17:31:53.650075] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:31:53.669886] [DEBUG] [LOCAL ] BCX: Loaded 22009 existing records from primary storage. [2025-10-13T17:31:53.670142] [INFO ] [MAIN ] BCX: Loaded 22009 existing records. [2025-10-13T17:31:53.787061] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T17:31:53.879825] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:31:53.880111] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-13T17:31:53.880167] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-13T17:31:53.880435] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-13T17:31:53.880475] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-13T17:31:54.031602] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-13T17:31:54.250090] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:31:54.817911] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-13T17:31:55.142801] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T17:31:55.145277] [INFO ] [REMOTE ] BCO: Full fetch complete (36245 records). [2025-10-13T17:31:55.145374] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-13T17:31:55.529975] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-13T17:31:55.530270] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-13T17:31:55.530813] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-13T17:31:55.530894] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-13T17:31:55.532329] [DEBUG] [LOCAL ] BCO: Trimmed 36245 records to 25559 (keeping 200 days of data) [2025-10-13T17:31:55.621667] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-13T17:31:55.663138] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-13T17:31:55.747435] [DEBUG] [LOCAL ] BCO: Primary data saved (25559 records). [2025-10-13T17:31:55.747585] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-13T17:31:55.747692] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCO took 38.3s. Estimated remaining: 4h 46m 58s. Rate: 7.4 symbols/min [2025-10-13T17:31:56.019493] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T17:31:56.418035] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-13T17:31:56.888142] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:31:57.217941] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-13T17:31:58.017900] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-13T17:31:58.352030] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T17:31:58.419132] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T17:31:58.818063] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-13T17:31:58.943171] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T17:31:59.617923] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-13T17:32:00.424875] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-13T17:32:00.445255] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T17:32:00.556386] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T17:32:00.560382] [INFO ] [REMOTE ] BCSF: Full fetch complete (39247 records). [2025-10-13T17:32:00.560469] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-13T17:32:00.946361] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-13T17:32:00.946447] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-13T17:32:00.946970] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-13T17:32:00.947032] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-13T17:32:00.948024] [DEBUG] [LOCAL ] BCSF: Trimmed 39247 records to 28213 (keeping 200 days of data) [2025-10-13T17:32:01.121958] [DEBUG] [LOCAL ] BCSF: Primary data saved (28213 records). [2025-10-13T17:32:01.122101] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-13T17:32:01.122838] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCSF took 29.8s. Estimated remaining: 4h 46m 26s. Rate: 7.4 symbols/min [2025-10-13T17:32:01.217935] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-13T17:32:01.797211] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T17:32:02.017971] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-13T17:32:02.942597] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T17:32:02.948216] [INFO ] [REMOTE ] BCS: Full fetch complete (77333 records). [2025-10-13T17:32:02.948349] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-13T17:32:03.325526] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T17:32:03.393713] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-13T17:32:03.439075] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-13T17:32:03.439220] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-13T17:32:03.440270] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-13T17:32:03.440343] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-13T17:32:03.442630] [DEBUG] [LOCAL ] BCS: Trimmed 77333 records to 53441 (keeping 200 days of data) [2025-10-13T17:32:03.785089] [DEBUG] [LOCAL ] BCS: Primary data saved (53441 records). [2025-10-13T17:32:03.785253] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-13T17:32:03.785338] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCS took 38.9s. Estimated remaining: 4h 45m 30s. Rate: 7.5 symbols/min [2025-10-13T17:32:04.648515] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T17:32:04.654880] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-13T17:32:05.519931] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T17:32:05.524387] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-13T17:32:06.549015] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T17:32:06.554080] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-13T17:32:07.644926] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T17:32:07.651065] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-13T17:32:08.560964] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T17:32:08.565301] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-13T17:32:09.419584] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T17:32:09.424371] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-13T17:32:10.429546] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T17:32:10.432145] [INFO ] [REMOTE ] BCX: Full fetch complete (33421 records). [2025-10-13T17:32:10.432258] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-13T17:32:10.432950] [FATAL] [VALIDATOR ] BCX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:32:10.433061] [FATAL] [MAIN ] BCX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:32:10.433104] [WARN ] [MAIN ] BCX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:32:10.433142] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-13T17:32:10.433197] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-10-13T17:32:10.433233] [INFO ] [LOCAL ] BCX: Starting deletion of derivative data. [2025-10-13T17:32:10.433412] [DEBUG] [LOCAL ] BCX: Deleted derivative data file. [2025-10-13T17:32:10.433550] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BCX took 17.0s. Estimated remaining: 4h 45m 10s. Rate: 7.5 symbols/min [2025-10-13T17:32:11.113494] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:11.115687] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:11.159906] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:11.184732] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:11.232514] [DEBUG] [LOCAL ] BDC: Loaded 24890 existing records from primary storage. [2025-10-13T17:32:11.233777] [INFO ] [MAIN ] BDC: Loaded 24890 existing records. [2025-10-13T17:32:11.273724] [DEBUG] [LOCAL ] BDN: Loaded 48258 existing records from primary storage. [2025-10-13T17:32:11.328833] [INFO ] [MAIN ] BDN: Loaded 48258 existing records. [2025-10-13T17:32:11.338322] [DEBUG] [LOCAL ] BDJ: Loaded 29717 existing records from primary storage. [2025-10-13T17:32:11.385606] [INFO ] [MAIN ] BDJ: Loaded 29717 existing records. [2025-10-13T17:32:11.619514] [DEBUG] [LOCAL ] BDX: Loaded 52941 existing records from primary storage. [2025-10-13T17:32:11.644795] [INFO ] [MAIN ] BDX: Loaded 52941 existing records. [2025-10-13T17:32:11.772311] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:11.938806] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-13T17:32:11.938607] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:11.994812] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-13T17:32:12.042930] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-13T17:32:12.082185] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:12.083231] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-13T17:32:12.086560] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:12.086889] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-13T17:32:12.086672] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-13T17:32:12.087261] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-13T17:32:12.108035] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-13T17:32:12.092594] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-13T17:32:12.108226] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-13T17:32:12.127573] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-13T17:32:12.107945] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-13T17:32:12.168506] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-13T17:32:12.168607] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-13T17:32:12.224070] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-13T17:32:12.369736] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-13T17:32:13.508745] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:13.553225] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-13T17:32:13.565847] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:13.577350] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-13T17:32:13.569903] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:13.589977] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-13T17:32:13.658136] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:13.658624] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-13T17:32:14.846300] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T17:32:14.852892] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-13T17:32:14.948699] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T17:32:14.953549] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-13T17:32:15.175070] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T17:32:15.185908] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-13T17:32:15.312607] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T17:32:15.322592] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-13T17:32:15.848939] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T17:32:15.854148] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-13T17:32:16.134906] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T17:32:16.141417] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-13T17:32:16.796086] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T17:32:16.801602] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-13T17:32:17.063254] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T17:32:17.146734] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T17:32:17.217977] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-13T17:32:17.359036] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T17:32:17.992753] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T17:32:18.017976] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-13T17:32:18.817921] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-13T17:32:18.952870] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T17:32:19.089589] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T17:32:19.617950] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-13T17:32:19.808091] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T17:32:20.417982] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-13T17:32:20.811832] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T17:32:21.217968] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-13T17:32:21.651958] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:32:22.017933] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-13T17:32:22.377708] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:32:22.817956] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-13T17:32:23.155046] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T17:32:23.617927] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-13T17:32:24.025497] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T17:32:24.417902] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-13T17:32:24.616047] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T17:32:25.217974] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-13T17:32:25.352467] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T17:32:26.017941] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-13T17:32:26.470373] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T17:32:26.817946] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-13T17:32:27.617928] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-13T17:32:28.115811] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T17:32:28.147916] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-13T17:32:28.417922] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-13T17:32:28.509769] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T17:32:29.217929] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-13T17:32:30.017889] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-13T17:32:30.127977] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:32:30.189568] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T17:32:30.817919] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-13T17:32:31.159762] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:32:31.162563] [INFO ] [REMOTE ] BDC: Full fetch complete (35776 records). [2025-10-13T17:32:31.162639] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-13T17:32:31.526286] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-13T17:32:31.526375] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-13T17:32:31.526883] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-13T17:32:31.526946] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-13T17:32:31.527906] [DEBUG] [LOCAL ] BDC: Trimmed 35776 records to 24544 (keeping 200 days of data) [2025-10-13T17:32:31.618351] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-13T17:32:31.693578] [DEBUG] [LOCAL ] BDC: Primary data saved (24544 records). [2025-10-13T17:32:31.693747] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-13T17:32:31.693838] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDC took 21.3s. Estimated remaining: 4h 46m 59s. Rate: 7.4 symbols/min [2025-10-13T17:32:31.865801] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:31.917607] [DEBUG] [LOCAL ] BE: Loaded 54439 existing records from primary storage. [2025-10-13T17:32:31.917948] [INFO ] [MAIN ] BE: Loaded 54439 existing records. [2025-10-13T17:32:32.086588] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T17:32:32.106766] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:32.110104] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-13T17:32:32.110267] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-13T17:32:32.110473] [INFO ] [REMOTE ] BDJ: Full fetch complete (42942 records). [2025-10-13T17:32:32.110546] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-13T17:32:32.110666] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-13T17:32:32.110733] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-13T17:32:32.428127] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-13T17:32:32.865744] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:32.896882] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-13T17:32:32.896974] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-13T17:32:32.897566] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-13T17:32:32.897609] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-13T17:32:32.898878] [DEBUG] [LOCAL ] BDJ: Trimmed 42942 records to 29388 (keeping 200 days of data) [2025-10-13T17:32:33.080995] [DEBUG] [LOCAL ] BDJ: Primary data saved (29388 records). [2025-10-13T17:32:33.081401] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-13T17:32:33.081588] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDJ took 22.6s. Estimated remaining: 4h 45m 52s. Rate: 7.4 symbols/min [2025-10-13T17:32:33.226708] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-13T17:32:33.261768] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:33.261955] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-13T17:32:33.262053] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-13T17:32:33.262334] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-13T17:32:33.262403] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-13T17:32:33.262558] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-13T17:32:33.262782] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-13T17:32:33.633815] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:33.716017] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-13T17:32:33.907534] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:32:34.017911] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-13T17:32:34.753784] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T17:32:34.821913] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-13T17:32:35.099616] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T17:32:35.141152] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-13T17:32:35.617937] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-13T17:32:36.417919] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-13T17:32:36.738379] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-13T17:32:37.217930] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-13T17:32:37.731301] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-13T17:32:38.017920] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-13T17:32:38.430807] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-13T17:32:38.817907] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-13T17:32:38.950869] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T17:32:39.618028] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-13T17:32:40.417931] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-13T17:32:40.595045] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T17:32:41.217907] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-13T17:32:41.325552] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T17:32:42.017939] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-13T17:32:42.389514] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-13T17:32:42.450200] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T17:32:42.817909] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-13T17:32:43.617888] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-13T17:32:43.969587] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T17:32:44.086510] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T17:32:44.100231] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T17:32:44.417931] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-13T17:32:44.834001] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-13T17:32:45.217967] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-13T17:32:46.017937] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-13T17:32:46.817913] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-13T17:32:47.183605] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T17:32:47.617913] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-13T17:32:48.168209] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-13T17:32:48.417985] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-13T17:32:48.485670] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T17:32:48.798758] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-13T17:32:49.094088] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T17:32:49.217955] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-13T17:32:50.017963] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-13T17:32:50.817936] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-13T17:32:51.015211] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T17:32:51.618044] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-13T17:32:51.976699] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T17:32:52.416638] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:32:52.426445] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-13T17:32:52.667664] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-13T17:32:53.217898] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-13T17:32:53.335797] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T17:32:54.017947] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-13T17:32:54.253134] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-13T17:32:54.711049] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T17:32:54.716681] [INFO ] [REMOTE ] BDX: Full fetch complete (75442 records). [2025-10-13T17:32:54.716836] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-13T17:32:54.823165] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-13T17:32:55.124045] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-13T17:32:55.124145] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-13T17:32:55.124973] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-13T17:32:55.125042] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-13T17:32:55.129123] [DEBUG] [LOCAL ] BDX: Trimmed 75442 records to 52183 (keeping 200 days of data) [2025-10-13T17:32:55.354761] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T17:32:55.490534] [DEBUG] [LOCAL ] BDX: Primary data saved (52183 records). [2025-10-13T17:32:55.490721] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-13T17:32:55.492107] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDX took 45.1s. Estimated remaining: 4h 47m 49s. Rate: 7.4 symbols/min [2025-10-13T17:32:55.623167] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-13T17:32:55.668142] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:55.723638] [DEBUG] [LOCAL ] BEKE: Loaded 54007 existing records from primary storage. [2025-10-13T17:32:55.724015] [INFO ] [MAIN ] BEKE: Loaded 54007 existing records. [2025-10-13T17:32:55.905436] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:55.905724] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-13T17:32:55.905782] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-13T17:32:55.906256] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-13T17:32:55.906317] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-13T17:32:56.282746] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:56.417925] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-13T17:32:57.218021] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-13T17:32:57.245463] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T17:32:57.250581] [INFO ] [REMOTE ] BDN: Full fetch complete (69161 records). [2025-10-13T17:32:57.250739] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-13T17:32:57.649768] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-13T17:32:57.649867] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-13T17:32:57.650737] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-13T17:32:57.650815] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-13T17:32:57.652308] [DEBUG] [LOCAL ] BDN: Trimmed 69161 records to 47607 (keeping 200 days of data) [2025-10-13T17:32:57.940497] [DEBUG] [LOCAL ] BDN: Primary data saved (47607 records). [2025-10-13T17:32:57.940632] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-13T17:32:57.940791] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BDN took 47.5s. Estimated remaining: 4h 46m 52s. Rate: 7.4 symbols/min [2025-10-13T17:32:58.030832] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-13T17:32:58.112907] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:58.163884] [DEBUG] [LOCAL ] BEN: Loaded 53824 existing records from primary storage. [2025-10-13T17:32:58.164213] [INFO ] [MAIN ] BEN: Loaded 53824 existing records. [2025-10-13T17:32:58.348359] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:58.348766] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-13T17:32:58.348863] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-13T17:32:58.349383] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-13T17:32:58.349528] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-13T17:32:58.602278] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-13T17:32:58.675458] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T17:32:58.682353] [INFO ] [REMOTE ] BEDU: Full fetch complete (1388 records). [2025-10-13T17:32:58.701438] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-13T17:32:58.824076] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-13T17:32:58.875526] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:32:58.970063] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-13T17:32:58.970352] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:32:58.970436] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:32:58.970532] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-13T17:32:58.970620] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-13T17:32:58.970750] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-13T17:32:58.970820] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-13T17:32:58.970901] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 25.9s. Estimated remaining: 4h 45m 42s. Rate: 7.4 symbols/min [2025-10-13T17:32:59.141746] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:32:59.180504] [DEBUG] [LOCAL ] BEP: Loaded 39584 existing records from primary storage. [2025-10-13T17:32:59.180815] [INFO ] [MAIN ] BEP: Loaded 39584 existing records. [2025-10-13T17:32:59.360318] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:32:59.360796] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-13T17:32:59.360928] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-13T17:32:59.361457] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-13T17:32:59.361533] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-13T17:32:59.502894] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-13T17:32:59.623133] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-13T17:32:59.781781] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:00.417964] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-13T17:33:00.728125] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T17:33:01.217953] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-13T17:33:01.429938] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:33:02.017950] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-13T17:33:02.220908] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T17:33:02.818022] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-13T17:33:03.151487] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T17:33:03.617954] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-13T17:33:03.671662] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:33:04.021039] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T17:33:04.417930] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-13T17:33:05.217965] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-13T17:33:05.507301] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-13T17:33:05.778338] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:33:06.017942] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-13T17:33:06.753633] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T17:33:06.818051] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-13T17:33:07.618044] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-13T17:33:08.336870] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T17:33:08.412820] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-13T17:33:08.423181] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-13T17:33:09.217931] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-13T17:33:09.484790] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T17:33:09.954519] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T17:33:10.017906] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-13T17:33:10.818015] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-13T17:33:11.515110] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T17:33:11.562804] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-13T17:33:11.617944] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-13T17:33:12.379116] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:33:12.417908] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-13T17:33:12.899249] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T17:33:13.217984] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-13T17:33:14.017981] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-13T17:33:14.817926] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-13T17:33:14.984393] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-13T17:33:14.990714] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-13T17:33:14.990922] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-13T17:33:15.234426] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-13T17:33:15.452031] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-13T17:33:15.452288] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-13T17:33:15.453434] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-13T17:33:15.453676] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-13T17:33:15.455619] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 53661 (keeping 200 days of data) [2025-10-13T17:33:15.593620] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T17:33:15.618221] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-13T17:33:15.838589] [DEBUG] [LOCAL ] BE: Primary data saved (53661 records). [2025-10-13T17:33:15.838828] [INFO ] [MAIN ] BE: Full history saved. [2025-10-13T17:33:15.838948] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BE took 44.1s. Estimated remaining: 4h 46m 50s. Rate: 7.4 symbols/min [2025-10-13T17:33:16.021926] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:16.069558] [DEBUG] [LOCAL ] BEPC: Loaded 47216 existing records from primary storage. [2025-10-13T17:33:16.069983] [INFO ] [MAIN ] BEPC: Loaded 47216 existing records. [2025-10-13T17:33:16.259738] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:16.260185] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-13T17:33:16.260349] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-13T17:33:16.260943] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-13T17:33:16.261010] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-13T17:33:16.433706] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-13T17:33:16.518450] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T17:33:16.659789] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:17.125754] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T17:33:17.217930] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-13T17:33:18.017911] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-13T17:33:18.385131] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T17:33:18.809440] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:33:18.819322] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-13T17:33:19.617934] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-13T17:33:19.829019] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T17:33:20.425957] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-13T17:33:20.445376] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:33:21.217939] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-13T17:33:21.395870] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T17:33:21.974076] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:33:22.017905] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-13T17:33:22.737235] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T17:33:22.817882] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-13T17:33:23.527563] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T17:33:23.617906] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-13T17:33:24.396094] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T17:33:24.417884] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-13T17:33:24.754019] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:33:24.758758] [INFO ] [REMOTE ] BEP: Full fetch complete (58828 records). [2025-10-13T17:33:24.758869] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-13T17:33:25.144204] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-13T17:33:25.144361] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-13T17:33:25.145425] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-13T17:33:25.145494] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-13T17:33:25.147234] [DEBUG] [LOCAL ] BEP: Trimmed 58828 records to 38934 (keeping 200 days of data) [2025-10-13T17:33:25.238898] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-13T17:33:25.423204] [DEBUG] [LOCAL ] BEP: Primary data saved (38934 records). [2025-10-13T17:33:25.423396] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-13T17:33:25.424119] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 26.5s. Estimated remaining: 4h 46m 55s. Rate: 7.4 symbols/min [2025-10-13T17:33:25.596371] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:25.607459] [DEBUG] [LOCAL ] BEPH: Loaded 5407 existing records from primary storage. [2025-10-13T17:33:25.607767] [INFO ] [MAIN ] BEPH: Loaded 5407 existing records. [2025-10-13T17:33:25.783920] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:25.784231] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-13T17:33:25.784281] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-13T17:33:25.784490] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-13T17:33:25.784547] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-13T17:33:26.026006] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-13T17:33:26.150370] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:26.556760] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T17:33:26.817988] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-13T17:33:27.146977] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T17:33:27.617949] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-13T17:33:27.892094] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T17:33:28.080777] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T17:33:28.417931] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-13T17:33:29.110274] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T17:33:29.217908] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-13T17:33:29.476936] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T17:33:30.017908] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-13T17:33:30.695193] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T17:33:30.817922] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-13T17:33:31.617977] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-13T17:33:31.936825] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T17:33:32.123639] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T17:33:32.182727] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T17:33:32.417924] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-13T17:33:32.945244] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-13T17:33:33.217926] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-13T17:33:33.897069] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T17:33:34.017958] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-13T17:33:34.818021] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-13T17:33:35.617949] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-13T17:33:35.811506] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T17:33:35.817083] [INFO ] [REMOTE ] BEKE: Full fetch complete (77182 records). [2025-10-13T17:33:35.817193] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-13T17:33:36.198493] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-13T17:33:36.198580] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-13T17:33:36.199454] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-13T17:33:36.199519] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-13T17:33:36.201116] [DEBUG] [LOCAL ] BEKE: Trimmed 77182 records to 53220 (keeping 200 days of data) [2025-10-13T17:33:36.418383] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-13T17:33:36.520855] [DEBUG] [LOCAL ] BEKE: Primary data saved (53220 records). [2025-10-13T17:33:36.521007] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-13T17:33:36.521092] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEKE took 41.0s. Estimated remaining: 4h 47m 13s. Rate: 7.4 symbols/min [2025-10-13T17:33:36.692784] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:36.698290] [DEBUG] [LOCAL ] BEPI: Loaded 3641 existing records from primary storage. [2025-10-13T17:33:36.698460] [INFO ] [MAIN ] BEPI: Loaded 3641 existing records. [2025-10-13T17:33:36.911552] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-13T17:33:36.910483] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:36.917412] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-13T17:33:36.917518] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-13T17:33:36.917973] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-13T17:33:36.918062] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-13T17:33:36.930129] [INFO ] [REMOTE ] BEN: Full fetch complete (76913 records). [2025-10-13T17:33:36.950849] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-13T17:33:37.294046] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T17:33:37.398238] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-13T17:33:37.655403] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:37.730343] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-13T17:33:37.786245] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-13T17:33:37.786430] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-13T17:33:37.787301] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-13T17:33:37.787387] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-13T17:33:37.788977] [DEBUG] [LOCAL ] BEN: Trimmed 76913 records to 53109 (keeping 200 days of data) [2025-10-13T17:33:38.017783] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T17:33:38.018210] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-13T17:33:38.127191] [DEBUG] [LOCAL ] BEN: Primary data saved (53109 records). [2025-10-13T17:33:38.127339] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-13T17:33:38.127420] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEN took 40.2s. Estimated remaining: 4h 46m 9s. Rate: 7.4 symbols/min [2025-10-13T17:33:38.292292] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:38.296944] [DEBUG] [LOCAL ] BEPJ: Loaded 3156 existing records from primary storage. [2025-10-13T17:33:38.297120] [INFO ] [MAIN ] BEPJ: Loaded 3156 existing records. [2025-10-13T17:33:38.471197] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:38.471418] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-13T17:33:38.471463] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-13T17:33:38.471638] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-13T17:33:38.471731] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-13T17:33:38.823094] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-13T17:33:38.864508] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:39.550759] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T17:33:39.617926] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-13T17:33:39.766402] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T17:33:40.145949] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-13T17:33:40.417936] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-13T17:33:41.217975] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-13T17:33:41.836234] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T17:33:42.017910] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-13T17:33:42.073825] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T17:33:42.588787] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T17:33:42.818053] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-13T17:33:43.617931] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-13T17:33:44.167154] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T17:33:44.357415] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T17:33:44.417961] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-13T17:33:44.891329] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T17:33:45.217926] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-13T17:33:46.017931] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-13T17:33:46.466495] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T17:33:46.817935] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-13T17:33:46.855827] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T17:33:46.861749] [INFO ] [REMOTE ] BEPC: Full fetch complete (68340 records). [2025-10-13T17:33:46.861867] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-13T17:33:46.862696] [FATAL] [VALIDATOR ] BEPC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:33:46.862788] [FATAL] [MAIN ] BEPC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:33:46.862831] [WARN ] [MAIN ] BEPC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:33:46.862870] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-13T17:33:46.862925] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-13T17:33:46.862959] [INFO ] [LOCAL ] BEPC: Starting deletion of derivative data. [2025-10-13T17:33:46.863144] [DEBUG] [LOCAL ] BEPC: Deleted derivative data file. [2025-10-13T17:33:46.863238] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPC took 31.0s. Estimated remaining: 4h 46m 6s. Rate: 7.4 symbols/min [2025-10-13T17:33:47.031361] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:47.065124] [DEBUG] [LOCAL ] BFAM: Loaded 33979 existing records from primary storage. [2025-10-13T17:33:47.065426] [INFO ] [MAIN ] BFAM: Loaded 33979 existing records. [2025-10-13T17:33:47.241473] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:47.241713] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-13T17:33:47.241768] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-13T17:33:47.242143] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-13T17:33:47.242198] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-13T17:33:47.530893] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-13T17:33:47.609035] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:47.617884] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-13T17:33:48.417898] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-13T17:33:49.025921] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T17:33:49.025770] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T17:33:49.217978] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-13T17:33:49.646340] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T17:33:50.017969] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-13T17:33:50.605195] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T17:33:50.817977] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-13T17:33:51.306096] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-13T17:33:51.617920] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-13T17:33:52.346087] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T17:33:52.347326] [INFO ] [REMOTE ] BEPH: Full fetch complete (7621 records). [2025-10-13T17:33:52.347398] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-13T17:33:52.423210] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-13T17:33:52.762100] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-13T17:33:52.762194] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-13T17:33:52.762454] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-13T17:33:52.762495] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-13T17:33:52.762945] [DEBUG] [LOCAL ] BEPH: Trimmed 7621 records to 5283 (keeping 200 days of data) [2025-10-13T17:33:52.800879] [DEBUG] [LOCAL ] BEPH: Primary data saved (5283 records). [2025-10-13T17:33:52.801026] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-13T17:33:52.801115] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPH took 27.4s. Estimated remaining: 4h 45m 40s. Rate: 7.4 symbols/min [2025-10-13T17:33:52.968566] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-13T17:33:53.006194] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:33:53.051871] [DEBUG] [LOCAL ] BFH: Loaded 42048 existing records from primary storage. [2025-10-13T17:33:53.052228] [INFO ] [MAIN ] BFH: Loaded 42048 existing records. [2025-10-13T17:33:53.228942] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-13T17:33:53.235614] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:33:53.237174] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-13T17:33:53.237231] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-13T17:33:53.237704] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-13T17:33:53.237773] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-13T17:33:53.652728] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:33:53.714276] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T17:33:54.017954] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-13T17:33:54.509169] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T17:33:54.817951] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-13T17:33:55.340509] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-13T17:33:55.617939] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-13T17:33:56.417928] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-13T17:33:56.830292] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T17:33:56.978541] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T17:33:57.218019] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-13T17:33:57.820464] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T17:33:58.018026] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-13T17:33:58.817939] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-13T17:33:59.277987] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T17:33:59.604493] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:33:59.617880] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-13T17:34:00.418068] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-13T17:34:01.007367] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T17:34:01.217907] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-13T17:34:01.285134] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:34:01.734988] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T17:34:01.735820] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4471 records). [2025-10-13T17:34:01.735890] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-13T17:34:02.023271] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-13T17:34:02.138743] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-13T17:34:02.138834] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-13T17:34:02.138986] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-13T17:34:02.139048] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-13T17:34:02.139415] [DEBUG] [LOCAL ] BEPJ: Trimmed 4471 records to 3122 (keeping 200 days of data) [2025-10-13T17:34:02.159229] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3122 records). [2025-10-13T17:34:02.159367] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-13T17:34:02.159528] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BEPJ took 24.0s. Estimated remaining: 4h 45m 43s. Rate: 7.4 symbols/min [2025-10-13T17:34:02.331076] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:02.345838] [DEBUG] [LOCAL ] BFK: Loaded 13833 existing records from primary storage. [2025-10-13T17:34:02.346044] [INFO ] [MAIN ] BFK: Loaded 13833 existing records. [2025-10-13T17:34:02.523320] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:02.523619] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-13T17:34:02.523700] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-13T17:34:02.523958] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-13T17:34:02.524026] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-13T17:34:02.823037] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-13T17:34:02.877580] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:03.551080] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T17:34:03.605892] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T17:34:03.617894] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-13T17:34:04.417961] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-13T17:34:04.741497] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T17:34:05.217976] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-13T17:34:05.796442] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:34:06.017904] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-13T17:34:06.110828] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T17:34:06.817924] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-13T17:34:07.298388] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:34:07.372580] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T17:34:07.617926] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-13T17:34:08.417982] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-13T17:34:09.012001] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T17:34:09.217938] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-13T17:34:09.875459] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T17:34:10.017927] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-13T17:34:10.182566] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T17:34:10.578135] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T17:34:10.818030] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-13T17:34:11.617927] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-13T17:34:12.228153] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T17:34:12.417896] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-13T17:34:12.519217] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T17:34:13.217919] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-13T17:34:13.745745] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T17:34:13.761969] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-13T17:34:14.017923] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-13T17:34:14.817940] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-13T17:34:15.092990] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-13T17:34:15.617929] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-13T17:34:16.165274] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T17:34:16.417961] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-13T17:34:16.451137] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T17:34:16.884628] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T17:34:17.217948] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-13T17:34:17.753788] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T17:34:17.754829] [INFO ] [REMOTE ] BEPI: Full fetch complete (4797 records). [2025-10-13T17:34:17.754905] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-13T17:34:18.023211] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-13T17:34:18.140469] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-13T17:34:18.140561] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-13T17:34:18.140814] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-13T17:34:18.140877] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-13T17:34:18.141296] [DEBUG] [LOCAL ] BEPI: Trimmed 4797 records to 3617 (keeping 200 days of data) [2025-10-13T17:34:18.165585] [DEBUG] [LOCAL ] BEPI: Primary data saved (3617 records). [2025-10-13T17:34:18.165784] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-13T17:34:18.165886] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BEPI took 41.6s. Estimated remaining: 4h 46m 41s. Rate: 7.4 symbols/min [2025-10-13T17:34:18.347538] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:18.401509] [DEBUG] [LOCAL ] BFLY: Loaded 52599 existing records from primary storage. [2025-10-13T17:34:18.401992] [INFO ] [MAIN ] BFLY: Loaded 52599 existing records. [2025-10-13T17:34:18.619170] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:18.619437] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-13T17:34:18.619488] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-13T17:34:18.619917] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-13T17:34:18.619979] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-13T17:34:18.823121] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-13T17:34:19.002216] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:19.618049] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-13T17:34:19.755077] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T17:34:19.866332] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T17:34:20.418038] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-13T17:34:21.217965] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T17:34:21.223115] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-13T17:34:21.443192] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T17:34:22.017945] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-13T17:34:22.200082] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T17:34:22.817938] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-13T17:34:23.294240] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T17:34:23.617947] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-13T17:34:24.417949] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-13T17:34:24.468137] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:34:25.125089] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:34:25.217937] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-13T17:34:25.298985] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T17:34:26.017913] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-13T17:34:26.716624] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T17:34:26.817957] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-13T17:34:27.617944] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-13T17:34:27.786523] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T17:34:28.331634] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T17:34:28.335422] [INFO ] [REMOTE ] BFAM: Full fetch complete (47021 records). [2025-10-13T17:34:28.335504] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-13T17:34:28.423527] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-13T17:34:28.706028] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-13T17:34:28.706110] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-13T17:34:28.706612] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-13T17:34:28.706704] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-13T17:34:28.707620] [DEBUG] [LOCAL ] BFAM: Trimmed 47021 records to 33707 (keeping 200 days of data) [2025-10-13T17:34:28.904895] [DEBUG] [LOCAL ] BFAM: Primary data saved (33707 records). [2025-10-13T17:34:28.905029] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-13T17:34:28.905122] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFAM took 42.0s. Estimated remaining: 4h 46m 55s. Rate: 7.4 symbols/min [2025-10-13T17:34:29.072431] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:29.097395] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T17:34:29.112531] [DEBUG] [LOCAL ] BFS: Loaded 9495 existing records from primary storage. [2025-10-13T17:34:29.112762] [INFO ] [MAIN ] BFS: Loaded 9495 existing records. [2025-10-13T17:34:29.223171] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-13T17:34:29.289703] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:29.289884] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-13T17:34:29.289949] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-13T17:34:29.290132] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-13T17:34:29.290188] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-13T17:34:29.633244] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:30.017960] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-13T17:34:30.112269] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T17:34:30.113940] [INFO ] [REMOTE ] BFK: Full fetch complete (18912 records). [2025-10-13T17:34:30.114028] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-13T17:34:30.424246] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-13T17:34:30.514948] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-13T17:34:30.515020] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-13T17:34:30.515331] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-13T17:34:30.515369] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-13T17:34:30.515916] [DEBUG] [LOCAL ] BFK: Trimmed 18912 records to 13519 (keeping 200 days of data) [2025-10-13T17:34:30.601683] [DEBUG] [LOCAL ] BFK: Primary data saved (13519 records). [2025-10-13T17:34:30.601812] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-13T17:34:30.601885] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFK took 28.4s. Estimated remaining: 4h 45m 53s. Rate: 7.4 symbols/min [2025-10-13T17:34:30.773628] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:30.785922] [DEBUG] [LOCAL ] BFZ: Loaded 12034 existing records from primary storage. [2025-10-13T17:34:30.786118] [INFO ] [MAIN ] BFZ: Loaded 12034 existing records. [2025-10-13T17:34:30.827830] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-13T17:34:30.961218] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:30.961431] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-13T17:34:30.961476] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-13T17:34:30.961637] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-13T17:34:30.961726] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-13T17:34:31.312838] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:31.332486] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T17:34:31.617907] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-13T17:34:32.417958] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-13T17:34:32.651202] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:34:33.069951] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T17:34:33.217901] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-13T17:34:33.358232] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T17:34:34.017976] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-13T17:34:34.685358] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T17:34:34.817958] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-13T17:34:35.042804] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T17:34:35.564468] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T17:34:35.617954] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-13T17:34:36.418032] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-13T17:34:36.665888] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T17:34:37.217965] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-13T17:34:38.001605] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T17:34:38.017885] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-13T17:34:38.063710] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T17:34:38.755706] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T17:34:38.818141] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-13T17:34:39.617934] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-13T17:34:39.656865] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T17:34:40.418024] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-13T17:34:40.447248] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T17:34:41.215317] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T17:34:41.218396] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-13T17:34:41.849541] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T17:34:42.017910] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-13T17:34:42.817936] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-13T17:34:43.389004] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T17:34:43.394305] [INFO ] [REMOTE ] BFH: Full fetch complete (59725 records). [2025-10-13T17:34:43.394501] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-13T17:34:43.625637] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-13T17:34:43.787251] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-13T17:34:43.787338] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-13T17:34:43.788057] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-13T17:34:43.788121] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-13T17:34:43.789384] [DEBUG] [LOCAL ] BFH: Trimmed 59725 records to 41480 (keeping 200 days of data) [2025-10-13T17:34:44.043900] [DEBUG] [LOCAL ] BFH: Primary data saved (41480 records). [2025-10-13T17:34:44.044034] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-13T17:34:44.044774] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFH took 51.2s. Estimated remaining: 4h 46m 29s. Rate: 7.4 symbols/min [2025-10-13T17:34:44.224233] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:44.281144] [DEBUG] [LOCAL ] BG: Loaded 51146 existing records from primary storage. [2025-10-13T17:34:44.281578] [INFO ] [MAIN ] BG: Loaded 51146 existing records. [2025-10-13T17:34:44.433525] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-13T17:34:44.485030] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:44.495375] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-13T17:34:44.494924] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-13T17:34:44.498505] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-13T17:34:44.499913] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-13T17:34:44.500139] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-13T17:34:44.810064] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T17:34:44.930705] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:45.218022] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-13T17:34:45.234343] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-13T17:34:46.017935] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-13T17:34:46.817932] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-13T17:34:46.870093] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T17:34:46.998414] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T17:34:47.617908] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-13T17:34:47.692255] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T17:34:48.417944] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-13T17:34:49.217905] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-13T17:34:49.414042] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:34:49.897466] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T17:34:50.017899] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-13T17:34:50.190074] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T17:34:50.817925] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-13T17:34:51.617946] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-13T17:34:52.012031] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-13T17:34:52.018129] [INFO ] [REMOTE ] BFLY: Full fetch complete (75322 records). [2025-10-13T17:34:52.018318] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-13T17:34:52.438298] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-13T17:34:52.497585] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-13T17:34:52.498138] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-13T17:34:52.499369] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-13T17:34:52.499532] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-13T17:34:52.508241] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T17:34:52.512614] [DEBUG] [LOCAL ] BFLY: Trimmed 75322 records to 51828 (keeping 200 days of data) [2025-10-13T17:34:52.629001] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T17:34:52.862681] [DEBUG] [LOCAL ] BFLY: Primary data saved (51828 records). [2025-10-13T17:34:52.862883] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-13T17:34:52.862985] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFLY took 34.7s. Estimated remaining: 4h 46m 27s. Rate: 7.4 symbols/min [2025-10-13T17:34:53.034742] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:53.057903] [DEBUG] [LOCAL ] BGB: Loaded 18164 existing records from primary storage. [2025-10-13T17:34:53.058274] [INFO ] [MAIN ] BGB: Loaded 18164 existing records. [2025-10-13T17:34:53.218476] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-13T17:34:53.240597] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:53.241805] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-13T17:34:53.241861] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-13T17:34:53.242120] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-13T17:34:53.242177] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-13T17:34:53.429605] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T17:34:53.507591] [INFO ] [REMOTE ] BFZ: Full fetch complete (17457 records). [2025-10-13T17:34:53.537290] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-13T17:34:53.755145] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:53.893010] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T17:34:54.024110] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-13T17:34:54.056587] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-13T17:34:54.056720] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-13T17:34:54.057239] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-13T17:34:54.057306] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-13T17:34:54.058151] [DEBUG] [LOCAL ] BFZ: Trimmed 17457 records to 11930 (keeping 200 days of data) [2025-10-13T17:34:54.137051] [DEBUG] [LOCAL ] BFZ: Primary data saved (11930 records). [2025-10-13T17:34:54.137256] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-13T17:34:54.137359] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFZ took 23.5s. Estimated remaining: 4h 45m 22s. Rate: 7.4 symbols/min [2025-10-13T17:34:54.318468] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:34:54.338218] [DEBUG] [LOCAL ] BGH: Loaded 17497 existing records from primary storage. [2025-10-13T17:34:54.338550] [INFO ] [MAIN ] BGH: Loaded 17497 existing records. [2025-10-13T17:34:54.527921] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:34:54.528258] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-13T17:34:54.528311] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-13T17:34:54.528534] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-13T17:34:54.528593] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-13T17:34:54.823131] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-13T17:34:54.844415] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T17:34:54.957309] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:34:55.617935] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-13T17:34:56.417943] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-13T17:34:56.485444] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T17:34:56.555977] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T17:34:57.217927] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-13T17:34:57.302251] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T17:34:57.862615] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T17:34:58.017973] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-13T17:34:58.639865] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T17:34:58.817957] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-13T17:34:59.617916] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-13T17:34:59.637044] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T17:35:00.418031] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-13T17:35:00.526841] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-13T17:35:01.217981] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-13T17:35:02.017971] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-13T17:35:02.291004] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T17:35:02.361831] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:35:02.817973] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-13T17:35:03.047738] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T17:35:03.617962] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-13T17:35:04.417915] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-13T17:35:04.453712] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T17:35:04.580845] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T17:35:05.217977] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-13T17:35:05.341426] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T17:35:06.018006] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-13T17:35:06.817935] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-13T17:35:06.978902] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T17:35:07.025602] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T17:35:07.617894] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-13T17:35:07.728609] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T17:35:08.417935] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-13T17:35:09.217903] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-13T17:35:09.250297] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T17:35:09.505567] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T17:35:09.820295] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T17:35:09.822046] [INFO ] [REMOTE ] BFS: Full fetch complete (12879 records). [2025-10-13T17:35:09.822118] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-13T17:35:10.027507] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-13T17:35:10.210473] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-13T17:35:10.210557] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-13T17:35:10.211010] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-13T17:35:10.211075] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-13T17:35:10.211582] [DEBUG] [LOCAL ] BFS: Trimmed 12879 records to 9473 (keeping 200 days of data) [2025-10-13T17:35:10.269331] [DEBUG] [LOCAL ] BFS: Primary data saved (9473 records). [2025-10-13T17:35:10.269469] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-13T17:35:10.269550] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BFS took 41.4s. Estimated remaining: 4h 46m 20s. Rate: 7.4 symbols/min [2025-10-13T17:35:10.448925] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:10.462850] [DEBUG] [LOCAL ] BGR: Loaded 13729 existing records from primary storage. [2025-10-13T17:35:10.463086] [INFO ] [MAIN ] BGR: Loaded 13729 existing records. [2025-10-13T17:35:10.645974] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:10.646217] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-13T17:35:10.646265] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-13T17:35:10.646472] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-13T17:35:10.646529] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-13T17:35:10.822466] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-13T17:35:11.041801] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:11.054812] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:35:11.617919] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-13T17:35:12.417965] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-13T17:35:12.568393] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T17:35:12.942284] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T17:35:13.015744] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T17:35:13.217945] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-13T17:35:14.017960] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-13T17:35:14.286240] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T17:35:14.772476] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T17:35:14.817953] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-13T17:35:15.617941] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-13T17:35:15.640314] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T17:35:16.417982] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-13T17:35:16.573219] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T17:35:17.217939] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-13T17:35:18.017914] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-13T17:35:18.063915] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T17:35:18.272724] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T17:35:18.573948] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T17:35:18.817961] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-13T17:35:19.625400] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-13T17:35:19.626680] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T17:35:20.417934] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-13T17:35:21.217916] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-13T17:35:21.509987] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T17:35:21.507414] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:35:21.526342] [INFO ] [REMOTE ] BGB: Full fetch complete (27003 records). [2025-10-13T17:35:21.526515] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-13T17:35:21.901847] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-13T17:35:21.902079] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-13T17:35:21.902691] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-13T17:35:21.902753] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-13T17:35:21.903469] [DEBUG] [LOCAL ] BGB: Trimmed 27003 records to 18070 (keeping 200 days of data) [2025-10-13T17:35:22.013085] [DEBUG] [LOCAL ] BGB: Primary data saved (18070 records). [2025-10-13T17:35:22.013237] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-13T17:35:22.013319] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BGB took 29.2s. Estimated remaining: 4h 46m 41s. Rate: 7.4 symbols/min [2025-10-13T17:35:22.024268] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-13T17:35:22.185071] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T17:35:22.225271] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:22.275829] [DEBUG] [LOCAL ] BGS: Loaded 51214 existing records from primary storage. [2025-10-13T17:35:22.276215] [INFO ] [MAIN ] BGS: Loaded 51214 existing records. [2025-10-13T17:35:22.457334] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:22.457827] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-13T17:35:22.457896] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-13T17:35:22.458301] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-13T17:35:22.458359] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-13T17:35:22.801332] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:22.817925] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-13T17:35:23.130464] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T17:35:23.617984] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-13T17:35:24.390785] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T17:35:24.417891] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-13T17:35:24.562518] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T17:35:25.217914] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-13T17:35:25.906584] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T17:35:26.017951] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-13T17:35:26.085246] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-13T17:35:26.817927] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-13T17:35:27.568759] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T17:35:27.617879] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-13T17:35:27.679578] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T17:35:27.682244] [INFO ] [REMOTE ] BGH: Full fetch complete (22782 records). [2025-10-13T17:35:27.682314] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-13T17:35:28.037947] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-13T17:35:28.038094] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-13T17:35:28.038540] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-13T17:35:28.038581] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-13T17:35:28.039209] [DEBUG] [LOCAL ] BGH: Trimmed 22782 records to 17259 (keeping 200 days of data) [2025-10-13T17:35:28.146020] [DEBUG] [LOCAL ] BGH: Primary data saved (17259 records). [2025-10-13T17:35:28.146161] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-13T17:35:28.146244] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGH took 34.0s. Estimated remaining: 4h 46m 16s. Rate: 7.4 symbols/min [2025-10-13T17:35:28.309413] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:28.317739] [DEBUG] [LOCAL ] BGSF: Loaded 7869 existing records from primary storage. [2025-10-13T17:35:28.317936] [INFO ] [MAIN ] BGSF: Loaded 7869 existing records. [2025-10-13T17:35:28.418076] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-13T17:35:28.497560] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:28.497813] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-13T17:35:28.497862] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-13T17:35:28.498051] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-13T17:35:28.498106] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-13T17:35:28.842571] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:29.091178] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T17:35:29.217973] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-13T17:35:30.017958] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-13T17:35:30.258860] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T17:35:30.264423] [INFO ] [REMOTE ] BG: Full fetch complete (72751 records). [2025-10-13T17:35:30.264556] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-13T17:35:30.670737] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-13T17:35:30.670966] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-13T17:35:30.672037] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-13T17:35:30.672117] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-13T17:35:30.674078] [DEBUG] [LOCAL ] BG: Trimmed 72751 records to 50492 (keeping 200 days of data) [2025-10-13T17:35:30.864284] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-13T17:35:30.953435] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:35:30.952553] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T17:35:31.058602] [DEBUG] [LOCAL ] BG: Primary data saved (50492 records). [2025-10-13T17:35:31.058816] [INFO ] [MAIN ] BG: Full history saved. [2025-10-13T17:35:31.059686] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BG took 47.0s. Estimated remaining: 4h 45m 26s. Rate: 7.4 symbols/min [2025-10-13T17:35:31.238063] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:31.259421] [DEBUG] [LOCAL ] BGT: Loaded 16808 existing records from primary storage. [2025-10-13T17:35:31.259789] [INFO ] [MAIN ] BGT: Loaded 16808 existing records. [2025-10-13T17:35:31.449887] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:31.450138] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-13T17:35:31.450188] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-13T17:35:31.450442] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-13T17:35:31.450499] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-13T17:35:31.554045] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T17:35:31.630779] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-13T17:35:31.812526] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:32.417886] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-13T17:35:32.471459] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T17:35:33.217966] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-13T17:35:33.960464] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T17:35:34.017963] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-13T17:35:34.164138] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T17:35:34.754537] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T17:35:34.817923] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-13T17:35:35.617928] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-13T17:35:35.874623] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T17:35:36.417948] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-13T17:35:37.219504] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-13T17:35:37.223385] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T17:35:37.246122] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T17:35:38.013923] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T17:35:38.017870] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-13T17:35:38.817913] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-13T17:35:38.972758] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T17:35:39.618054] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-13T17:35:39.707067] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T17:35:40.417902] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-13T17:35:41.217963] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-13T17:35:41.261837] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T17:35:41.263867] [INFO ] [REMOTE ] BGR: Full fetch complete (20074 records). [2025-10-13T17:35:41.264086] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-13T17:35:41.646982] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T17:35:41.740231] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-13T17:35:41.740316] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-13T17:35:41.740758] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-13T17:35:41.740825] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-13T17:35:41.741416] [DEBUG] [LOCAL ] BGR: Trimmed 20074 records to 13557 (keeping 200 days of data) [2025-10-13T17:35:41.825583] [DEBUG] [LOCAL ] BGR: Primary data saved (13557 records). [2025-10-13T17:35:41.825760] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-13T17:35:41.825854] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGR took 31.6s. Estimated remaining: 4h 45m 39s. Rate: 7.4 symbols/min [2025-10-13T17:35:42.014188] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:42.019743] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-13T17:35:42.032940] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:35:42.047933] [DEBUG] [LOCAL ] BGX: Loaded 11399 existing records from primary storage. [2025-10-13T17:35:42.048199] [INFO ] [MAIN ] BGX: Loaded 11399 existing records. [2025-10-13T17:35:42.225684] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:42.225960] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-13T17:35:42.226013] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-13T17:35:42.226203] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-13T17:35:42.226259] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-13T17:35:42.580068] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:42.704490] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-13T17:35:42.817898] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-13T17:35:43.617899] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-13T17:35:43.770416] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T17:35:44.417969] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-13T17:35:44.574949] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T17:35:45.217953] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-13T17:35:46.017908] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-13T17:35:46.156148] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T17:35:46.294127] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T17:35:46.748604] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T17:35:46.817919] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-13T17:35:47.204684] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-13T17:35:47.617929] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-13T17:35:48.417903] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-13T17:35:48.687387] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T17:35:49.217941] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-13T17:35:50.017901] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-13T17:35:50.208112] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T17:35:50.207434] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T17:35:50.580865] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T17:35:50.817920] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-13T17:35:51.621323] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-13T17:35:51.623579] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T17:35:52.171059] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-13T17:35:52.417968] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-13T17:35:53.217965] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-13T17:35:53.959391] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T17:35:54.006331] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T17:35:54.011879] [INFO ] [REMOTE ] BGS: Full fetch complete (72475 records). [2025-10-13T17:35:54.012088] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-13T17:35:54.024269] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-13T17:35:54.418701] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-13T17:35:54.418802] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-13T17:35:54.419581] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-13T17:35:54.419624] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-13T17:35:54.421088] [DEBUG] [LOCAL ] BGS: Trimmed 72475 records to 50490 (keeping 200 days of data) [2025-10-13T17:35:54.710608] [DEBUG] [LOCAL ] BGS: Primary data saved (50490 records). [2025-10-13T17:35:54.710780] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-13T17:35:54.710872] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGS took 32.7s. Estimated remaining: 4h 46m 9s. Rate: 7.4 symbols/min [2025-10-13T17:35:54.822121] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-13T17:35:54.879371] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T17:35:54.899105] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:54.924471] [DEBUG] [LOCAL ] BGY: Loaded 22421 existing records from primary storage. [2025-10-13T17:35:54.924774] [INFO ] [MAIN ] BGY: Loaded 22421 existing records. [2025-10-13T17:35:55.110281] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:55.111183] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-13T17:35:55.111244] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-13T17:35:55.111707] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-13T17:35:55.111766] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-13T17:35:55.521722] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:55.621833] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-13T17:35:55.624264] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T17:35:56.417973] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-13T17:35:56.582736] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T17:35:56.584566] [INFO ] [REMOTE ] BGT: Full fetch complete (24171 records). [2025-10-13T17:35:56.584638] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-13T17:35:56.950724] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-13T17:35:56.950817] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-13T17:35:56.951228] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-13T17:35:56.951267] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-13T17:35:56.951931] [DEBUG] [LOCAL ] BGT: Trimmed 24171 records to 16534 (keeping 200 days of data) [2025-10-13T17:35:57.051405] [DEBUG] [LOCAL ] BGT: Primary data saved (16534 records). [2025-10-13T17:35:57.051547] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-13T17:35:57.051626] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGT took 26.0s. Estimated remaining: 4h 45m 15s. Rate: 7.4 symbols/min [2025-10-13T17:35:57.216798] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:35:57.217974] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-13T17:35:57.234917] [DEBUG] [LOCAL ] BH: Loaded 16341 existing records from primary storage. [2025-10-13T17:35:57.235250] [INFO ] [MAIN ] BH: Loaded 16341 existing records. [2025-10-13T17:35:57.412131] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:35:57.412489] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-13T17:35:57.412543] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-13T17:35:57.412797] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-13T17:35:57.412854] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-13T17:35:57.737910] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-13T17:35:57.756139] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T17:35:57.816729] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:35:58.017931] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-13T17:35:58.817965] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-13T17:35:59.062875] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T17:35:59.269281] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T17:35:59.617954] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-13T17:36:00.374450] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T17:36:00.417893] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-13T17:36:01.069692] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T17:36:01.217939] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-13T17:36:02.017933] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-13T17:36:02.215736] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T17:36:02.496476] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-13T17:36:02.817967] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-13T17:36:03.617903] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-13T17:36:03.625702] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T17:36:04.418022] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-13T17:36:04.710705] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T17:36:05.148757] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T17:36:05.217969] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-13T17:36:06.017966] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-13T17:36:06.114897] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-13T17:36:06.817955] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-13T17:36:07.275161] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T17:36:07.610623] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T17:36:07.617880] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-13T17:36:08.418047] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-13T17:36:08.572333] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T17:36:09.217896] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-13T17:36:09.606186] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T17:36:10.017919] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-13T17:36:10.119170] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T17:36:10.817940] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-13T17:36:11.119577] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T17:36:11.617904] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-13T17:36:11.853742] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T17:36:12.418016] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-13T17:36:12.436019] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T17:36:13.217910] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-13T17:36:13.323612] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T17:36:14.017954] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-13T17:36:14.406304] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T17:36:14.651068] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T17:36:14.817911] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-13T17:36:15.617922] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-13T17:36:15.981795] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T17:36:16.417981] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-13T17:36:16.840882] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:36:17.158371] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T17:36:17.217897] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-13T17:36:18.017902] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-13T17:36:18.324298] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T17:36:18.817910] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-13T17:36:19.355816] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T17:36:19.358068] [INFO ] [REMOTE ] BGSF: Full fetch complete (9397 records). [2025-10-13T17:36:19.358168] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-13T17:36:19.623097] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-13T17:36:19.782759] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-13T17:36:19.783362] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-13T17:36:19.783280] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T17:36:19.783819] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-13T17:36:19.787865] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-13T17:36:19.789047] [DEBUG] [LOCAL ] BGSF: Trimmed 9397 records to 7846 (keeping 200 days of data) [2025-10-13T17:36:19.839033] [DEBUG] [LOCAL ] BGSF: Primary data saved (7846 records). [2025-10-13T17:36:19.839146] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-13T17:36:19.839261] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGSF took 51.7s. Estimated remaining: 4h 47m 3s. Rate: 7.3 symbols/min [2025-10-13T17:36:20.007412] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:20.051548] [DEBUG] [LOCAL ] BHC: Loaded 47488 existing records from primary storage. [2025-10-13T17:36:20.051947] [INFO ] [MAIN ] BHC: Loaded 47488 existing records. [2025-10-13T17:36:20.230788] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:36:20.231014] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-13T17:36:20.231062] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-13T17:36:20.231485] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-13T17:36:20.231553] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-13T17:36:20.423351] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-13T17:36:20.545420] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T17:36:20.609439] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:21.217906] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-13T17:36:21.225822] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T17:36:21.229857] [INFO ] [REMOTE ] BGY: Full fetch complete (32981 records). [2025-10-13T17:36:21.229933] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-13T17:36:21.601667] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-13T17:36:21.601757] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-13T17:36:21.602208] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-13T17:36:21.602247] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-13T17:36:21.602994] [DEBUG] [LOCAL ] BGY: Trimmed 32981 records to 22024 (keeping 200 days of data) [2025-10-13T17:36:21.728286] [DEBUG] [LOCAL ] BGY: Primary data saved (22024 records). [2025-10-13T17:36:21.728414] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-13T17:36:21.728492] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 27.0s. Estimated remaining: 4h 46m 5s. Rate: 7.4 symbols/min [2025-10-13T17:36:21.903852] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:21.927004] [DEBUG] [LOCAL ] BHE: Loaded 24326 existing records from primary storage. [2025-10-13T17:36:21.927290] [INFO ] [MAIN ] BHE: Loaded 24326 existing records. [2025-10-13T17:36:22.024992] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-13T17:36:22.111732] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:36:22.112041] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-13T17:36:22.112091] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-13T17:36:22.112351] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-13T17:36:22.112409] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-13T17:36:22.470272] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:22.817980] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-13T17:36:22.852945] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T17:36:22.887138] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T17:36:22.889298] [INFO ] [REMOTE ] BGX: Full fetch complete (16460 records). [2025-10-13T17:36:22.889379] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-13T17:36:22.889878] [FATAL] [VALIDATOR ] BGX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:36:22.889961] [FATAL] [MAIN ] BGX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:36:22.890002] [WARN ] [MAIN ] BGX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:36:22.890040] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-13T17:36:22.890095] [DEBUG] [LOCAL ] BGX: No primary data file found to delete. [2025-10-13T17:36:22.890128] [INFO ] [LOCAL ] BGX: Starting deletion of derivative data. [2025-10-13T17:36:22.890382] [DEBUG] [LOCAL ] BGX: Deleted derivative data file. [2025-10-13T17:36:22.890484] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BGX took 41.1s. Estimated remaining: 4h 45m 2s. Rate: 7.4 symbols/min [2025-10-13T17:36:23.065746] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:23.066039] [DEBUG] [LOCAL ] BHK: No existing data file found in primary storage. [2025-10-13T17:36:23.066094] [WARN ] [MAIN ] BHK: No existing data found, performing full refresh instead. [2025-10-13T17:36:23.066236] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-13T17:36:23.066305] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-13T17:36:23.066368] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-13T17:36:23.066404] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-13T17:36:23.422294] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:23.617966] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-13T17:36:24.056031] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T17:36:24.417936] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-13T17:36:24.920540] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T17:36:25.217912] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-13T17:36:25.542113] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T17:36:26.017908] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-13T17:36:26.119834] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T17:36:26.817934] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-13T17:36:26.955419] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T17:36:27.617929] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-13T17:36:27.754853] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T17:36:28.417959] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-13T17:36:28.464083] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T17:36:29.217946] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-13T17:36:29.299170] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T17:36:29.301074] [INFO ] [REMOTE ] BH: Full fetch complete (19573 records). [2025-10-13T17:36:29.301143] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-13T17:36:29.663908] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-13T17:36:29.663991] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-13T17:36:29.664339] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-13T17:36:29.664376] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-13T17:36:29.665057] [DEBUG] [LOCAL ] BH: Trimmed 19573 records to 16227 (keeping 200 days of data) [2025-10-13T17:36:29.760463] [DEBUG] [LOCAL ] BH: Primary data saved (16227 records). [2025-10-13T17:36:29.760595] [INFO ] [MAIN ] BH: Full history saved. [2025-10-13T17:36:29.760714] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BH took 32.7s. Estimated remaining: 4h 44m 44s. Rate: 7.4 symbols/min [2025-10-13T17:36:29.924886] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:29.925078] [DEBUG] [LOCAL ] BHP: No existing data file found in primary storage. [2025-10-13T17:36:29.925114] [WARN ] [MAIN ] BHP: No existing data found, performing full refresh instead. [2025-10-13T17:36:29.925225] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-13T17:36:29.925266] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-13T17:36:29.925305] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-13T17:36:29.925336] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-13T17:36:30.023235] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-13T17:36:30.271854] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:30.824527] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-13T17:36:30.840960] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:36:31.391577] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T17:36:31.407197] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T17:36:31.617961] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-13T17:36:32.417929] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-13T17:36:33.217954] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-13T17:36:33.502012] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T17:36:34.027882] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-13T17:36:34.033018] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T17:36:34.277539] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T17:36:34.817885] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-13T17:36:34.874804] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-13T17:36:35.617927] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-13T17:36:36.417925] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-13T17:36:36.518213] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T17:36:36.585876] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T17:36:37.217952] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-13T17:36:37.899889] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:36:38.017936] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-13T17:36:38.071815] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T17:36:38.817927] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-13T17:36:39.134201] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T17:36:39.617943] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-13T17:36:40.417910] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-13T17:36:40.692815] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T17:36:41.216419] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T17:36:41.220236] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-13T17:36:41.331875] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T17:36:42.017927] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-13T17:36:42.440704] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T17:36:42.817913] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-13T17:36:43.062821] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-13T17:36:43.617955] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-13T17:36:44.238429] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T17:36:44.418017] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-13T17:36:45.217905] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-13T17:36:45.696606] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T17:36:46.017930] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-13T17:36:46.114027] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T17:36:46.284323] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T17:36:46.817932] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-13T17:36:47.617923] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-13T17:36:48.073187] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T17:36:48.117325] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T17:36:48.417896] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-13T17:36:48.725271] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T17:36:49.217943] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-13T17:36:50.017967] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-13T17:36:50.132383] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T17:36:50.817924] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-13T17:36:50.858514] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T17:36:50.918765] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T17:36:51.617903] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-13T17:36:51.906143] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:36:51.908778] [INFO ] [REMOTE ] BHE: Full fetch complete (36225 records). [2025-10-13T17:36:51.908912] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-13T17:36:52.281854] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-13T17:36:52.281933] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-13T17:36:52.282400] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-13T17:36:52.282439] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-13T17:36:52.283359] [DEBUG] [LOCAL ] BHE: Trimmed 36225 records to 23897 (keeping 200 days of data) [2025-10-13T17:36:52.421317] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-13T17:36:52.428802] [DEBUG] [LOCAL ] BHE: Primary data saved (23897 records). [2025-10-13T17:36:52.428933] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-13T17:36:52.429013] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHE took 30.7s. Estimated remaining: 4h 46m 29s. Rate: 7.3 symbols/min [2025-10-13T17:36:52.599054] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:52.620260] [DEBUG] [LOCAL ] BHR: Loaded 22281 existing records from primary storage. [2025-10-13T17:36:52.620525] [INFO ] [MAIN ] BHR: Loaded 22281 existing records. [2025-10-13T17:36:52.800204] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:36:52.800458] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-13T17:36:52.800517] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-13T17:36:52.800836] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-13T17:36:52.800895] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-13T17:36:53.169562] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:53.217916] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-13T17:36:53.328831] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T17:36:53.335906] [INFO ] [REMOTE ] BHC: Full fetch complete (67178 records). [2025-10-13T17:36:53.336082] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-13T17:36:53.726616] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-13T17:36:53.726782] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-13T17:36:53.727522] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-13T17:36:53.727583] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-13T17:36:53.729204] [DEBUG] [LOCAL ] BHC: Trimmed 67178 records to 46690 (keeping 200 days of data) [2025-10-13T17:36:53.988973] [DEBUG] [LOCAL ] BHC: Primary data saved (46690 records). [2025-10-13T17:36:53.989105] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-13T17:36:53.989186] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHC took 34.1s. Estimated remaining: 4h 45m 29s. Rate: 7.4 symbols/min [2025-10-13T17:36:54.020250] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-13T17:36:54.162766] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:54.163450] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-13T17:36:54.163911] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-13T17:36:54.164136] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-13T17:36:54.164189] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-13T17:36:54.164235] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-13T17:36:54.164320] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-13T17:36:54.462925] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T17:36:54.629220] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:54.631554] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-13T17:36:54.817897] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-13T17:36:55.217677] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:36:55.617934] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-13T17:36:56.417958] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-13T17:36:56.687363] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T17:36:56.775515] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T17:36:57.217927] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-13T17:36:57.552696] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T17:36:58.017928] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-13T17:36:58.267613] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T17:36:58.271299] [INFO ] [REMOTE ] BHK: Full fetch complete (30579 records). [2025-10-13T17:36:58.271581] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-13T17:36:58.669294] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-13T17:36:58.669383] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-13T17:36:58.669845] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-13T17:36:58.669907] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-13T17:36:58.670626] [DEBUG] [LOCAL ] BHK: Trimmed 30579 records to 23543 (keeping 200 days of data) [2025-10-13T17:36:58.811856] [DEBUG] [LOCAL ] BHK: Primary data saved (23543 records). [2025-10-13T17:36:58.811988] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-13T17:36:58.812057] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHK took 35.9s. Estimated remaining: 4h 44m 56s. Rate: 7.4 symbols/min [2025-10-13T17:36:58.823352] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-13T17:36:58.985548] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:36:58.996714] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T17:36:59.050298] [DEBUG] [LOCAL ] BHVN: Loaded 50961 existing records from primary storage. [2025-10-13T17:36:59.050620] [INFO ] [MAIN ] BHVN: Loaded 50961 existing records. [2025-10-13T17:36:59.230719] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:36:59.230931] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-13T17:36:59.230979] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-13T17:36:59.231281] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-13T17:36:59.231339] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-13T17:36:59.579453] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:36:59.617886] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-13T17:37:00.417948] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-13T17:37:00.767410] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T17:37:00.953107] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-13T17:37:01.020790] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T17:37:01.217910] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-13T17:37:02.017916] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-13T17:37:02.359219] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-13T17:37:02.670036] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:37:02.817950] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-13T17:37:03.617980] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-13T17:37:03.814519] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T17:37:04.417930] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-13T17:37:05.126071] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T17:37:05.217903] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-13T17:37:05.647158] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:37:06.017931] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-13T17:37:06.758809] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T17:37:06.817906] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-13T17:37:07.617907] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-13T17:37:08.142843] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-13T17:37:08.337372] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T17:37:08.417893] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-13T17:37:08.745510] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T17:37:09.217930] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-13T17:37:10.019020] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-13T17:37:10.022416] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T17:37:10.048806] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T17:37:10.817939] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-13T17:37:11.617917] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-13T17:37:11.778908] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T17:37:11.921626] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-13T17:37:11.927299] [INFO ] [REMOTE ] BHP: Full fetch complete (77269 records). [2025-10-13T17:37:11.927432] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-13T17:37:12.324670] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-13T17:37:12.324768] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-13T17:37:12.325578] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-13T17:37:12.325618] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-13T17:37:12.327170] [DEBUG] [LOCAL ] BHP: Trimmed 77269 records to 53373 (keeping 200 days of data) [2025-10-13T17:37:12.425212] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-13T17:37:12.668426] [DEBUG] [LOCAL ] BHP: Primary data saved (53373 records). [2025-10-13T17:37:12.668623] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-13T17:37:12.668769] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHP took 42.9s. Estimated remaining: 4h 45m 31s. Rate: 7.3 symbols/min [2025-10-13T17:37:12.838115] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:12.887587] [DEBUG] [LOCAL ] BILL: Loaded 53182 existing records from primary storage. [2025-10-13T17:37:12.887977] [INFO ] [MAIN ] BILL: Loaded 53182 existing records. [2025-10-13T17:37:13.062093] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:13.062321] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-13T17:37:13.062368] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-13T17:37:13.062704] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-13T17:37:13.062761] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-13T17:37:13.261397] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-13T17:37:13.440600] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:13.442052] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T17:37:13.475346] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T17:37:13.764695] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T17:37:14.017911] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-13T17:37:14.817962] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-13T17:37:15.124597] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-13T17:37:15.617933] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-13T17:37:15.779339] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T17:37:16.417918] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-13T17:37:17.139575] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T17:37:17.217889] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-13T17:37:17.641280] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-13T17:37:17.753279] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T17:37:18.017923] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-13T17:37:18.817965] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-13T17:37:19.623214] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-13T17:37:19.644049] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T17:37:20.417927] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-13T17:37:20.500680] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:37:20.775636] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T17:37:20.778881] [INFO ] [REMOTE ] BHR: Full fetch complete (31271 records). [2025-10-13T17:37:20.778955] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-13T17:37:21.151218] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-13T17:37:21.151298] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-13T17:37:21.151752] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-13T17:37:21.151812] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-13T17:37:21.152500] [DEBUG] [LOCAL ] BHR: Trimmed 31271 records to 22109 (keeping 200 days of data) [2025-10-13T17:37:21.236004] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-13T17:37:21.282744] [DEBUG] [LOCAL ] BHR: Primary data saved (22109 records). [2025-10-13T17:37:21.282885] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-13T17:37:21.282969] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHR took 28.9s. Estimated remaining: 4h 45m 27s. Rate: 7.3 symbols/min [2025-10-13T17:37:21.449494] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:21.472182] [DEBUG] [LOCAL ] BIO: Loaded 24502 existing records from primary storage. [2025-10-13T17:37:21.472429] [INFO ] [MAIN ] BIO: Loaded 24502 existing records. [2025-10-13T17:37:21.634610] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-13T17:37:21.653488] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:21.654736] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-13T17:37:21.654790] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-13T17:37:21.655025] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-13T17:37:21.655082] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-13T17:37:22.037346] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-13T17:37:22.037284] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:22.074495] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T17:37:22.399299] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-13T17:37:22.817958] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-13T17:37:23.618007] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-13T17:37:23.729608] [DEBUG] [REMOTE ] BIO: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-13T17:37:23.730042] [WARN ] [REMOTE ] BIO: No data returned for month 2024-12 [2025-10-13T17:37:23.730160] [FATAL] [REMOTE ] BIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:37:23.730248] [FATAL] [MAIN ] BIO: Failed to fetch primary data. [2025-10-13T17:37:23.730331] [WARN ] [MAIN ] BIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:37:23.730418] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-13T17:37:23.730499] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-13T17:37:23.730549] [INFO ] [LOCAL ] BIO: Starting deletion of derivative data. [2025-10-13T17:37:23.730813] [DEBUG] [LOCAL ] BIO: Deleted derivative data file. [2025-10-13T17:37:23.730926] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BIO took 2.4s. Estimated remaining: 4h 44m 35s. Rate: 7.4 symbols/min [2025-10-13T17:37:23.917405] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:23.917726] [DEBUG] [LOCAL ] BIP: No existing data file found in primary storage. [2025-10-13T17:37:23.917778] [WARN ] [MAIN ] BIP: No existing data found, performing full refresh instead. [2025-10-13T17:37:23.917896] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-13T17:37:23.917939] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-13T17:37:23.918004] [DEBUG] [LOCAL ] BIP: No primary data file found to delete. [2025-10-13T17:37:23.918062] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-13T17:37:24.306097] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:24.417914] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-13T17:37:24.475220] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T17:37:25.217977] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-13T17:37:25.748272] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T17:37:26.018030] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-13T17:37:26.817973] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-13T17:37:27.092032] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T17:37:27.098017] [INFO ] [REMOTE ] BHVN: Full fetch complete (70190 records). [2025-10-13T17:37:27.098208] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-13T17:37:27.374681] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T17:37:27.549864] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-13T17:37:27.550904] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-13T17:37:27.550692] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:37:27.559194] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-13T17:37:27.560385] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-13T17:37:27.562544] [DEBUG] [LOCAL ] BHVN: Trimmed 70190 records to 50396 (keeping 200 days of data) [2025-10-13T17:37:27.623835] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-13T17:37:27.882093] [DEBUG] [LOCAL ] BHVN: Primary data saved (50396 records). [2025-10-13T17:37:27.882276] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-13T17:37:27.882368] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BHVN took 29.1s. Estimated remaining: 4h 43m 56s. Rate: 7.4 symbols/min [2025-10-13T17:37:28.059289] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:28.099998] [DEBUG] [LOCAL ] BIPC: Loaded 41873 existing records from primary storage. [2025-10-13T17:37:28.100446] [INFO ] [MAIN ] BIPC: Loaded 41873 existing records. [2025-10-13T17:37:28.288686] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:28.288973] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-13T17:37:28.289022] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-13T17:37:28.289404] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-13T17:37:28.289462] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-13T17:37:28.423087] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-13T17:37:28.669254] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:28.975413] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T17:37:29.217913] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-13T17:37:30.017921] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-13T17:37:30.162302] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T17:37:30.399617] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-13T17:37:30.720456] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:37:30.817879] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-13T17:37:31.617908] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-13T17:37:32.129407] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T17:37:32.417908] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-13T17:37:33.217897] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-13T17:37:33.392006] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T17:37:33.701040] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T17:37:34.017968] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-13T17:37:34.672298] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T17:37:34.817965] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-13T17:37:35.399366] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T17:37:35.617937] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-13T17:37:36.093283] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T17:37:36.417977] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-13T17:37:37.074164] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T17:37:37.217950] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-13T17:37:37.893996] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T17:37:37.918815] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:37:38.017911] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-13T17:37:38.479301] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T17:37:38.480132] [INFO ] [REMOTE ] BHV: Full fetch complete (1383 records). [2025-10-13T17:37:38.480200] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-13T17:37:38.669954] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-13T17:37:38.670236] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:37:38.670323] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:37:38.670415] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-13T17:37:38.671048] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-13T17:37:38.671132] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-13T17:37:38.671237] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-13T17:37:38.671348] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BHV took 44.7s. Estimated remaining: 4h 44m 8s. Rate: 7.4 symbols/min [2025-10-13T17:37:38.818019] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-13T17:37:39.617959] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-13T17:37:40.422980] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-13T17:37:40.436447] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T17:37:41.217951] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-13T17:37:41.248924] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T17:37:42.017938] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-13T17:37:42.061051] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T17:37:42.764139] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:37:42.817892] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-13T17:37:43.618053] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-13T17:37:43.790736] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T17:37:44.372589] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T17:37:44.417918] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-13T17:37:44.998349] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T17:37:45.217960] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-13T17:37:46.018070] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-13T17:37:46.210693] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T17:37:46.258729] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:37:46.263508] [INFO ] [REMOTE ] BIP: Full fetch complete (57030 records). [2025-10-13T17:37:46.263683] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-13T17:37:46.653573] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-13T17:37:46.653724] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-13T17:37:46.654514] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-13T17:37:46.654568] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-13T17:37:46.656281] [DEBUG] [LOCAL ] BIP: Trimmed 57030 records to 39207 (keeping 200 days of data) [2025-10-13T17:37:46.837789] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-13T17:37:46.910353] [DEBUG] [LOCAL ] BIP: Primary data saved (39207 records). [2025-10-13T17:37:46.910560] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-13T17:37:46.910677] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIP took 23.2s. Estimated remaining: 4h 44m 1s. Rate: 7.4 symbols/min [2025-10-13T17:37:47.288467] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T17:37:47.617963] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-13T17:37:48.805373] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T17:37:48.818330] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-13T17:37:48.892090] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T17:37:49.218078] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-13T17:37:50.563938] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T17:37:50.573181] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-13T17:37:50.862333] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-13T17:37:50.867884] [INFO ] [REMOTE ] BILL: Full fetch complete (75901 records). [2025-10-13T17:37:50.868041] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-13T17:37:51.250070] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-13T17:37:51.250157] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-13T17:37:51.251100] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-13T17:37:51.251163] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-13T17:37:51.252621] [DEBUG] [LOCAL ] BILL: Trimmed 75901 records to 52444 (keeping 200 days of data) [2025-10-13T17:37:51.558733] [DEBUG] [LOCAL ] BILL: Primary data saved (52444 records). [2025-10-13T17:37:51.558914] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-13T17:37:51.559714] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BILL took 38.9s. Estimated remaining: 4h 43m 27s. Rate: 7.4 symbols/min [2025-10-13T17:37:51.607128] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T17:37:51.617463] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-13T17:37:53.033182] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T17:37:53.042522] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-13T17:37:54.480902] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:37:54.486340] [INFO ] [REMOTE ] BIPC: Full fetch complete (59966 records). [2025-10-13T17:37:54.486499] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-13T17:37:54.864421] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-13T17:37:54.864501] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-13T17:37:54.865193] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-13T17:37:54.865254] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-13T17:37:54.866392] [DEBUG] [LOCAL ] BIPC: Trimmed 59966 records to 41208 (keeping 200 days of data) [2025-10-13T17:37:55.112574] [DEBUG] [LOCAL ] BIPC: Primary data saved (41208 records). [2025-10-13T17:37:55.112731] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-13T17:37:55.112815] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPC took 27.2s. Estimated remaining: 4h 42m 44s. Rate: 7.4 symbols/min [2025-10-13T17:37:55.716695] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:55.766843] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:55.865172] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:55.887810] [DEBUG] [LOCAL ] BIPH: Loaded 2591 existing records from primary storage. [2025-10-13T17:37:55.887523] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:37:55.889803] [INFO ] [MAIN ] BIPH: Loaded 2591 existing records. [2025-10-13T17:37:55.933808] [DEBUG] [LOCAL ] BIPI: Loaded 3192 existing records from primary storage. [2025-10-13T17:37:55.939446] [INFO ] [MAIN ] BIPI: Loaded 3192 existing records. [2025-10-13T17:37:56.114060] [DEBUG] [LOCAL ] BIPJ: Loaded 3196 existing records from primary storage. [2025-10-13T17:37:56.131185] [INFO ] [MAIN ] BIPJ: Loaded 3196 existing records. [2025-10-13T17:37:56.314844] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:56.320372] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-13T17:37:56.385627] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-13T17:37:56.423032] [DEBUG] [LOCAL ] BIRK: Loaded 51758 existing records from primary storage. [2025-10-13T17:37:56.450676] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-13T17:37:56.440277] [INFO ] [MAIN ] BIRK: Loaded 51758 existing records. [2025-10-13T17:37:56.482040] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-13T17:37:56.624623] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:56.660863] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-13T17:37:56.634461] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:56.687100] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-13T17:37:56.692603] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-13T17:37:56.726515] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-13T17:37:56.749109] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-13T17:37:56.764915] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-13T17:37:56.828715] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-13T17:37:56.850254] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-13T17:37:57.083867] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:37:57.165008] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-13T17:37:57.203371] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-13T17:37:57.248575] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-13T17:37:57.347120] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-13T17:37:57.983194] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:58.041101] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-13T17:37:58.231367] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:58.242422] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-13T17:37:58.304365] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:58.337480] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-13T17:37:58.514145] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:37:58.514575] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-13T17:37:59.013837] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-13T17:37:59.015522] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-13T17:37:59.032423] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T17:37:59.034120] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-13T17:37:59.381031] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-13T17:37:59.382357] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-13T17:37:59.468976] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T17:37:59.471616] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-13T17:37:59.481772] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T17:37:59.483725] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-13T17:37:59.797711] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T17:37:59.798999] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-13T17:37:59.946847] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T17:38:00.016521] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-13T17:38:00.092880] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-13T17:38:00.417923] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-13T17:38:00.465992] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T17:38:00.844146] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T17:38:01.217936] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-13T17:38:02.017936] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-13T17:38:02.452111] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T17:38:02.714142] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T17:38:02.817975] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-13T17:38:03.369725] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T17:38:03.617958] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-13T17:38:04.417905] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-13T17:38:04.863403] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T17:38:05.152872] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T17:38:05.217890] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-13T17:38:06.017915] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-13T17:38:06.606282] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T17:38:06.818091] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-13T17:38:06.899340] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T17:38:07.245138] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T17:38:07.617946] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-13T17:38:07.946402] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-13T17:38:08.417940] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-13T17:38:08.945758] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-13T17:38:09.217920] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-13T17:38:09.684843] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T17:38:10.017926] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-13T17:38:10.714942] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T17:38:10.817938] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-13T17:38:11.354297] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-13T17:38:11.617896] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-13T17:38:12.156674] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T17:38:12.417928] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-13T17:38:12.936774] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T17:38:12.937664] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4383 records). [2025-10-13T17:38:12.937754] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-13T17:38:13.225387] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-13T17:38:13.313013] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-13T17:38:13.313098] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-13T17:38:13.313286] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-13T17:38:13.313349] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-13T17:38:13.313766] [DEBUG] [LOCAL ] BIPJ: Trimmed 4383 records to 3168 (keeping 200 days of data) [2025-10-13T17:38:13.334289] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3168 records). [2025-10-13T17:38:13.334374] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-13T17:38:13.334494] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 18.2s. Estimated remaining: 4h 43m 51s. Rate: 7.4 symbols/min [2025-10-13T17:38:13.509203] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:13.534213] [DEBUG] [LOCAL ] BIT: Loaded 23580 existing records from primary storage. [2025-10-13T17:38:13.534549] [INFO ] [MAIN ] BIT: Loaded 23580 existing records. [2025-10-13T17:38:13.716896] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:13.717146] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-13T17:38:13.717194] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-13T17:38:13.717452] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-13T17:38:13.717529] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-13T17:38:14.023156] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-13T17:38:14.116986] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:38:14.460354] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-13T17:38:14.810226] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T17:38:14.820566] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-13T17:38:15.300017] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T17:38:15.617951] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-13T17:38:16.058750] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T17:38:16.418030] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-13T17:38:16.801963] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-13T17:38:17.218002] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-13T17:38:18.018027] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-13T17:38:18.475769] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T17:38:18.476794] [INFO ] [REMOTE ] BIPH: Full fetch complete (4153 records). [2025-10-13T17:38:18.476865] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-13T17:38:18.839815] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-13T17:38:18.888749] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-13T17:38:18.888994] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-13T17:38:18.889375] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-13T17:38:18.889518] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-13T17:38:18.891050] [DEBUG] [LOCAL ] BIPH: Trimmed 4153 records to 2553 (keeping 200 days of data) [2025-10-13T17:38:18.947926] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T17:38:18.951954] [DEBUG] [LOCAL ] BIPH: Primary data saved (2553 records). [2025-10-13T17:38:18.963979] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-13T17:38:18.964171] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPH took 23.9s. Estimated remaining: 4h 43m 24s. Rate: 7.4 symbols/min [2025-10-13T17:38:19.141718] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:19.203895] [DEBUG] [LOCAL ] BJ: Loaded 52284 existing records from primary storage. [2025-10-13T17:38:19.204260] [INFO ] [MAIN ] BJ: Loaded 52284 existing records. [2025-10-13T17:38:19.394377] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:19.399179] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-13T17:38:19.398988] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T17:38:19.399375] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-13T17:38:19.401927] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-13T17:38:19.402008] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-13T17:38:19.623174] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-13T17:38:19.782208] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:38:20.151787] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T17:38:20.418017] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-13T17:38:21.217936] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-13T17:38:21.696969] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-13T17:38:21.979552] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:38:22.017898] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-13T17:38:22.817959] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-13T17:38:23.368245] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T17:38:23.617957] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-13T17:38:23.829749] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T17:38:23.978089] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-13T17:38:24.417944] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-13T17:38:24.893871] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T17:38:24.894918] [INFO ] [REMOTE ] BIPI: Full fetch complete (4905 records). [2025-10-13T17:38:24.894993] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-13T17:38:25.227204] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-13T17:38:25.270544] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-13T17:38:25.270672] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-13T17:38:25.270988] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-13T17:38:25.271073] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-13T17:38:25.271538] [DEBUG] [LOCAL ] BIPI: Trimmed 4905 records to 3114 (keeping 200 days of data) [2025-10-13T17:38:25.294236] [DEBUG] [LOCAL ] BIPI: Primary data saved (3114 records). [2025-10-13T17:38:25.294402] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-13T17:38:25.294521] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIPI took 30.2s. Estimated remaining: 4h 43m 3s. Rate: 7.4 symbols/min [2025-10-13T17:38:25.469708] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:25.526246] [DEBUG] [LOCAL ] BK: Loaded 54309 existing records from primary storage. [2025-10-13T17:38:25.526687] [INFO ] [MAIN ] BK: Loaded 54309 existing records. [2025-10-13T17:38:25.711272] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:25.711553] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-13T17:38:25.711603] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-13T17:38:25.711884] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-13T17:38:25.711942] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-13T17:38:26.023112] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-13T17:38:26.102598] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:38:26.817942] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-13T17:38:27.042346] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T17:38:27.393187] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T17:38:27.618195] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-13T17:38:28.289111] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T17:38:28.417903] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-13T17:38:28.492563] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T17:38:29.217898] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-13T17:38:29.398782] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T17:38:30.018021] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-13T17:38:30.818047] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-13T17:38:30.865418] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:38:31.581786] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T17:38:31.617886] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-13T17:38:32.428878] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-13T17:38:32.435211] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T17:38:33.217912] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-13T17:38:33.522865] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T17:38:34.017903] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-13T17:38:34.052546] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:38:34.174574] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T17:38:34.817965] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-13T17:38:35.617933] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-13T17:38:35.769966] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T17:38:35.775348] [INFO ] [REMOTE ] BIRK: Full fetch complete (73048 records). [2025-10-13T17:38:35.775460] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-13T17:38:35.925401] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T17:38:36.213991] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-13T17:38:36.214075] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-13T17:38:36.214871] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-13T17:38:36.214938] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-13T17:38:36.216351] [DEBUG] [LOCAL ] BIRK: Trimmed 73048 records to 51043 (keeping 200 days of data) [2025-10-13T17:38:36.417972] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-13T17:38:36.513861] [DEBUG] [LOCAL ] BIRK: Primary data saved (51043 records). [2025-10-13T17:38:36.514004] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-13T17:38:36.514085] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 41.4s. Estimated remaining: 4h 43m 18s. Rate: 7.4 symbols/min [2025-10-13T17:38:36.686611] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:36.733161] [DEBUG] [LOCAL ] BKD: Loaded 51097 existing records from primary storage. [2025-10-13T17:38:36.733504] [INFO ] [MAIN ] BKD: Loaded 51097 existing records. [2025-10-13T17:38:36.910216] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:36.910510] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-13T17:38:36.910557] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-13T17:38:36.910857] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-13T17:38:36.910947] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-13T17:38:37.230355] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-13T17:38:37.274696] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:38:37.539274] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-13T17:38:38.001499] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T17:38:38.017877] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-13T17:38:38.285540] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T17:38:38.817952] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-13T17:38:39.617950] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-13T17:38:39.955020] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T17:38:40.423030] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-13T17:38:40.444426] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T17:38:40.490490] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T17:38:41.217941] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-13T17:38:42.017890] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-13T17:38:42.096682] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T17:38:42.778519] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T17:38:42.817913] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-13T17:38:43.617900] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-13T17:38:43.728904] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:38:44.417924] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-13T17:38:44.510548] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T17:38:45.223124] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-13T17:38:45.240131] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:38:46.017925] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-13T17:38:46.401681] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:38:46.535785] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-13T17:38:46.817923] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-13T17:38:47.402925] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T17:38:47.617918] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-13T17:38:48.412675] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T17:38:48.424532] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-13T17:38:49.168530] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T17:38:49.217893] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-13T17:38:50.022789] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-13T17:38:50.025621] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T17:38:50.817902] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-13T17:38:51.000271] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T17:38:51.375977] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T17:38:51.617919] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-13T17:38:52.417930] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-13T17:38:52.550963] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T17:38:52.771597] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T17:38:53.217974] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-13T17:38:54.017956] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-13T17:38:54.105761] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T17:38:54.831432] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-13T17:38:54.835357] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T17:38:55.617999] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-13T17:38:55.958863] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T17:38:56.417906] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-13T17:38:56.531206] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T17:38:56.538253] [INFO ] [REMOTE ] BJ: Full fetch complete (74088 records). [2025-10-13T17:38:56.538415] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-13T17:38:56.950317] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-13T17:38:56.950457] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-13T17:38:56.951547] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-13T17:38:56.951619] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-13T17:38:56.953709] [DEBUG] [LOCAL ] BJ: Trimmed 74088 records to 51584 (keeping 200 days of data) [2025-10-13T17:38:57.214719] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T17:38:57.225936] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-13T17:38:57.327109] [DEBUG] [LOCAL ] BJ: Primary data saved (51584 records). [2025-10-13T17:38:57.327312] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-13T17:38:57.327432] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BJ took 38.4s. Estimated remaining: 4h 44m 42s. Rate: 7.3 symbols/min [2025-10-13T17:38:57.506748] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:57.543016] [DEBUG] [LOCAL ] BKE: Loaded 34527 existing records from primary storage. [2025-10-13T17:38:57.543390] [INFO ] [MAIN ] BKE: Loaded 34527 existing records. [2025-10-13T17:38:57.738525] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:57.738859] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-13T17:38:57.738911] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-13T17:38:57.739292] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-13T17:38:57.739352] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-13T17:38:58.018280] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-13T17:38:58.139469] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:38:58.169766] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:38:58.528860] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T17:38:58.532494] [INFO ] [REMOTE ] BIT: Full fetch complete (31892 records). [2025-10-13T17:38:58.532591] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-13T17:38:58.825799] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-13T17:38:58.916811] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-13T17:38:58.916908] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-13T17:38:58.917554] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-13T17:38:58.917616] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-13T17:38:58.918682] [DEBUG] [LOCAL ] BIT: Trimmed 31892 records to 23487 (keeping 200 days of data) [2025-10-13T17:38:59.063994] [DEBUG] [LOCAL ] BIT: Primary data saved (23487 records). [2025-10-13T17:38:59.064164] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-13T17:38:59.064259] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BIT took 45.7s. Estimated remaining: 4h 43m 47s. Rate: 7.3 symbols/min [2025-10-13T17:38:59.237191] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:38:59.277206] [DEBUG] [LOCAL ] BKH: Loaded 37451 existing records from primary storage. [2025-10-13T17:38:59.277713] [INFO ] [MAIN ] BKH: Loaded 37451 existing records. [2025-10-13T17:38:59.463497] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:38:59.464049] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-13T17:38:59.464139] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-13T17:38:59.464925] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-13T17:38:59.464990] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-13T17:38:59.615552] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T17:38:59.620923] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-13T17:38:59.873552] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:00.360104] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T17:39:00.417952] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-13T17:39:01.218009] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-13T17:39:01.582904] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T17:39:02.017911] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-13T17:39:02.118745] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T17:39:02.278147] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T17:39:02.818028] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-13T17:39:03.593306] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T17:39:03.602211] [INFO ] [REMOTE ] BK: Full fetch complete (77481 records). [2025-10-13T17:39:03.602429] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-13T17:39:03.623800] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-13T17:39:03.988392] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-13T17:39:03.988528] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-13T17:39:03.989433] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-13T17:39:03.989540] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-13T17:39:03.991229] [DEBUG] [LOCAL ] BK: Trimmed 77481 records to 53535 (keeping 200 days of data) [2025-10-13T17:39:04.251899] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T17:39:04.347604] [DEBUG] [LOCAL ] BK: Primary data saved (53535 records). [2025-10-13T17:39:04.347773] [INFO ] [MAIN ] BK: Full history saved. [2025-10-13T17:39:04.347860] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BK took 39.1s. Estimated remaining: 4h 43m 18s. Rate: 7.4 symbols/min [2025-10-13T17:39:04.423440] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-13T17:39:04.519778] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:04.554479] [DEBUG] [LOCAL ] BKKT: Loaded 36488 existing records from primary storage. [2025-10-13T17:39:04.554804] [INFO ] [MAIN ] BKKT: Loaded 36488 existing records. [2025-10-13T17:39:04.727068] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:39:04.727267] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-13T17:39:04.727314] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-13T17:39:04.727560] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-13T17:39:04.727615] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-13T17:39:05.071766] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:05.217973] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-13T17:39:05.320855] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:39:05.806500] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T17:39:06.017910] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-13T17:39:06.384634] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T17:39:06.817953] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-13T17:39:07.460701] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:39:07.465844] [INFO ] [REMOTE ] BKD: Full fetch complete (71845 records). [2025-10-13T17:39:07.465957] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-13T17:39:07.622697] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-13T17:39:07.852287] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-13T17:39:07.852370] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-13T17:39:07.853199] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-13T17:39:07.853261] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-13T17:39:07.854607] [DEBUG] [LOCAL ] BKD: Trimmed 71845 records to 50414 (keeping 200 days of data) [2025-10-13T17:39:08.136027] [DEBUG] [LOCAL ] BKD: Primary data saved (50414 records). [2025-10-13T17:39:08.136151] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-13T17:39:08.136229] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKD took 31.6s. Estimated remaining: 4h 42m 38s. Rate: 7.4 symbols/min [2025-10-13T17:39:08.258610] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T17:39:08.335579] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:08.345049] [DEBUG] [LOCAL ] BKN: Loaded 7736 existing records from primary storage. [2025-10-13T17:39:08.345275] [INFO ] [MAIN ] BKN: Loaded 7736 existing records. [2025-10-13T17:39:08.423375] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-13T17:39:08.531092] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:39:08.531312] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-13T17:39:08.531360] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-13T17:39:08.531533] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-13T17:39:08.531589] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-13T17:39:08.893286] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:09.032686] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T17:39:09.217928] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-13T17:39:09.466749] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T17:39:10.017968] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-13T17:39:10.817929] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-13T17:39:11.283580] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T17:39:11.385697] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T17:39:11.617956] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-13T17:39:11.849163] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:39:12.417948] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-13T17:39:13.217914] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-13T17:39:13.263769] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T17:39:14.026077] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-13T17:39:14.030953] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T17:39:14.749312] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T17:39:14.817906] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-13T17:39:14.863596] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T17:39:15.617944] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-13T17:39:16.254454] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T17:39:16.417952] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-13T17:39:17.038474] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:39:17.217968] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-13T17:39:17.978991] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T17:39:18.018082] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-13T17:39:18.057320] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T17:39:18.818048] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-13T17:39:19.307192] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T17:39:19.617966] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-13T17:39:19.998788] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-13T17:39:20.395732] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T17:39:20.417894] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-13T17:39:21.217941] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-13T17:39:21.814860] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T17:39:22.018042] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-13T17:39:22.817945] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-13T17:39:22.870849] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T17:39:22.884574] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T17:39:23.617949] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-13T17:39:24.209903] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T17:39:24.214159] [INFO ] [REMOTE ] BKH: Full fetch complete (52433 records). [2025-10-13T17:39:24.214301] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-13T17:39:24.428052] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-13T17:39:24.612280] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-13T17:39:24.612425] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-13T17:39:24.613180] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-13T17:39:24.613246] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-13T17:39:24.614834] [DEBUG] [LOCAL ] BKH: Trimmed 52433 records to 36967 (keeping 200 days of data) [2025-10-13T17:39:24.857679] [DEBUG] [LOCAL ] BKH: Primary data saved (36967 records). [2025-10-13T17:39:24.857892] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-13T17:39:24.858860] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKH took 25.8s. Estimated remaining: 4h 43m 32s. Rate: 7.3 symbols/min [2025-10-13T17:39:25.042800] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:25.076876] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T17:39:25.118335] [DEBUG] [LOCAL ] BKSY: Loaded 49237 existing records from primary storage. [2025-10-13T17:39:25.118741] [INFO ] [MAIN ] BKSY: Loaded 49237 existing records. [2025-10-13T17:39:25.218026] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-13T17:39:25.300038] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:39:25.300295] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-13T17:39:25.300344] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-13T17:39:25.301061] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-13T17:39:25.301119] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-13T17:39:25.654534] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T17:39:25.688338] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:26.021675] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-13T17:39:26.023405] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:39:26.817943] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-13T17:39:27.400259] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T17:39:27.617879] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-13T17:39:28.381065] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T17:39:28.417883] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-13T17:39:28.932537] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T17:39:29.217934] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-13T17:39:29.950249] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T17:39:30.017898] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-13T17:39:30.144420] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T17:39:30.817939] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-13T17:39:31.347675] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T17:39:31.617939] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-13T17:39:32.417920] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-13T17:39:32.704271] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:39:32.718591] [INFO ] [REMOTE ] BKE: Full fetch complete (50174 records). [2025-10-13T17:39:32.732845] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-13T17:39:32.741098] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T17:39:33.129856] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-13T17:39:33.129965] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-13T17:39:33.130679] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-13T17:39:33.130742] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-13T17:39:33.131846] [DEBUG] [LOCAL ] BKE: Trimmed 50174 records to 33944 (keeping 200 days of data) [2025-10-13T17:39:33.218926] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-13T17:39:33.326024] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T17:39:33.350238] [DEBUG] [LOCAL ] BKE: Primary data saved (33944 records). [2025-10-13T17:39:33.350450] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-13T17:39:33.350555] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKE took 36.0s. Estimated remaining: 4h 43m 26s. Rate: 7.3 symbols/min [2025-10-13T17:39:33.531202] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:33.545019] [DEBUG] [LOCAL ] BKT: Loaded 12155 existing records from primary storage. [2025-10-13T17:39:33.545308] [INFO ] [MAIN ] BKT: Loaded 12155 existing records. [2025-10-13T17:39:33.726919] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:39:33.727197] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-13T17:39:33.727248] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-13T17:39:33.727763] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-13T17:39:33.728090] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-13T17:39:34.023116] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-13T17:39:34.109788] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:34.817931] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-13T17:39:35.265365] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-13T17:39:35.486603] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T17:39:35.535976] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-13T17:39:35.617901] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-13T17:39:36.288678] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-13T17:39:36.417913] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-13T17:39:37.143693] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-13T17:39:37.217933] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-13T17:39:38.017955] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-13T17:39:38.817952] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-13T17:39:39.185456] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T17:39:39.510571] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T17:39:39.512246] [INFO ] [REMOTE ] BKN: Full fetch complete (11471 records). [2025-10-13T17:39:39.512341] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-13T17:39:39.623158] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-13T17:39:39.910505] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-13T17:39:39.910590] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-13T17:39:39.910980] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-13T17:39:39.911040] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-13T17:39:39.911483] [DEBUG] [LOCAL ] BKN: Trimmed 11471 records to 7347 (keeping 200 days of data) [2025-10-13T17:39:39.957382] [DEBUG] [LOCAL ] BKN: Primary data saved (7347 records). [2025-10-13T17:39:39.957582] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-13T17:39:39.957775] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKN took 31.8s. Estimated remaining: 4h 43m 6s. Rate: 7.3 symbols/min [2025-10-13T17:39:40.162884] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:40.163160] [DEBUG] [LOCAL ] BKU: No existing data file found in primary storage. [2025-10-13T17:39:40.163321] [WARN ] [MAIN ] BKU: No existing data found, performing full refresh instead. [2025-10-13T17:39:40.163582] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-13T17:39:40.163690] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-13T17:39:40.163800] [DEBUG] [LOCAL ] BKU: No primary data file found to delete. [2025-10-13T17:39:40.163983] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-13T17:39:40.329605] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-13T17:39:40.432637] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-13T17:39:40.622869] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:41.217920] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-13T17:39:41.351184] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T17:39:41.737862] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-13T17:39:41.744381] [INFO ] [REMOTE ] BKKT: Full fetch complete (51047 records). [2025-10-13T17:39:41.744602] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-13T17:39:42.027222] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-13T17:39:42.129424] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-13T17:39:42.129516] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-13T17:39:42.130338] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-13T17:39:42.130402] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-13T17:39:42.131554] [DEBUG] [LOCAL ] BKKT: Trimmed 51047 records to 36153 (keeping 200 days of data) [2025-10-13T17:39:42.337804] [DEBUG] [LOCAL ] BKKT: Primary data saved (36153 records). [2025-10-13T17:39:42.337939] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-13T17:39:42.338046] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKKT took 38.0s. Estimated remaining: 4h 42m 17s. Rate: 7.4 symbols/min [2025-10-13T17:39:42.510298] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:39:42.541615] [DEBUG] [LOCAL ] BKV: Loaded 30370 existing records from primary storage. [2025-10-13T17:39:42.542052] [INFO ] [MAIN ] BKV: Loaded 30370 existing records. [2025-10-13T17:39:42.755052] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:39:42.751373] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T17:39:42.755832] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-13T17:39:42.759060] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-13T17:39:42.759321] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-13T17:39:42.759364] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-13T17:39:42.822859] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-13T17:39:43.134171] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:39:43.164756] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T17:39:43.617962] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-13T17:39:44.417968] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-13T17:39:44.470587] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T17:39:45.046939] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T17:39:45.098507] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T17:39:45.217924] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-13T17:39:46.018021] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-13T17:39:46.806838] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T17:39:46.817900] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-13T17:39:46.955334] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T17:39:47.617993] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-13T17:39:48.332297] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T17:39:48.382951] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T17:39:48.417922] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-13T17:39:49.217955] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-13T17:39:50.017948] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-13T17:39:50.403127] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T17:39:50.471890] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-13T17:39:50.817965] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-13T17:39:51.270836] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T17:39:51.617951] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-13T17:39:52.417956] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-13T17:39:52.998826] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T17:39:53.055528] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-13T17:39:53.110315] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-13T17:39:53.217966] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-13T17:39:54.018043] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-13T17:39:54.817906] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-13T17:39:55.036392] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T17:39:55.478525] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T17:39:55.617946] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-13T17:39:55.908184] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T17:39:56.417950] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-13T17:39:56.974436] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T17:39:57.217998] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-13T17:39:57.235414] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T17:39:58.017953] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-13T17:39:58.818073] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-13T17:39:58.903019] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:39:59.268090] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T17:39:59.617948] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-13T17:40:00.343997] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T17:40:00.417970] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-13T17:40:00.881087] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T17:40:01.218007] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-13T17:40:01.651577] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T17:40:02.018055] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-13T17:40:02.047125] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T17:40:02.817957] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-13T17:40:03.440342] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T17:40:03.617967] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-13T17:40:04.202593] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T17:40:04.418013] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-13T17:40:04.603293] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T17:40:05.217970] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-13T17:40:05.400704] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T17:40:06.017948] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-13T17:40:06.817965] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-13T17:40:07.326107] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-13T17:40:07.335438] [INFO ] [REMOTE ] BKSY: Full fetch complete (70100 records). [2025-10-13T17:40:07.335745] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-13T17:40:07.621794] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-13T17:40:07.818564] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-13T17:40:07.818788] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-13T17:40:07.819844] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-13T17:40:07.819931] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-13T17:40:07.862164] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T17:40:07.862334] [DEBUG] [LOCAL ] BKSY: Trimmed 70100 records to 48596 (keeping 200 days of data) [2025-10-13T17:40:07.984342] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T17:40:08.205089] [DEBUG] [LOCAL ] BKSY: Primary data saved (48596 records). [2025-10-13T17:40:08.205280] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-13T17:40:08.205381] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKSY took 43.3s. Estimated remaining: 4h 44m 15s. Rate: 7.3 symbols/min [2025-10-13T17:40:08.394965] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:08.417955] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-13T17:40:08.436473] [DEBUG] [LOCAL ] BLCO: Loaded 36059 existing records from primary storage. [2025-10-13T17:40:08.436950] [INFO ] [MAIN ] BLCO: Loaded 36059 existing records. [2025-10-13T17:40:08.656566] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:08.657084] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-13T17:40:08.657151] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-13T17:40:08.657567] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-13T17:40:08.657635] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-13T17:40:09.013164] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:40:09.112247] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:09.217938] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-13T17:40:10.017898] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-13T17:40:10.091821] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T17:40:10.636529] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T17:40:10.817946] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-13T17:40:11.617964] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-13T17:40:12.177255] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T17:40:12.417935] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-13T17:40:12.574026] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T17:40:12.576754] [INFO ] [REMOTE ] BKT: Full fetch complete (16083 records). [2025-10-13T17:40:12.576860] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-13T17:40:12.979986] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-13T17:40:12.980109] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-13T17:40:12.980620] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-13T17:40:12.980712] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-13T17:40:12.981437] [DEBUG] [LOCAL ] BKT: Trimmed 16083 records to 12267 (keeping 200 days of data) [2025-10-13T17:40:13.074095] [DEBUG] [LOCAL ] BKT: Primary data saved (12267 records). [2025-10-13T17:40:13.074281] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-13T17:40:13.074433] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKT took 39.7s. Estimated remaining: 4h 43m 43s. Rate: 7.3 symbols/min [2025-10-13T17:40:13.219244] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-13T17:40:13.254126] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:13.285728] [DEBUG] [LOCAL ] BLD: Loaded 28106 existing records from primary storage. [2025-10-13T17:40:13.286108] [INFO ] [MAIN ] BLD: Loaded 28106 existing records. [2025-10-13T17:40:13.483534] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:13.484842] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-13T17:40:13.484932] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-13T17:40:13.486344] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-13T17:40:13.486494] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-13T17:40:13.878136] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:13.906952] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T17:40:13.941775] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (3.92 seconds). [2025-10-13T17:40:13.946146] [INFO ] [REMOTE ] BKV: Full fetch complete (44802 records). [2025-10-13T17:40:13.946435] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-13T17:40:14.023033] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-13T17:40:14.368056] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-13T17:40:14.368148] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-13T17:40:14.369353] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-13T17:40:14.369417] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-13T17:40:14.371377] [DEBUG] [LOCAL ] BKV: Trimmed 44802 records to 29753 (keeping 200 days of data) [2025-10-13T17:40:14.542380] [DEBUG] [LOCAL ] BKV: Primary data saved (29753 records). [2025-10-13T17:40:14.542522] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-13T17:40:14.542604] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKV took 32.2s. Estimated remaining: 4h 42m 47s. Rate: 7.3 symbols/min [2025-10-13T17:40:14.742582] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:14.769043] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:40:14.821281] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-13T17:40:14.823169] [DEBUG] [LOCAL ] BLDR: Loaded 52473 existing records from primary storage. [2025-10-13T17:40:14.823547] [INFO ] [MAIN ] BLDR: Loaded 52473 existing records. [2025-10-13T17:40:15.002534] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:15.002957] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-13T17:40:15.003054] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-13T17:40:15.003687] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-13T17:40:15.003884] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-13T17:40:15.200905] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T17:40:15.392432] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:15.617918] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-13T17:40:16.370298] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T17:40:16.417897] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-13T17:40:17.217901] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-13T17:40:17.455089] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T17:40:18.017930] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-13T17:40:18.182165] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T17:40:18.186916] [INFO ] [REMOTE ] BKU: Full fetch complete (60324 records). [2025-10-13T17:40:18.187032] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-13T17:40:18.593322] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-13T17:40:18.593936] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-13T17:40:18.594458] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T17:40:18.595223] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-13T17:40:18.601224] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-13T17:40:18.602360] [DEBUG] [LOCAL ] BKU: Trimmed 60324 records to 41954 (keeping 200 days of data) [2025-10-13T17:40:18.818394] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-13T17:40:18.865043] [DEBUG] [LOCAL ] BKU: Primary data saved (41954 records). [2025-10-13T17:40:18.865178] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-13T17:40:18.865261] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BKU took 38.9s. Estimated remaining: 4h 42m 12s. Rate: 7.4 symbols/min [2025-10-13T17:40:19.041354] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:19.058966] [DEBUG] [LOCAL ] BLE: Loaded 14251 existing records from primary storage. [2025-10-13T17:40:19.059282] [INFO ] [MAIN ] BLE: Loaded 14251 existing records. [2025-10-13T17:40:19.263491] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:19.264086] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-13T17:40:19.264282] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-13T17:40:19.264591] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-13T17:40:19.264696] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-13T17:40:19.377888] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T17:40:19.627085] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-13T17:40:19.674228] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:20.418039] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-13T17:40:20.616002] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T17:40:21.045728] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T17:40:21.135476] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T17:40:21.217929] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-13T17:40:22.018033] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-13T17:40:22.817910] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-13T17:40:22.945609] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T17:40:23.619326] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T17:40:23.619484] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-13T17:40:24.147316] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T17:40:24.417924] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-13T17:40:25.217963] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-13T17:40:25.367682] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T17:40:25.470007] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T17:40:25.912339] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T17:40:26.018007] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-13T17:40:26.129236] [DEBUG] [REMOTE ] BLE: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-13T17:40:26.129618] [WARN ] [REMOTE ] BLE: No data returned for month 2025-02 [2025-10-13T17:40:26.129787] [FATAL] [REMOTE ] BLE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:40:26.129884] [FATAL] [MAIN ] BLE: Failed to fetch primary data. [2025-10-13T17:40:26.129946] [WARN ] [MAIN ] BLE: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:40:26.130023] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-13T17:40:26.130139] [DEBUG] [LOCAL ] BLE: No primary data file found to delete. [2025-10-13T17:40:26.130185] [INFO ] [LOCAL ] BLE: Starting deletion of derivative data. [2025-10-13T17:40:26.130364] [DEBUG] [LOCAL ] BLE: Deleted derivative data file. [2025-10-13T17:40:26.130457] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLE took 7.3s. Estimated remaining: 4h 41m 58s. Rate: 7.4 symbols/min [2025-10-13T17:40:26.322971] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:26.362799] [DEBUG] [LOCAL ] BLK: Loaded 34578 existing records from primary storage. [2025-10-13T17:40:26.363152] [INFO ] [MAIN ] BLK: Loaded 34578 existing records. [2025-10-13T17:40:26.549306] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:26.549605] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-13T17:40:26.549711] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-13T17:40:26.550003] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-13T17:40:26.550076] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-13T17:40:26.823099] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-13T17:40:26.947425] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:27.617939] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-13T17:40:28.262126] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T17:40:28.417955] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-13T17:40:29.217919] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-13T17:40:29.551451] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T17:40:29.630176] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T17:40:30.017955] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-13T17:40:30.772489] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T17:40:30.817924] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-13T17:40:31.408903] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T17:40:31.617968] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-13T17:40:31.964516] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T17:40:32.418009] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-13T17:40:33.217971] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-13T17:40:33.410981] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T17:40:33.784014] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T17:40:34.017910] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-13T17:40:34.162912] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T17:40:34.817945] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-13T17:40:35.337423] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T17:40:35.341178] [INFO ] [REMOTE ] BLCO: Full fetch complete (52243 records). [2025-10-13T17:40:35.341275] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-13T17:40:35.623064] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-13T17:40:35.725069] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-13T17:40:35.725147] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-13T17:40:35.725787] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-13T17:40:35.725847] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-13T17:40:35.727253] [DEBUG] [LOCAL ] BLCO: Trimmed 52243 records to 35532 (keeping 200 days of data) [2025-10-13T17:40:35.930763] [DEBUG] [LOCAL ] BLCO: Primary data saved (35532 records). [2025-10-13T17:40:35.930918] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-13T17:40:35.931800] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLCO took 27.7s. Estimated remaining: 4h 42m 1s. Rate: 7.4 symbols/min [2025-10-13T17:40:36.107098] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:36.159984] [DEBUG] [LOCAL ] BLND: Loaded 49952 existing records from primary storage. [2025-10-13T17:40:36.160331] [INFO ] [MAIN ] BLND: Loaded 49952 existing records. [2025-10-13T17:40:36.337809] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:36.338197] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-13T17:40:36.338251] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-13T17:40:36.338796] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-13T17:40:36.338853] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-13T17:40:36.419210] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-13T17:40:36.704088] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:36.727436] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T17:40:37.217922] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-13T17:40:37.393846] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T17:40:37.794787] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T17:40:38.017920] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-13T17:40:38.817926] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-13T17:40:38.918172] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T17:40:39.317504] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T17:40:39.617906] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-13T17:40:40.374191] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:40:40.417893] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-13T17:40:40.878779] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T17:40:41.217927] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-13T17:40:42.018023] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-13T17:40:42.149282] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T17:40:42.817905] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-13T17:40:42.860814] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:40:42.889521] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T17:40:42.892668] [INFO ] [REMOTE ] BLD: Full fetch complete (39960 records). [2025-10-13T17:40:42.892754] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-13T17:40:43.262294] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-13T17:40:43.262379] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-13T17:40:43.262978] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-13T17:40:43.263039] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-13T17:40:43.263916] [DEBUG] [LOCAL ] BLD: Trimmed 39960 records to 27619 (keeping 200 days of data) [2025-10-13T17:40:43.428003] [DEBUG] [LOCAL ] BLD: Primary data saved (27619 records). [2025-10-13T17:40:43.428146] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-13T17:40:43.428259] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLD took 30.4s. Estimated remaining: 4h 41m 48s. Rate: 7.4 symbols/min [2025-10-13T17:40:43.606313] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:43.606516] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-13T17:40:43.606556] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-13T17:40:43.606691] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-13T17:40:43.606745] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-13T17:40:43.606789] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-13T17:40:43.606854] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-13T17:40:43.627187] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-13T17:40:43.961271] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:44.225124] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T17:40:44.417939] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-13T17:40:45.202892] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T17:40:45.217889] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-13T17:40:46.017963] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-13T17:40:46.207075] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:40:46.207476] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-13T17:40:46.207573] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:40:46.207627] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-13T17:40:46.207715] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:40:46.207795] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-13T17:40:46.207869] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-13T17:40:46.207907] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-13T17:40:46.207947] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-13T17:40:46.208033] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLSH took 2.8s. Estimated remaining: 4h 41m 3s. Rate: 7.4 symbols/min [2025-10-13T17:40:46.381605] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:46.406565] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-13T17:40:46.425343] [DEBUG] [LOCAL ] BLW: Loaded 13518 existing records from primary storage. [2025-10-13T17:40:46.425598] [INFO ] [MAIN ] BLW: Loaded 13518 existing records. [2025-10-13T17:40:46.612203] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:46.612435] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-13T17:40:46.612483] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-13T17:40:46.612730] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-13T17:40:46.612812] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-13T17:40:46.824300] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-13T17:40:46.991231] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:47.020818] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T17:40:47.617925] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-13T17:40:48.417927] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-13T17:40:48.585453] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T17:40:48.641840] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T17:40:49.217927] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-13T17:40:49.988730] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-13T17:40:50.017901] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-13T17:40:50.221967] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:40:50.815788] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T17:40:50.818801] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-13T17:40:51.617955] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-13T17:40:52.417967] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-13T17:40:52.474838] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T17:40:52.525891] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-13T17:40:53.217924] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-13T17:40:54.017939] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-13T17:40:54.303969] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-13T17:40:54.309511] [INFO ] [REMOTE ] BLDR: Full fetch complete (74519 records). [2025-10-13T17:40:54.309703] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-13T17:40:54.718766] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-13T17:40:54.719574] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-13T17:40:54.720824] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-13T17:40:54.720955] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-13T17:40:54.722998] [DEBUG] [LOCAL ] BLDR: Trimmed 74519 records to 51810 (keeping 200 days of data) [2025-10-13T17:40:54.827090] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-13T17:40:54.867021] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T17:40:54.886666] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T17:40:55.120688] [DEBUG] [LOCAL ] BLDR: Primary data saved (51810 records). [2025-10-13T17:40:55.120849] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-13T17:40:55.120946] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLDR took 40.6s. Estimated remaining: 4h 41m 0s. Rate: 7.4 symbols/min [2025-10-13T17:40:55.290117] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:40:55.305820] [DEBUG] [LOCAL ] BLX: Loaded 15813 existing records from primary storage. [2025-10-13T17:40:55.306054] [INFO ] [MAIN ] BLX: Loaded 15813 existing records. [2025-10-13T17:40:55.477066] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:40:55.477330] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-13T17:40:55.477378] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-13T17:40:55.477569] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-13T17:40:55.477625] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-13T17:40:55.623060] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-13T17:40:55.835313] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:40:56.399098] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T17:40:56.417883] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-13T17:40:56.712393] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T17:40:57.217944] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-13T17:40:57.228881] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T17:40:58.017921] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-13T17:40:58.827511] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-13T17:40:58.829987] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T17:40:59.497553] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-13T17:40:59.525449] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:40:59.617924] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-13T17:41:00.417936] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-13T17:41:01.217950] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-13T17:41:01.418342] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T17:41:02.017940] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-13T17:41:02.030464] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T17:41:02.473785] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T17:41:02.818046] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-13T17:41:02.955661] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T17:41:03.617923] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-13T17:41:04.417900] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-13T17:41:04.619729] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T17:41:04.715537] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T17:41:05.060366] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T17:41:05.217923] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-13T17:41:06.017961] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-13T17:41:06.181270] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T17:41:06.183517] [INFO ] [REMOTE ] BLW: Full fetch complete (19268 records). [2025-10-13T17:41:06.183588] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-13T17:41:06.581169] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-13T17:41:06.581262] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-13T17:41:06.581719] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-13T17:41:06.581782] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-13T17:41:06.582619] [DEBUG] [LOCAL ] BLW: Trimmed 19268 records to 13268 (keeping 200 days of data) [2025-10-13T17:41:06.675081] [DEBUG] [LOCAL ] BLW: Primary data saved (13268 records). [2025-10-13T17:41:06.675227] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-13T17:41:06.675308] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLW took 20.5s. Estimated remaining: 4h 41m 15s. Rate: 7.4 symbols/min [2025-10-13T17:41:06.823031] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-13T17:41:06.848978] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:06.883731] [DEBUG] [LOCAL ] BMA: Loaded 36296 existing records from primary storage. [2025-10-13T17:41:06.884066] [INFO ] [MAIN ] BMA: Loaded 36296 existing records. [2025-10-13T17:41:07.061229] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:07.061497] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-13T17:41:07.061551] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-13T17:41:07.061841] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-13T17:41:07.061898] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-13T17:41:07.424191] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:07.618015] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-13T17:41:07.619732] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:41:07.670035] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T17:41:08.417925] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-13T17:41:09.203710] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:41:09.217890] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-13T17:41:10.024045] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-13T17:41:10.026419] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T17:41:10.031920] [INFO ] [REMOTE ] BLND: Full fetch complete (72196 records). [2025-10-13T17:41:10.032033] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-13T17:41:10.428903] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-13T17:41:10.429200] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-13T17:41:10.430223] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-13T17:41:10.430394] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-13T17:41:10.432003] [DEBUG] [LOCAL ] BLND: Trimmed 72196 records to 49275 (keeping 200 days of data) [2025-10-13T17:41:10.537913] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T17:41:10.731778] [DEBUG] [LOCAL ] BLND: Primary data saved (49275 records). [2025-10-13T17:41:10.731927] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-13T17:41:10.732669] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLND took 34.8s. Estimated remaining: 4h 40m 39s. Rate: 7.4 symbols/min [2025-10-13T17:41:10.823097] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-13T17:41:10.905619] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:10.919387] [DEBUG] [LOCAL ] BME: Loaded 11309 existing records from primary storage. [2025-10-13T17:41:10.919671] [INFO ] [MAIN ] BME: Loaded 11309 existing records. [2025-10-13T17:41:11.099683] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:11.109825] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-13T17:41:11.110361] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-13T17:41:11.110775] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-13T17:41:11.110817] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-13T17:41:11.112286] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-13T17:41:11.461755] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:11.617923] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-13T17:41:12.179038] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:41:12.417945] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-13T17:41:12.859201] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T17:41:13.217940] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-13T17:41:14.017902] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-13T17:41:14.151704] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T17:41:14.170173] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-13T17:41:14.817935] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-13T17:41:15.038690] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T17:41:15.578863] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T17:41:15.617914] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-13T17:41:16.417900] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-13T17:41:16.535020] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-13T17:41:17.218006] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-13T17:41:17.265274] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T17:41:18.017918] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-13T17:41:18.426687] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T17:41:18.673444] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:41:18.817898] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-13T17:41:19.549916] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-13T17:41:19.617907] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-13T17:41:20.344507] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T17:41:20.417900] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-13T17:41:21.200407] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T17:41:21.217887] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-13T17:41:21.932585] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T17:41:22.017921] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-13T17:41:22.818008] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-13T17:41:22.869290] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T17:41:23.618032] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-13T17:41:24.372593] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:41:24.417926] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-13T17:41:24.549027] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T17:41:25.218033] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-13T17:41:25.966012] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T17:41:26.017919] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-13T17:41:26.151282] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T17:41:26.818000] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-13T17:41:27.459569] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T17:41:27.617954] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-13T17:41:28.337059] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T17:41:28.417947] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-13T17:41:28.533792] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T17:41:29.218004] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-13T17:41:29.803873] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T17:41:30.017951] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-13T17:41:30.124862] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T17:41:30.126997] [INFO ] [REMOTE ] BME: Full fetch complete (15963 records). [2025-10-13T17:41:30.127071] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-13T17:41:30.492887] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-13T17:41:30.492972] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-13T17:41:30.493357] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-13T17:41:30.493396] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-13T17:41:30.493914] [DEBUG] [LOCAL ] BME: Trimmed 15963 records to 11201 (keeping 200 days of data) [2025-10-13T17:41:30.562211] [DEBUG] [LOCAL ] BME: Primary data saved (11201 records). [2025-10-13T17:41:30.562356] [INFO ] [MAIN ] BME: Full history saved. [2025-10-13T17:41:30.562440] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BME took 19.8s. Estimated remaining: 4h 41m 51s. Rate: 7.3 symbols/min [2025-10-13T17:41:30.726740] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:30.752755] [DEBUG] [LOCAL ] BMEZ: Loaded 26860 existing records from primary storage. [2025-10-13T17:41:30.753028] [INFO ] [MAIN ] BMEZ: Loaded 26860 existing records. [2025-10-13T17:41:30.825183] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-13T17:41:30.932307] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:30.932570] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-13T17:41:30.932624] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-13T17:41:30.932985] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-13T17:41:30.933044] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-13T17:41:31.299336] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:31.618289] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-13T17:41:31.622034] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-13T17:41:31.627096] [INFO ] [REMOTE ] BLK: Full fetch complete (52549 records). [2025-10-13T17:41:31.627190] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-13T17:41:32.063370] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-13T17:41:32.063547] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-13T17:41:32.064415] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-13T17:41:32.064601] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-13T17:41:32.067786] [DEBUG] [LOCAL ] BLK: Trimmed 52549 records to 34143 (keeping 200 days of data) [2025-10-13T17:41:32.226034] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:41:32.343776] [DEBUG] [LOCAL ] BLK: Primary data saved (34143 records). [2025-10-13T17:41:32.343969] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-13T17:41:32.344070] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BLK took 1m 6s. Estimated remaining: 4h 40m 59s. Rate: 7.4 symbols/min [2025-10-13T17:41:32.423128] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-13T17:41:32.531549] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:32.557826] [DEBUG] [LOCAL ] BMI: Loaded 24727 existing records from primary storage. [2025-10-13T17:41:32.558200] [INFO ] [MAIN ] BMI: Loaded 24727 existing records. [2025-10-13T17:41:32.756031] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:32.756465] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-13T17:41:32.756525] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-13T17:41:32.756807] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-13T17:41:32.756867] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-13T17:41:33.170511] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:33.173761] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T17:41:33.209129] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T17:41:33.217880] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-13T17:41:34.017900] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-13T17:41:34.126594] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T17:41:34.129222] [INFO ] [REMOTE ] BLX: Full fetch complete (22409 records). [2025-10-13T17:41:34.129348] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-13T17:41:34.508386] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-13T17:41:34.508499] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-13T17:41:34.509046] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-13T17:41:34.509119] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-13T17:41:34.510195] [DEBUG] [LOCAL ] BLX: Trimmed 22409 records to 15613 (keeping 200 days of data) [2025-10-13T17:41:34.609513] [DEBUG] [LOCAL ] BLX: Primary data saved (15613 records). [2025-10-13T17:41:34.609741] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-13T17:41:34.609855] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BLX took 39.5s. Estimated remaining: 4h 40m 11s. Rate: 7.4 symbols/min [2025-10-13T17:41:34.786552] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:34.786812] [DEBUG] [LOCAL ] BMN: No existing data file found in primary storage. [2025-10-13T17:41:34.786857] [WARN ] [MAIN ] BMN: No existing data found, performing full refresh instead. [2025-10-13T17:41:34.786988] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-13T17:41:34.787029] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-13T17:41:34.787069] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-10-13T17:41:34.787102] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-13T17:41:34.823105] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-13T17:41:35.189312] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:35.367274] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T17:41:35.617946] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-13T17:41:36.253086] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T17:41:36.417901] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-13T17:41:36.772890] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T17:41:37.217935] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-13T17:41:38.018025] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-13T17:41:38.097031] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:41:38.153554] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T17:41:38.574559] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-13T17:41:38.817954] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-13T17:41:39.617969] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-13T17:41:39.885073] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T17:41:40.417952] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-13T17:41:40.528991] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T17:41:41.218029] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-13T17:41:41.510200] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:41:41.515809] [INFO ] [REMOTE ] BMA: Full fetch complete (51598 records). [2025-10-13T17:41:41.516031] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-13T17:41:41.933628] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-13T17:41:41.933870] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-13T17:41:41.934855] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-13T17:41:41.934923] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-13T17:41:41.936625] [DEBUG] [LOCAL ] BMA: Trimmed 51598 records to 35960 (keeping 200 days of data) [2025-10-13T17:41:42.030568] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-13T17:41:42.164192] [DEBUG] [LOCAL ] BMA: Primary data saved (35960 records). [2025-10-13T17:41:42.164349] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-13T17:41:42.164436] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMA took 35.5s. Estimated remaining: 4h 39m 59s. Rate: 7.4 symbols/min [2025-10-13T17:41:42.336410] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:42.375346] [DEBUG] [LOCAL ] BMO: Loaded 41706 existing records from primary storage. [2025-10-13T17:41:42.382455] [INFO ] [MAIN ] BMO: Loaded 41706 existing records. [2025-10-13T17:41:42.487955] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T17:41:42.580872] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:42.581173] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-13T17:41:42.581221] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-13T17:41:42.581629] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-13T17:41:42.581716] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-13T17:41:42.827755] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-13T17:41:42.953684] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:42.972114] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-13T17:41:43.333721] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T17:41:43.617921] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-13T17:41:44.052181] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T17:41:44.417930] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-13T17:41:44.847734] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T17:41:45.217933] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-13T17:41:46.017959] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-13T17:41:46.563907] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T17:41:46.781874] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T17:41:46.817929] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-13T17:41:47.275006] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-13T17:41:47.617949] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-13T17:41:48.418024] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-13T17:41:49.091433] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T17:41:49.217935] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-13T17:41:49.518254] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T17:41:50.017949] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-13T17:41:50.679155] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T17:41:50.817896] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-13T17:41:51.225611] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T17:41:51.617931] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-13T17:41:52.246430] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-13T17:41:52.276382] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T17:41:52.417941] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-13T17:41:53.217947] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-13T17:41:54.017964] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-13T17:41:54.090921] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T17:41:54.260475] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T17:41:54.817950] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-13T17:41:54.948558] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T17:41:55.276620] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T17:41:55.618002] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-13T17:41:56.092190] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T17:41:56.418024] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-13T17:41:56.888998] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T17:41:57.217939] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-13T17:41:57.725444] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-13T17:41:57.726547] [INFO ] [REMOTE ] BMN: Full fetch complete (3715 records). [2025-10-13T17:41:57.726948] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-13T17:41:58.023105] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-13T17:41:58.092027] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-13T17:41:58.092119] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-13T17:41:58.092294] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-13T17:41:58.092357] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-13T17:41:58.092796] [DEBUG] [LOCAL ] BMN: Trimmed 3715 records to 2587 (keeping 200 days of data) [2025-10-13T17:41:58.111196] [DEBUG] [LOCAL ] BMN: Primary data saved (2587 records). [2025-10-13T17:41:58.111353] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-13T17:41:58.111476] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMN took 23.5s. Estimated remaining: 4h 40m 43s. Rate: 7.3 symbols/min [2025-10-13T17:41:58.283141] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:41:58.336299] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-10-13T17:41:58.336844] [INFO ] [MAIN ] BMY: Loaded 54537 existing records. [2025-10-13T17:41:58.511463] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:41:58.511732] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-13T17:41:58.511787] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-13T17:41:58.512300] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-13T17:41:58.512366] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-13T17:41:58.823085] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-13T17:41:58.862712] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:41:59.617948] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-13T17:41:59.733327] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T17:41:59.854535] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T17:42:00.417914] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-13T17:42:01.217927] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-13T17:42:01.496563] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T17:42:01.632388] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T17:42:02.017954] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-13T17:42:02.229374] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T17:42:02.817958] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-13T17:42:03.072969] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-13T17:42:03.075951] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40256 records). [2025-10-13T17:42:03.076026] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-13T17:42:03.076621] [FATAL] [VALIDATOR ] BMEZ: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:42:03.076729] [FATAL] [MAIN ] BMEZ: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:42:03.076774] [WARN ] [MAIN ] BMEZ: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:42:03.076813] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-13T17:42:03.076885] [DEBUG] [LOCAL ] BMEZ: No primary data file found to delete. [2025-10-13T17:42:03.076939] [INFO ] [LOCAL ] BMEZ: Starting deletion of derivative data. [2025-10-13T17:42:03.077301] [DEBUG] [LOCAL ] BMEZ: Deleted derivative data file. [2025-10-13T17:42:03.077391] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMEZ took 32.5s. Estimated remaining: 4h 40m 14s. Rate: 7.4 symbols/min [2025-10-13T17:42:03.249742] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:03.305333] [DEBUG] [LOCAL ] BN: Loaded 53765 existing records from primary storage. [2025-10-13T17:42:03.305693] [INFO ] [MAIN ] BN: Loaded 53765 existing records. [2025-10-13T17:42:03.479120] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:03.479328] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-13T17:42:03.479372] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-13T17:42:03.479840] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-13T17:42:03.479896] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-13T17:42:03.621032] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-13T17:42:03.831863] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:04.417918] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-13T17:42:04.566885] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T17:42:05.217854] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-13T17:42:05.301156] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:42:06.018037] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-13T17:42:06.445506] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T17:42:06.712944] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T17:42:06.817915] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-13T17:42:07.617996] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-13T17:42:07.791814] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T17:42:07.912400] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-13T17:42:08.418003] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-13T17:42:08.892499] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T17:42:09.217966] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-13T17:42:10.018024] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-13T17:42:10.228832] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T17:42:10.277322] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T17:42:10.817961] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-13T17:42:11.618094] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-13T17:42:12.086869] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-13T17:42:12.140232] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:42:12.418043] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-13T17:42:13.030038] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T17:42:13.218023] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-13T17:42:14.018026] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-13T17:42:14.407196] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T17:42:14.491517] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-13T17:42:14.818001] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-13T17:42:15.601509] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T17:42:15.605947] [INFO ] [REMOTE ] BMO: Full fetch complete (59510 records). [2025-10-13T17:42:15.606050] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-13T17:42:15.626979] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-13T17:42:15.989867] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-13T17:42:15.989953] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-13T17:42:15.990839] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-13T17:42:15.990910] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-13T17:42:15.992881] [DEBUG] [LOCAL ] BMO: Trimmed 59510 records to 41112 (keeping 200 days of data) [2025-10-13T17:42:16.257772] [DEBUG] [LOCAL ] BMO: Primary data saved (41112 records). [2025-10-13T17:42:16.257916] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-13T17:42:16.258024] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 34.1s. Estimated remaining: 4h 40m 39s. Rate: 7.3 symbols/min [2025-10-13T17:42:16.419439] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-13T17:42:16.439170] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:16.471050] [DEBUG] [LOCAL ] BNED: Loaded 29437 existing records from primary storage. [2025-10-13T17:42:16.471399] [INFO ] [MAIN ] BNED: Loaded 29437 existing records. [2025-10-13T17:42:16.666054] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:16.666505] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-13T17:42:16.667014] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-13T17:42:16.667607] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-13T17:42:16.667780] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-13T17:42:16.996805] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-13T17:42:17.155346] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:17.161922] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T17:42:17.217945] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-13T17:42:18.017935] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-13T17:42:18.384131] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T17:42:18.614124] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T17:42:18.818025] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-13T17:42:19.617895] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-13T17:42:19.914914] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T17:42:19.918782] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T17:42:19.933865] [INFO ] [REMOTE ] BMI: Full fetch complete (33136 records). [2025-10-13T17:42:19.934598] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-13T17:42:20.321561] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-13T17:42:20.321677] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-13T17:42:20.322253] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-13T17:42:20.322380] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-13T17:42:20.323307] [DEBUG] [LOCAL ] BMI: Trimmed 33136 records to 24442 (keeping 200 days of data) [2025-10-13T17:42:20.418163] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-13T17:42:20.494898] [DEBUG] [LOCAL ] BMI: Primary data saved (24442 records). [2025-10-13T17:42:20.495075] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-13T17:42:20.495205] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMI took 48.2s. Estimated remaining: 4h 40m 5s. Rate: 7.4 symbols/min [2025-10-13T17:42:20.661776] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:20.668906] [DEBUG] [LOCAL ] BNH: Loaded 5306 existing records from primary storage. [2025-10-13T17:42:20.669147] [INFO ] [MAIN ] BNH: Loaded 5306 existing records. [2025-10-13T17:42:20.857147] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:20.857614] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-13T17:42:20.857803] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-13T17:42:20.858062] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-13T17:42:20.858124] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-13T17:42:21.111879] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T17:42:21.228694] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-13T17:42:21.275591] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:22.030555] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-13T17:42:22.039357] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T17:42:22.426852] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T17:42:22.818008] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-13T17:42:23.560249] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T17:42:23.617938] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-13T17:42:23.907526] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:42:24.172475] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T17:42:24.418056] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-13T17:42:25.218000] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-13T17:42:26.017937] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-13T17:42:26.120243] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T17:42:26.580914] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T17:42:26.817919] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-13T17:42:27.006332] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T17:42:27.617955] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-13T17:42:28.417919] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-13T17:42:28.679163] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T17:42:28.886483] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T17:42:29.218032] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-13T17:42:29.790188] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T17:42:30.017926] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-13T17:42:30.408539] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T17:42:30.817946] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-13T17:42:31.617924] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-13T17:42:31.889485] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T17:42:31.956421] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T17:42:32.417960] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-13T17:42:33.217898] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-13T17:42:33.539086] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T17:42:33.681518] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T17:42:34.017924] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-13T17:42:34.817934] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-13T17:42:34.900574] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T17:42:35.244050] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T17:42:35.284149] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T17:42:35.289753] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-13T17:42:35.289928] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-13T17:42:35.629401] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-13T17:42:35.688446] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-13T17:42:35.688672] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-13T17:42:35.689542] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-13T17:42:35.689586] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-13T17:42:35.691342] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-10-13T17:42:36.031459] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-13T17:42:36.031713] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-13T17:42:36.031808] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BMY took 37.9s. Estimated remaining: 4h 40m 45s. Rate: 7.3 symbols/min [2025-10-13T17:42:36.199737] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:36.203964] [DEBUG] [LOCAL ] BNJ: Loaded 2710 existing records from primary storage. [2025-10-13T17:42:36.204122] [INFO ] [MAIN ] BNJ: Loaded 2710 existing records. [2025-10-13T17:42:36.379755] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:36.380022] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-13T17:42:36.380072] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-13T17:42:36.380251] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-13T17:42:36.380306] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-13T17:42:36.423074] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-13T17:42:36.762249] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:36.779194] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T17:42:37.024503] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-13T17:42:37.218092] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-13T17:42:37.805410] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T17:42:38.018013] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-13T17:42:38.473688] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-13T17:42:38.817935] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-13T17:42:39.617931] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-13T17:42:40.417955] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-13T17:42:40.646507] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T17:42:40.652539] [INFO ] [REMOTE ] BN: Full fetch complete (76713 records). [2025-10-13T17:42:40.652709] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-13T17:42:41.124781] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T17:42:41.124944] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-13T17:42:41.132444] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-13T17:42:41.133745] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-13T17:42:41.134202] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-13T17:42:41.136076] [DEBUG] [LOCAL ] BN: Trimmed 76713 records to 52987 (keeping 200 days of data) [2025-10-13T17:42:41.227387] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-13T17:42:41.264821] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T17:42:41.477231] [DEBUG] [LOCAL ] BN: Primary data saved (52987 records). [2025-10-13T17:42:41.477389] [INFO ] [MAIN ] BN: Full history saved. [2025-10-13T17:42:41.478160] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BN took 38.4s. Estimated remaining: 4h 40m 19s. Rate: 7.3 symbols/min [2025-10-13T17:42:41.643520] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:41.690624] [DEBUG] [LOCAL ] BNL: Loaded 47890 existing records from primary storage. [2025-10-13T17:42:41.690985] [INFO ] [MAIN ] BNL: Loaded 47890 existing records. [2025-10-13T17:42:41.900091] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:41.900407] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-13T17:42:41.900477] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-13T17:42:41.900881] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-13T17:42:41.900948] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-13T17:42:42.020311] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-13T17:42:42.306110] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:42.518037] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-13T17:42:42.549057] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T17:42:42.817950] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-13T17:42:43.317385] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T17:42:43.618007] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-13T17:42:44.139396] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T17:42:44.418001] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-13T17:42:45.218023] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-13T17:42:45.774312] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-13T17:42:46.024071] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-13T17:42:46.045455] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T17:42:46.752614] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T17:42:46.817962] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-13T17:42:47.302369] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T17:42:47.617961] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-13T17:42:48.418067] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-13T17:42:48.909482] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T17:42:48.995851] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T17:42:49.218005] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-13T17:42:50.018026] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-13T17:42:50.420827] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T17:42:50.672469] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T17:42:50.817961] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-13T17:42:51.617957] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-13T17:42:51.865094] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T17:42:51.867999] [INFO ] [REMOTE ] BNED: Full fetch complete (42814 records). [2025-10-13T17:42:51.868088] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-13T17:42:52.252231] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-13T17:42:52.252316] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-13T17:42:52.252986] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-13T17:42:52.253048] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-13T17:42:52.254068] [DEBUG] [LOCAL ] BNED: Trimmed 42814 records to 28770 (keeping 200 days of data) [2025-10-13T17:42:52.418692] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-13T17:42:52.418567] [DEBUG] [LOCAL ] BNED: Primary data saved (28770 records). [2025-10-13T17:42:52.419265] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-13T17:42:52.419395] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNED took 36.2s. Estimated remaining: 4h 40m 29s. Rate: 7.3 symbols/min [2025-10-13T17:42:52.594793] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:52.644852] [DEBUG] [LOCAL ] BNS: Loaded 52233 existing records from primary storage. [2025-10-13T17:42:52.645183] [INFO ] [MAIN ] BNS: Loaded 52233 existing records. [2025-10-13T17:42:52.835055] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:52.835416] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-13T17:42:52.835490] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-13T17:42:52.836106] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-13T17:42:52.836164] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-13T17:42:53.019925] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:42:53.162684] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T17:42:53.167231] [INFO ] [REMOTE ] BNH: Full fetch complete (6942 records). [2025-10-13T17:42:53.177948] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-13T17:42:53.233366] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-13T17:42:53.293912] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:53.655617] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-13T17:42:53.655725] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-13T17:42:53.655942] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-13T17:42:53.655980] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-13T17:42:53.656352] [DEBUG] [LOCAL ] BNH: Trimmed 6942 records to 5246 (keeping 200 days of data) [2025-10-13T17:42:53.688095] [DEBUG] [LOCAL ] BNH: Primary data saved (5246 records). [2025-10-13T17:42:53.688179] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-13T17:42:53.688250] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNH took 33.2s. Estimated remaining: 4h 39m 36s. Rate: 7.4 symbols/min [2025-10-13T17:42:53.856548] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:42:53.861356] [DEBUG] [LOCAL ] BNT: Loaded 3433 existing records from primary storage. [2025-10-13T17:42:53.861506] [INFO ] [MAIN ] BNT: Loaded 3433 existing records. [2025-10-13T17:42:53.932858] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T17:42:54.020446] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-13T17:42:54.047668] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:42:54.047964] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-13T17:42:54.048062] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-13T17:42:54.048208] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-13T17:42:54.048252] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-13T17:42:54.398519] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:42:54.504522] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-13T17:42:54.817917] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-13T17:42:55.617917] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-13T17:42:56.417950] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-13T17:42:56.504440] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T17:42:57.011852] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T17:42:57.217955] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-13T17:42:57.294585] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T17:42:58.018020] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-13T17:42:58.410392] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-13T17:42:58.618124] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T17:42:58.817912] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-13T17:42:59.617917] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-13T17:43:00.151390] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T17:43:00.417897] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-13T17:43:00.578333] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T17:43:01.217922] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-13T17:43:01.669355] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T17:43:02.017903] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-13T17:43:02.160354] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T17:43:02.450857] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T17:43:02.818044] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-13T17:43:03.617964] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-13T17:43:04.193728] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T17:43:04.417934] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-13T17:43:04.542553] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T17:43:05.125941] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T17:43:05.126847] [INFO ] [REMOTE ] BNJ: Full fetch complete (4197 records). [2025-10-13T17:43:05.126915] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-13T17:43:05.224251] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-13T17:43:05.519617] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-13T17:43:05.519750] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-13T17:43:05.519929] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-13T17:43:05.519975] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-13T17:43:05.520406] [DEBUG] [LOCAL ] BNJ: Trimmed 4197 records to 2668 (keeping 200 days of data) [2025-10-13T17:43:05.539962] [DEBUG] [LOCAL ] BNJ: Primary data saved (2668 records). [2025-10-13T17:43:05.540153] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-13T17:43:05.540263] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNJ took 29.5s. Estimated remaining: 4h 39m 52s. Rate: 7.3 symbols/min [2025-10-13T17:43:05.712248] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:05.721258] [DEBUG] [LOCAL ] BNY: Loaded 7231 existing records from primary storage. [2025-10-13T17:43:05.721460] [INFO ] [MAIN ] BNY: Loaded 7231 existing records. [2025-10-13T17:43:05.899826] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:05.900064] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-13T17:43:05.900112] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-13T17:43:05.900355] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-13T17:43:05.900432] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-13T17:43:06.023180] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-13T17:43:06.254167] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:06.817908] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-13T17:43:07.072895] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T17:43:07.391142] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T17:43:07.617909] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-13T17:43:07.760230] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T17:43:08.417939] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-13T17:43:09.170719] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T17:43:09.217916] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-13T17:43:09.377359] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T17:43:10.017927] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-13T17:43:10.079702] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T17:43:10.818005] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-13T17:43:11.519884] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T17:43:11.555267] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T17:43:11.617887] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-13T17:43:12.421170] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-13T17:43:12.807820] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-13T17:43:13.217909] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-13T17:43:13.462259] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T17:43:14.017914] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-13T17:43:14.563266] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T17:43:14.614333] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T17:43:14.818012] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-13T17:43:15.608513] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T17:43:15.617870] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-13T17:43:16.007338] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-13T17:43:16.417995] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-13T17:43:17.218071] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-13T17:43:18.018015] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-13T17:43:18.259436] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T17:43:18.430009] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-13T17:43:18.818285] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-13T17:43:18.824191] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T17:43:19.490732] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T17:43:19.617927] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-13T17:43:20.417928] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-13T17:43:20.809946] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-13T17:43:21.217958] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-13T17:43:21.330772] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T17:43:21.633962] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-13T17:43:22.017939] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-13T17:43:22.552437] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T17:43:22.817949] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-13T17:43:23.617935] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-13T17:43:24.137513] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T17:43:24.139036] [INFO ] [REMOTE ] BNT: Full fetch complete (4593 records). [2025-10-13T17:43:24.139123] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-13T17:43:24.421741] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-13T17:43:24.548500] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-13T17:43:24.549302] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-13T17:43:24.549816] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T17:43:24.554891] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-13T17:43:24.555367] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-13T17:43:24.556365] [INFO ] [REMOTE ] BNS: Full fetch complete (74371 records). [2025-10-13T17:43:24.556493] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-13T17:43:24.556253] [DEBUG] [LOCAL ] BNT: Trimmed 4593 records to 3428 (keeping 200 days of data) [2025-10-13T17:43:24.683058] [DEBUG] [LOCAL ] BNT: Primary data saved (3428 records). [2025-10-13T17:43:24.685737] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-13T17:43:24.691619] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNT took 31.0s. Estimated remaining: 4h 40m 55s. Rate: 7.3 symbols/min [2025-10-13T17:43:24.977442] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-13T17:43:24.977526] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-13T17:43:24.978370] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-13T17:43:24.978433] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-13T17:43:24.980035] [DEBUG] [LOCAL ] BNS: Trimmed 74371 records to 51465 (keeping 200 days of data) [2025-10-13T17:43:25.220757] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-13T17:43:25.299900] [DEBUG] [LOCAL ] BNS: Primary data saved (51465 records). [2025-10-13T17:43:25.300035] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-13T17:43:25.300113] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNS took 32.9s. Estimated remaining: 4h 39m 57s. Rate: 7.3 symbols/min [2025-10-13T17:43:25.942753] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T17:43:26.017999] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-13T17:43:26.051391] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T17:43:26.818011] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-13T17:43:27.502352] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T17:43:27.604259] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T17:43:27.617875] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-13T17:43:27.739976] [DEBUG] [REMOTE ] BNL: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-13T17:43:27.740405] [WARN ] [REMOTE ] BNL: No data returned for month 2025-10 [2025-10-13T17:43:27.740503] [FATAL] [REMOTE ] BNL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:43:27.740618] [FATAL] [MAIN ] BNL: Failed to fetch primary data. [2025-10-13T17:43:27.740790] [WARN ] [MAIN ] BNL: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:43:27.740853] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-13T17:43:27.740957] [DEBUG] [LOCAL ] BNL: No primary data file found to delete. [2025-10-13T17:43:27.741014] [INFO ] [LOCAL ] BNL: Starting deletion of derivative data. [2025-10-13T17:43:27.741210] [DEBUG] [LOCAL ] BNL: Deleted derivative data file. [2025-10-13T17:43:27.742256] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNL took 46.3s. Estimated remaining: 4h 39m 12s. Rate: 7.3 symbols/min [2025-10-13T17:43:28.418006] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-13T17:43:29.127930] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T17:43:29.218074] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-13T17:43:30.031268] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T17:43:30.032999] [INFO ] [REMOTE ] BNY: Full fetch complete (10402 records). [2025-10-13T17:43:30.033071] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-13T17:43:30.400097] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-13T17:43:30.400203] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-13T17:43:30.400600] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-13T17:43:30.400685] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-13T17:43:30.401256] [DEBUG] [LOCAL ] BNY: Trimmed 10402 records to 7160 (keeping 200 days of data) [2025-10-13T17:43:30.445508] [DEBUG] [LOCAL ] BNY: Primary data saved (7160 records). [2025-10-13T17:43:30.445700] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-13T17:43:30.445803] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BNY took 24.9s. Estimated remaining: 4h 38m 29s. Rate: 7.4 symbols/min [2025-10-13T17:43:31.174914] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:31.193228] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:31.106351] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:31.257262] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:31.317104] [DEBUG] [LOCAL ] BOC: Loaded 18790 existing records from primary storage. [2025-10-13T17:43:31.316553] [DEBUG] [LOCAL ] BOE: Loaded 18415 existing records from primary storage. [2025-10-13T17:43:31.326063] [INFO ] [MAIN ] BOC: Loaded 18790 existing records. [2025-10-13T17:43:31.325955] [INFO ] [MAIN ] BOE: Loaded 18415 existing records. [2025-10-13T17:43:31.371793] [DEBUG] [LOCAL ] BOH: Loaded 30903 existing records from primary storage. [2025-10-13T17:43:31.420379] [INFO ] [MAIN ] BOH: Loaded 30903 existing records. [2025-10-13T17:43:31.434878] [DEBUG] [LOCAL ] BOND: Loaded 32729 existing records from primary storage. [2025-10-13T17:43:31.449102] [INFO ] [MAIN ] BOND: Loaded 32729 existing records. [2025-10-13T17:43:31.858625] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:31.959931] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:31.966095] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-13T17:43:32.012744] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-13T17:43:32.018191] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-13T17:43:32.038232] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-13T17:43:32.058706] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-13T17:43:32.069368] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-13T17:43:32.090063] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-13T17:43:32.106408] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-13T17:43:32.161523] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:32.197824] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-13T17:43:32.234994] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-13T17:43:32.224605] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:32.279244] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-13T17:43:32.284486] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-13T17:43:32.284621] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-13T17:43:32.323975] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-13T17:43:32.289958] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-13T17:43:32.324150] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-13T17:43:33.540022] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:33.581181] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-13T17:43:33.585934] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:33.592330] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-13T17:43:33.729871] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:33.730847] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-13T17:43:33.751193] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:33.751475] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-13T17:43:34.819149] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T17:43:34.824172] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-13T17:43:34.853993] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:43:34.859085] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-13T17:43:34.927421] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:43:34.933984] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-13T17:43:35.009235] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T17:43:35.617959] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-13T17:43:35.869948] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T17:43:35.944884] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T17:43:36.329443] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T17:43:36.417878] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-13T17:43:36.511691] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T17:43:37.217912] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-13T17:43:37.476748] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T17:43:38.017917] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-13T17:43:38.450750] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T17:43:38.794022] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-13T17:43:38.817904] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-13T17:43:39.617951] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-13T17:43:39.835952] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T17:43:40.417938] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-13T17:43:40.992587] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T17:43:41.217939] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-13T17:43:41.760026] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T17:43:42.018048] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-13T17:43:42.679916] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T17:43:42.817961] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-13T17:43:42.996792] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T17:43:43.617919] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-13T17:43:44.223528] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T17:43:44.417937] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-13T17:43:44.694509] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T17:43:45.218007] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-13T17:43:45.722067] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:43:46.017926] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-13T17:43:46.312129] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-13T17:43:46.817996] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-13T17:43:47.240317] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T17:43:47.617940] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-13T17:43:48.045554] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T17:43:48.418009] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-13T17:43:48.589384] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T17:43:49.122473] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T17:43:49.217921] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-13T17:43:49.994411] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T17:43:50.017903] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-13T17:43:50.817938] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-13T17:43:51.013091] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T17:43:51.617897] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-13T17:43:51.677443] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T17:43:52.317878] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T17:43:52.417887] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-13T17:43:53.218000] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-13T17:43:53.333427] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T17:43:54.017900] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-13T17:43:54.183527] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T17:43:54.755629] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T17:43:54.817895] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-13T17:43:55.617942] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-13T17:43:55.747629] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T17:43:55.749975] [INFO ] [REMOTE ] BOC: Full fetch complete (25835 records). [2025-10-13T17:43:55.750047] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-13T17:43:56.120104] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-13T17:43:56.120188] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-13T17:43:56.120693] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-13T17:43:56.120753] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-13T17:43:56.121417] [DEBUG] [LOCAL ] BOC: Trimmed 25835 records to 18609 (keeping 200 days of data) [2025-10-13T17:43:56.235431] [DEBUG] [LOCAL ] BOC: Primary data saved (18609 records). [2025-10-13T17:43:56.235579] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-13T17:43:56.235683] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOC took 25.8s. Estimated remaining: 4h 40m 14s. Rate: 7.3 symbols/min [2025-10-13T17:43:56.400472] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:43:56.420160] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-13T17:43:56.438627] [DEBUG] [LOCAL ] BOOT: Loaded 40592 existing records from primary storage. [2025-10-13T17:43:56.438984] [INFO ] [MAIN ] BOOT: Loaded 40592 existing records. [2025-10-13T17:43:56.614619] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:43:56.614885] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-13T17:43:56.614929] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-13T17:43:56.615127] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-13T17:43:56.615164] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-13T17:43:56.982124] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:43:57.050804] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T17:43:57.217939] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-13T17:43:57.349804] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T17:43:58.017943] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-13T17:43:58.305311] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T17:43:58.817936] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-13T17:43:59.373838] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T17:43:59.617889] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-13T17:43:59.993664] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T17:44:00.417916] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-13T17:44:01.217952] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-13T17:44:01.311838] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T17:44:02.017930] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-13T17:44:02.063696] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:44:02.153816] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T17:44:02.156675] [INFO ] [REMOTE ] BOE: Full fetch complete (26724 records). [2025-10-13T17:44:02.156816] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-13T17:44:02.561007] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-13T17:44:02.561137] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-13T17:44:02.561750] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-13T17:44:02.561823] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-13T17:44:02.562751] [DEBUG] [LOCAL ] BOE: Trimmed 26724 records to 18261 (keeping 200 days of data) [2025-10-13T17:44:02.677149] [DEBUG] [LOCAL ] BOE: Primary data saved (18261 records). [2025-10-13T17:44:02.677372] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-13T17:44:02.677477] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOE took 32.2s. Estimated remaining: 4h 39m 54s. Rate: 7.3 symbols/min [2025-10-13T17:44:02.828313] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-13T17:44:02.869460] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:02.925339] [DEBUG] [LOCAL ] BORR: Loaded 51843 existing records from primary storage. [2025-10-13T17:44:02.925830] [INFO ] [MAIN ] BORR: Loaded 51843 existing records. [2025-10-13T17:44:03.118268] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:03.118523] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-13T17:44:03.118575] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-13T17:44:03.118838] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-13T17:44:03.118898] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-13T17:44:03.486893] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:03.538000] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T17:44:03.617895] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-13T17:44:04.187636] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T17:44:04.417953] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-13T17:44:05.079804] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T17:44:05.217958] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-13T17:44:05.472880] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T17:44:06.018005] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-13T17:44:06.817945] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-13T17:44:06.935039] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T17:44:07.485886] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T17:44:07.489670] [INFO ] [REMOTE ] BOND: Full fetch complete (46410 records). [2025-10-13T17:44:07.489762] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-13T17:44:07.623140] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-13T17:44:07.911166] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-13T17:44:07.911330] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-13T17:44:07.912101] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-13T17:44:07.912181] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-13T17:44:07.913778] [DEBUG] [LOCAL ] BOND: Trimmed 46410 records to 32321 (keeping 200 days of data) [2025-10-13T17:44:08.131129] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T17:44:08.161390] [DEBUG] [LOCAL ] BOND: Primary data saved (32321 records). [2025-10-13T17:44:08.161579] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-13T17:44:08.161716] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOND took 37.7s. Estimated remaining: 4h 39m 29s. Rate: 7.3 symbols/min [2025-10-13T17:44:08.343410] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:08.369937] [DEBUG] [LOCAL ] BOW: Loaded 24153 existing records from primary storage. [2025-10-13T17:44:08.370317] [INFO ] [MAIN ] BOW: Loaded 24153 existing records. [2025-10-13T17:44:08.423174] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-13T17:44:08.599990] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:08.600334] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-13T17:44:08.600384] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-13T17:44:08.600820] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-13T17:44:08.600888] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-13T17:44:08.987774] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:09.217930] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-13T17:44:09.556776] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T17:44:10.017921] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-13T17:44:10.182581] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T17:44:10.294060] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T17:44:10.818005] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-13T17:44:11.625517] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-13T17:44:11.661438] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:44:12.273621] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T17:44:12.417992] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-13T17:44:12.602373] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T17:44:13.217998] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-13T17:44:13.957125] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T17:44:14.017914] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-13T17:44:14.127810] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T17:44:14.817913] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-13T17:44:15.206169] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T17:44:15.617943] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-13T17:44:16.243071] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T17:44:16.418025] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-13T17:44:17.217947] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-13T17:44:17.449548] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T17:44:17.640071] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T17:44:17.643877] [INFO ] [REMOTE ] BOH: Full fetch complete (44896 records). [2025-10-13T17:44:17.644025] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-13T17:44:18.023190] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-13T17:44:18.067497] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-13T17:44:18.067739] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-13T17:44:18.073375] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-13T17:44:18.073687] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-13T17:44:18.075436] [DEBUG] [LOCAL ] BOH: Trimmed 44896 records to 30490 (keeping 200 days of data) [2025-10-13T17:44:18.275435] [DEBUG] [LOCAL ] BOH: Primary data saved (30490 records). [2025-10-13T17:44:18.275703] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-13T17:44:18.276786] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOH took 47.8s. Estimated remaining: 4h 39m 33s. Rate: 7.3 symbols/min [2025-10-13T17:44:18.461451] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:18.518624] [DEBUG] [LOCAL ] BOX: Loaded 50941 existing records from primary storage. [2025-10-13T17:44:18.519192] [INFO ] [MAIN ] BOX: Loaded 50941 existing records. [2025-10-13T17:44:18.724440] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:18.751496] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-13T17:44:18.751638] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-13T17:44:18.752211] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-13T17:44:18.752929] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-13T17:44:18.754954] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T17:44:18.825340] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-13T17:44:19.152064] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:19.617907] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-13T17:44:19.958394] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T17:44:20.182300] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T17:44:20.417988] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-13T17:44:21.173404] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T17:44:21.217890] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-13T17:44:22.017946] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-13T17:44:22.254293] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T17:44:22.457180] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T17:44:22.817927] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-13T17:44:23.617917] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-13T17:44:23.709555] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T17:44:24.417912] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-13T17:44:24.578053] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T17:44:24.832100] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T17:44:24.836792] [INFO ] [REMOTE ] BOOT: Full fetch complete (59979 records). [2025-10-13T17:44:24.836960] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-13T17:44:25.226560] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-13T17:44:25.251030] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-13T17:44:25.251179] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-13T17:44:25.252062] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-13T17:44:25.252127] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-13T17:44:25.253937] [DEBUG] [LOCAL ] BOOT: Trimmed 59979 records to 39875 (keeping 200 days of data) [2025-10-13T17:44:25.513090] [DEBUG] [LOCAL ] BOOT: Primary data saved (39875 records). [2025-10-13T17:44:25.513298] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-13T17:44:25.513434] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOOT took 29.3s. Estimated remaining: 4h 39m 19s. Rate: 7.3 symbols/min [2025-10-13T17:44:25.705717] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:25.707504] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T17:44:25.764989] [DEBUG] [LOCAL ] BP: Loaded 54489 existing records from primary storage. [2025-10-13T17:44:25.765326] [INFO ] [MAIN ] BP: Loaded 54489 existing records. [2025-10-13T17:44:25.946216] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:25.946483] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-13T17:44:25.946541] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-13T17:44:25.947134] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-13T17:44:25.947191] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-13T17:44:26.026326] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-13T17:44:26.333215] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:26.817905] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-13T17:44:27.066594] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T17:44:27.618018] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-13T17:44:27.693813] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:44:28.418010] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-13T17:44:28.891572] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T17:44:29.217897] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-13T17:44:29.261251] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T17:44:29.980198] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:44:30.017984] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-13T17:44:30.817957] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-13T17:44:31.188730] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T17:44:31.617906] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-13T17:44:31.769884] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T17:44:31.915765] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T17:44:32.417949] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-13T17:44:33.217894] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-13T17:44:33.675936] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-13T17:44:33.987590] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:44:34.017897] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-13T17:44:34.032587] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T17:44:34.817922] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-13T17:44:35.617994] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-13T17:44:36.150412] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-13T17:44:36.417916] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-13T17:44:36.456142] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T17:44:37.144079] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T17:44:37.150930] [INFO ] [REMOTE ] BORR: Full fetch complete (74534 records). [2025-10-13T17:44:37.151152] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-13T17:44:37.218694] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-13T17:44:37.560937] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-13T17:44:37.561046] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-13T17:44:37.561977] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-13T17:44:37.562052] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-13T17:44:37.581946] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T17:44:37.588136] [DEBUG] [LOCAL ] BORR: Trimmed 74534 records to 51152 (keeping 200 days of data) [2025-10-13T17:44:37.874501] [DEBUG] [LOCAL ] BORR: Primary data saved (51152 records). [2025-10-13T17:44:37.874674] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-13T17:44:37.874776] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BORR took 35.2s. Estimated remaining: 4h 39m 36s. Rate: 7.3 symbols/min [2025-10-13T17:44:38.023567] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-13T17:44:38.043183] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:38.078740] [DEBUG] [LOCAL ] BR: Loaded 35349 existing records from primary storage. [2025-10-13T17:44:38.079037] [INFO ] [MAIN ] BR: Loaded 35349 existing records. [2025-10-13T17:44:38.259902] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:38.260160] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-13T17:44:38.260217] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-13T17:44:38.260457] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-13T17:44:38.260514] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-13T17:44:38.609507] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:38.817924] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-13T17:44:38.959327] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T17:44:39.036571] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T17:44:39.617929] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-13T17:44:39.941380] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T17:44:40.417930] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-13T17:44:41.101422] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T17:44:41.217901] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-13T17:44:41.600446] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T17:44:41.604337] [INFO ] [REMOTE ] BOW: Full fetch complete (32054 records). [2025-10-13T17:44:41.604423] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-13T17:44:41.984798] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-13T17:44:41.984883] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-13T17:44:41.985356] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-13T17:44:41.985394] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-13T17:44:41.986164] [DEBUG] [LOCAL ] BOW: Trimmed 32054 records to 23502 (keeping 200 days of data) [2025-10-13T17:44:42.035920] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-13T17:44:42.131094] [DEBUG] [LOCAL ] BOW: Primary data saved (23502 records). [2025-10-13T17:44:42.131259] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-13T17:44:42.131357] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOW took 34.0s. Estimated remaining: 4h 39m 4s. Rate: 7.3 symbols/min [2025-10-13T17:44:42.299661] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:42.351372] [DEBUG] [LOCAL ] BRBR: Loaded 52223 existing records from primary storage. [2025-10-13T17:44:42.351714] [INFO ] [MAIN ] BRBR: Loaded 52223 existing records. [2025-10-13T17:44:42.534018] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:42.534306] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-13T17:44:42.534372] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-13T17:44:42.534989] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-13T17:44:42.535049] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-13T17:44:42.818223] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-13T17:44:42.932900] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:42.970090] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T17:44:43.617938] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-13T17:44:44.345553] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T17:44:44.417914] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-13T17:44:44.482883] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-13T17:44:44.921748] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T17:44:45.217923] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-13T17:44:45.402621] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T17:44:46.017940] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-13T17:44:46.817939] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-13T17:44:46.925059] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T17:44:47.341862] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T17:44:47.617985] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-13T17:44:48.417941] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-13T17:44:49.006753] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-13T17:44:49.044736] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T17:44:49.217940] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-13T17:44:50.018167] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-13T17:44:50.122818] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T17:44:50.128428] [INFO ] [REMOTE ] BOX: Full fetch complete (72081 records). [2025-10-13T17:44:50.128632] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-13T17:44:50.660992] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-13T17:44:50.661181] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-13T17:44:50.662519] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-13T17:44:50.662736] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-13T17:44:50.664610] [DEBUG] [LOCAL ] BOX: Trimmed 72081 records to 50236 (keeping 200 days of data) [2025-10-13T17:44:50.842888] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-13T17:44:50.954244] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T17:44:51.053983] [DEBUG] [LOCAL ] BOX: Primary data saved (50236 records). [2025-10-13T17:44:51.054173] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-13T17:44:51.054974] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BOX took 32.8s. Estimated remaining: 4h 38m 60s. Rate: 7.3 symbols/min [2025-10-13T17:44:51.230054] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:44:51.251090] [DEBUG] [LOCAL ] BRC: Loaded 19046 existing records from primary storage. [2025-10-13T17:44:51.251370] [INFO ] [MAIN ] BRC: Loaded 19046 existing records. [2025-10-13T17:44:51.439004] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:44:51.439278] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-13T17:44:51.439326] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-13T17:44:51.439537] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-13T17:44:51.439594] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-13T17:44:51.619824] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-13T17:44:51.811210] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:44:52.063527] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-13T17:44:52.417953] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-13T17:44:52.494159] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T17:44:53.223397] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-13T17:44:53.242956] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T17:44:54.017930] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-13T17:44:54.542052] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T17:44:54.802986] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-13T17:44:54.817872] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-13T17:44:54.854144] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T17:44:55.617937] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-13T17:44:56.417913] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-13T17:44:56.495638] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-13T17:44:56.607809] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T17:44:57.217927] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-13T17:44:57.807408] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T17:44:58.017932] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-13T17:44:58.616819] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:44:58.818034] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-13T17:44:59.617922] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-13T17:44:59.845366] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T17:45:00.268535] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-13T17:45:00.418007] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-13T17:45:01.231135] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-13T17:45:01.234136] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T17:45:01.891022] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T17:45:02.017933] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-13T17:45:02.818035] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-13T17:45:03.472811] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-13T17:45:03.477816] [INFO ] [REMOTE ] BP: Full fetch complete (77371 records). [2025-10-13T17:45:03.477931] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-13T17:45:03.478735] [FATAL] [VALIDATOR ] BP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:45:03.478823] [FATAL] [MAIN ] BP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:45:03.478865] [WARN ] [MAIN ] BP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:45:03.478902] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-13T17:45:03.478960] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-10-13T17:45:03.479002] [INFO ] [LOCAL ] BP: Starting deletion of derivative data. [2025-10-13T17:45:03.479165] [DEBUG] [LOCAL ] BP: Deleted derivative data file. [2025-10-13T17:45:03.479253] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BP took 38.0s. Estimated remaining: 4h 39m 18s. Rate: 7.3 symbols/min [2025-10-13T17:45:03.619706] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-13T17:45:03.657331] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:03.698239] [DEBUG] [LOCAL ] BRCC: Loaded 40648 existing records from primary storage. [2025-10-13T17:45:03.698726] [INFO ] [MAIN ] BRCC: Loaded 40648 existing records. [2025-10-13T17:45:03.802614] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T17:45:03.917762] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:03.918084] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-13T17:45:03.918182] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-13T17:45:03.918705] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-13T17:45:03.918761] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-13T17:45:04.243622] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T17:45:04.323093] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:04.417921] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-13T17:45:05.131414] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T17:45:05.217880] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-13T17:45:05.607388] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T17:45:06.017915] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-13T17:45:06.439977] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T17:45:06.817958] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-13T17:45:07.535911] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T17:45:07.540290] [INFO ] [REMOTE ] BR: Full fetch complete (49627 records). [2025-10-13T17:45:07.540403] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-13T17:45:07.623342] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-13T17:45:07.921750] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-13T17:45:07.921852] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-13T17:45:07.922475] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-13T17:45:07.922570] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-13T17:45:07.923881] [DEBUG] [LOCAL ] BR: Trimmed 49627 records to 34832 (keeping 200 days of data) [2025-10-13T17:45:08.145516] [DEBUG] [LOCAL ] BR: Primary data saved (34832 records). [2025-10-13T17:45:08.145684] [INFO ] [MAIN ] BR: Full history saved. [2025-10-13T17:45:08.145780] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BR took 30.3s. Estimated remaining: 4h 38m 48s. Rate: 7.3 symbols/min [2025-10-13T17:45:08.317425] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:08.368470] [DEBUG] [LOCAL ] BRO: Loaded 52722 existing records from primary storage. [2025-10-13T17:45:08.368887] [INFO ] [MAIN ] BRO: Loaded 52722 existing records. [2025-10-13T17:45:08.424395] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-13T17:45:08.550497] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:08.550849] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-13T17:45:08.550897] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-13T17:45:08.551240] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-13T17:45:08.551296] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-13T17:45:08.910282] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T17:45:08.930824] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T17:45:08.952154] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:09.217917] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-13T17:45:10.002235] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T17:45:10.017884] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-13T17:45:10.817961] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-13T17:45:11.052606] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T17:45:11.617907] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-13T17:45:11.793358] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T17:45:11.846552] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T17:45:12.417946] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-13T17:45:12.873822] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T17:45:13.217924] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-13T17:45:14.017934] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-13T17:45:14.168870] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:45:14.546536] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T17:45:14.817924] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-13T17:45:15.617937] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-13T17:45:15.755100] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T17:45:16.418030] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-13T17:45:16.561002] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T17:45:17.216176] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T17:45:17.224330] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-13T17:45:18.017896] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-13T17:45:18.053363] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T17:45:18.818026] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-13T17:45:18.961877] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T17:45:18.967119] [INFO ] [REMOTE ] BRBR: Full fetch complete (72456 records). [2025-10-13T17:45:18.967234] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-13T17:45:19.350834] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-13T17:45:19.350971] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-13T17:45:19.351920] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-13T17:45:19.351985] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-13T17:45:19.353320] [DEBUG] [LOCAL ] BRBR: Trimmed 72456 records to 51571 (keeping 200 days of data) [2025-10-13T17:45:19.605440] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T17:45:19.618185] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-13T17:45:19.686956] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-13T17:45:19.709194] [DEBUG] [LOCAL ] BRBR: Primary data saved (51571 records). [2025-10-13T17:45:19.709302] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-13T17:45:19.709376] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRBR took 37.6s. Estimated remaining: 4h 39m 0s. Rate: 7.3 symbols/min [2025-10-13T17:45:19.875805] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:19.924770] [DEBUG] [LOCAL ] BROS: Loaded 54079 existing records from primary storage. [2025-10-13T17:45:19.925116] [INFO ] [MAIN ] BROS: Loaded 54079 existing records. [2025-10-13T17:45:20.098362] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:20.098570] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-13T17:45:20.098619] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-13T17:45:20.099075] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-13T17:45:20.099125] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-13T17:45:20.423037] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-13T17:45:20.451829] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:21.217892] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-13T17:45:21.640730] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-13T17:45:22.017903] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-13T17:45:22.184601] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T17:45:22.817999] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-13T17:45:23.147807] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T17:45:23.194277] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T17:45:23.618001] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-13T17:45:24.417899] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-13T17:45:24.529272] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T17:45:25.175086] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T17:45:25.217924] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-13T17:45:25.925921] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T17:45:26.017944] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-13T17:45:26.817922] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-13T17:45:27.164074] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-13T17:45:27.416596] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T17:45:27.617933] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-13T17:45:28.417910] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-13T17:45:28.662839] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T17:45:29.217934] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-13T17:45:29.306876] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:45:30.018009] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-13T17:45:30.381228] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T17:45:30.425839] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-13T17:45:30.817910] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-13T17:45:31.579201] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T17:45:31.617906] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-13T17:45:31.946363] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T17:45:31.948957] [INFO ] [REMOTE ] BRC: Full fetch complete (28457 records). [2025-10-13T17:45:31.949042] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-13T17:45:32.375760] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-13T17:45:32.375906] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-13T17:45:32.376432] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-13T17:45:32.376495] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-13T17:45:32.377462] [DEBUG] [LOCAL ] BRC: Trimmed 28457 records to 18661 (keeping 200 days of data) [2025-10-13T17:45:32.428423] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-13T17:45:32.494529] [DEBUG] [LOCAL ] BRC: Primary data saved (18661 records). [2025-10-13T17:45:32.494702] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-13T17:45:32.494796] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRC took 41.4s. Estimated remaining: 4h 39m 20s. Rate: 7.3 symbols/min [2025-10-13T17:45:32.675311] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:32.675502] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-13T17:45:32.675539] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-13T17:45:32.675690] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-13T17:45:32.675746] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-13T17:45:32.675790] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-13T17:45:32.675824] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-13T17:45:33.031084] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:33.061498] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T17:45:33.065417] [INFO ] [REMOTE ] BRCC: Full fetch complete (57366 records). [2025-10-13T17:45:33.065529] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-13T17:45:33.223046] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-13T17:45:33.480091] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-13T17:45:33.480226] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-13T17:45:33.481111] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-13T17:45:33.481178] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-13T17:45:33.482673] [DEBUG] [LOCAL ] BRCC: Trimmed 57366 records to 40184 (keeping 200 days of data) [2025-10-13T17:45:33.536324] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:45:33.562979] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-13T17:45:33.563996] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:45:33.565217] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-13T17:45:33.566910] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:45:33.570185] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-13T17:45:33.570846] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-13T17:45:33.571733] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-13T17:45:33.572420] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-13T17:45:33.572512] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRSL took 1.1s. Estimated remaining: 4h 38m 28s. Rate: 7.3 symbols/min [2025-10-13T17:45:33.768710] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:33.896101] [DEBUG] [LOCAL ] BRCC: Primary data saved (40184 records). [2025-10-13T17:45:33.896241] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-13T17:45:33.896320] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRCC took 30.4s. Estimated remaining: 4h 37m 32s. Rate: 7.3 symbols/min [2025-10-13T17:45:33.977673] [DEBUG] [LOCAL ] BRSP: Loaded 37280 existing records from primary storage. [2025-10-13T17:45:33.999162] [INFO ] [MAIN ] BRSP: Loaded 37280 existing records. [2025-10-13T17:45:34.021593] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-13T17:45:34.166968] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:34.190210] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-13T17:45:34.190424] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-13T17:45:34.190725] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-13T17:45:34.201763] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-13T17:45:34.250678] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-13T17:45:34.267888] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-13T17:45:34.273611] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:34.306268] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-13T17:45:34.306423] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-13T17:45:34.319356] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-13T17:45:34.345414] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-13T17:45:34.968966] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-13T17:45:34.965808] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:35.020271] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-13T17:45:35.065358] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:35.617899] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-13T17:45:35.834588] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T17:45:35.951584] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T17:45:36.417939] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-13T17:45:36.947712] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-13T17:45:37.092978] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T17:45:37.217944] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-13T17:45:37.695049] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-13T17:45:38.017927] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-13T17:45:38.817934] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-13T17:45:39.439153] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T17:45:39.617959] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-13T17:45:40.417919] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-13T17:45:40.495437] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T17:45:41.012004] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T17:45:41.036023] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T17:45:41.217944] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-13T17:45:42.017941] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-13T17:45:42.818051] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-13T17:45:43.038815] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T17:45:43.434697] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T17:45:43.617957] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-13T17:45:44.417911] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-13T17:45:44.601923] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T17:45:44.966253] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T17:45:45.217997] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-13T17:45:46.018023] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-13T17:45:46.066689] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T17:45:46.308003] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T17:45:46.817924] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-13T17:45:47.403006] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T17:45:47.617895] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-13T17:45:47.867468] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:45:48.417922] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-13T17:45:49.093945] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T17:45:49.217916] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-13T17:45:49.729396] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-13T17:45:49.850720] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T17:45:49.856048] [INFO ] [REMOTE ] BRO: Full fetch complete (74491 records). [2025-10-13T17:45:49.856177] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-13T17:45:50.035421] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-13T17:45:50.251187] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-13T17:45:50.251268] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-13T17:45:50.252128] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-13T17:45:50.252190] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-13T17:45:50.253706] [DEBUG] [LOCAL ] BRO: Trimmed 74491 records to 52044 (keeping 200 days of data) [2025-10-13T17:45:50.571231] [DEBUG] [LOCAL ] BRO: Primary data saved (52044 records). [2025-10-13T17:45:50.571369] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-13T17:45:50.571447] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRO took 42.4s. Estimated remaining: 4h 38m 16s. Rate: 7.3 symbols/min [2025-10-13T17:45:50.743663] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:50.763033] [DEBUG] [LOCAL ] BRW: Loaded 21087 existing records from primary storage. [2025-10-13T17:45:50.763285] [INFO ] [MAIN ] BRW: Loaded 21087 existing records. [2025-10-13T17:45:50.823164] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-13T17:45:50.952451] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:50.952688] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-13T17:45:50.952745] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-13T17:45:50.953023] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-13T17:45:50.953066] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-13T17:45:51.315474] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:51.427452] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T17:45:51.437080] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-13T17:45:51.617905] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-13T17:45:52.225635] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T17:45:52.417922] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-13T17:45:53.043406] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T17:45:53.218002] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-13T17:45:54.017931] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-13T17:45:54.663237] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T17:45:54.664457] [INFO ] [REMOTE ] BRT: Full fetch complete (6822 records). [2025-10-13T17:45:54.664526] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-13T17:45:54.664984] [FATAL] [VALIDATOR ] BRT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:45:54.665066] [FATAL] [MAIN ] BRT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:45:54.665109] [WARN ] [MAIN ] BRT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:45:54.665146] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-13T17:45:54.665199] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-13T17:45:54.665233] [INFO ] [LOCAL ] BRT: Starting deletion of derivative data. [2025-10-13T17:45:54.665275] [DEBUG] [LOCAL ] BRT: No derivative data file found to delete. [2025-10-13T17:45:54.665329] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRT took 20.8s. Estimated remaining: 4h 37m 43s. Rate: 7.3 symbols/min [2025-10-13T17:45:54.822284] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-13T17:45:54.861113] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:45:54.863071] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:45:54.921848] [DEBUG] [LOCAL ] BRX: Loaded 52530 existing records from primary storage. [2025-10-13T17:45:54.922198] [INFO ] [MAIN ] BRX: Loaded 52530 existing records. [2025-10-13T17:45:55.093520] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:45:55.093794] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-13T17:45:55.093843] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-13T17:45:55.094202] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-13T17:45:55.094241] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-13T17:45:55.492975] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:45:55.617942] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-13T17:45:55.917262] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T17:45:56.417930] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-13T17:45:56.992134] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T17:45:57.217919] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-13T17:45:57.808497] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T17:45:58.017888] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-13T17:45:58.334949] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T17:45:58.818017] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-13T17:45:59.617894] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-13T17:46:00.125184] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-13T17:46:00.353918] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T17:46:00.377476] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T17:46:00.417878] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-13T17:46:01.217933] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-13T17:46:01.439350] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T17:46:02.017994] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-13T17:46:02.473163] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:46:02.477431] [INFO ] [REMOTE ] BRSP: Full fetch complete (54256 records). [2025-10-13T17:46:02.477623] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-13T17:46:02.820990] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-13T17:46:02.858594] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-13T17:46:02.858712] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-13T17:46:02.859506] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-13T17:46:02.859549] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-13T17:46:02.860835] [DEBUG] [LOCAL ] BRSP: Trimmed 54256 records to 36738 (keeping 200 days of data) [2025-10-13T17:46:03.074831] [DEBUG] [LOCAL ] BRSP: Primary data saved (36738 records). [2025-10-13T17:46:03.074983] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-13T17:46:03.075625] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRSP took 29.5s. Estimated remaining: 4h 37m 36s. Rate: 7.3 symbols/min [2025-10-13T17:46:03.241153] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:03.276930] [DEBUG] [LOCAL ] BSAC: Loaded 33396 existing records from primary storage. [2025-10-13T17:46:03.277228] [INFO ] [MAIN ] BSAC: Loaded 33396 existing records. [2025-10-13T17:46:03.461257] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:03.461409] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-13T17:46:03.461457] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-13T17:46:03.461706] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-13T17:46:03.461763] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-13T17:46:03.619334] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-13T17:46:03.845996] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:04.243983] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-13T17:46:04.417934] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-13T17:46:04.743906] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T17:46:04.781901] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-13T17:46:05.217996] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-13T17:46:06.017959] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-13T17:46:06.517121] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-13T17:46:06.817901] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-13T17:46:06.934625] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T17:46:06.997318] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T17:46:07.617988] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-13T17:46:08.418031] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-13T17:46:09.147000] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-13T17:46:09.153592] [INFO ] [REMOTE ] BROS: Full fetch complete (77085 records). [2025-10-13T17:46:09.153836] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-13T17:46:09.238223] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-13T17:46:09.496555] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T17:46:09.554526] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:46:09.619048] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-13T17:46:09.620258] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-13T17:46:09.621253] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-13T17:46:09.621340] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-13T17:46:09.623001] [DEBUG] [LOCAL ] BROS: Trimmed 77085 records to 53300 (keeping 200 days of data) [2025-10-13T17:46:09.929715] [DEBUG] [LOCAL ] BROS: Primary data saved (53300 records). [2025-10-13T17:46:09.929861] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-13T17:46:09.929945] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BROS took 50.2s. Estimated remaining: 4h 37m 20s. Rate: 7.3 symbols/min [2025-10-13T17:46:10.026508] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-13T17:46:10.099095] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:10.132078] [DEBUG] [LOCAL ] BSBR: Loaded 35864 existing records from primary storage. [2025-10-13T17:46:10.132374] [INFO ] [MAIN ] BSBR: Loaded 35864 existing records. [2025-10-13T17:46:10.314177] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:10.325835] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-13T17:46:10.326398] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-13T17:46:10.326845] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T17:46:10.328476] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-13T17:46:10.331597] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-13T17:46:10.684761] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:10.817929] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-13T17:46:11.617902] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-13T17:46:11.744717] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T17:46:12.189323] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T17:46:12.417932] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-13T17:46:12.734246] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-13T17:46:13.217921] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-13T17:46:13.875136] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T17:46:14.017935] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-13T17:46:14.799102] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T17:46:14.817879] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-13T17:46:15.101022] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T17:46:15.617904] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-13T17:46:16.417921] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-13T17:46:16.615682] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T17:46:16.973716] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T17:46:17.217917] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-13T17:46:17.636430] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T17:46:18.018009] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-13T17:46:18.499502] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T17:46:18.818126] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-13T17:46:19.554595] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T17:46:19.617912] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-13T17:46:20.187052] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T17:46:20.417919] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-13T17:46:21.217995] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-13T17:46:21.379862] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T17:46:21.448573] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T17:46:22.017946] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-13T17:46:22.323325] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T17:46:22.818116] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-13T17:46:23.618004] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-13T17:46:23.692124] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T17:46:24.331329] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T17:46:24.417936] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-13T17:46:24.851810] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T17:46:25.218017] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-13T17:46:25.919943] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T17:46:26.017884] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-13T17:46:26.539964] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T17:46:26.543390] [INFO ] [REMOTE ] BRW: Full fetch complete (30495 records). [2025-10-13T17:46:26.543563] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-13T17:46:26.823958] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-13T17:46:26.954619] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-13T17:46:26.954738] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-13T17:46:26.955524] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-13T17:46:26.955590] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-13T17:46:26.959254] [DEBUG] [LOCAL ] BRW: Trimmed 30495 records to 20943 (keeping 200 days of data) [2025-10-13T17:46:27.095691] [DEBUG] [LOCAL ] BRW: Primary data saved (20943 records). [2025-10-13T17:46:27.095845] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-13T17:46:27.095970] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BRW took 36.5s. Estimated remaining: 4h 38m 5s. Rate: 7.3 symbols/min [2025-10-13T17:46:27.297088] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:27.308259] [DEBUG] [LOCAL ] BSL: Loaded 8430 existing records from primary storage. [2025-10-13T17:46:27.308514] [INFO ] [MAIN ] BSL: Loaded 8430 existing records. [2025-10-13T17:46:27.543715] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:27.543957] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-13T17:46:27.544029] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-13T17:46:27.547287] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-13T17:46:27.547214] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T17:46:27.547415] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-13T17:46:27.624686] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-13T17:46:27.935805] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:28.418008] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-13T17:46:28.495475] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T17:46:28.504964] [INFO ] [REMOTE ] BRX: Full fetch complete (74928 records). [2025-10-13T17:46:28.505127] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-13T17:46:28.897248] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-13T17:46:28.897348] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-13T17:46:28.898311] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-13T17:46:28.898382] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-13T17:46:28.900069] [DEBUG] [LOCAL ] BRX: Trimmed 74928 records to 51788 (keeping 200 days of data) [2025-10-13T17:46:29.221893] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-13T17:46:29.249267] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T17:46:29.253892] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T17:46:29.268215] [DEBUG] [LOCAL ] BRX: Primary data saved (51788 records). [2025-10-13T17:46:29.268310] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-13T17:46:29.268399] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BRX took 34.6s. Estimated remaining: 4h 37m 21s. Rate: 7.3 symbols/min [2025-10-13T17:46:29.433719] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:29.467364] [DEBUG] [LOCAL ] BSM: Loaded 32627 existing records from primary storage. [2025-10-13T17:46:29.467635] [INFO ] [MAIN ] BSM: Loaded 32627 existing records. [2025-10-13T17:46:29.643026] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:29.643255] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-13T17:46:29.643300] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-13T17:46:29.643565] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-13T17:46:29.643619] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-13T17:46:29.983968] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:30.017877] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-13T17:46:30.694914] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T17:46:30.817908] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-13T17:46:31.119732] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T17:46:31.617925] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-13T17:46:32.240316] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T17:46:32.417930] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-13T17:46:32.954707] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T17:46:33.217927] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-13T17:46:33.390738] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T17:46:33.394483] [INFO ] [REMOTE ] BSBR: Full fetch complete (50660 records). [2025-10-13T17:46:33.394606] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-13T17:46:33.771364] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-13T17:46:33.771444] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-13T17:46:33.772161] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-13T17:46:33.772224] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-13T17:46:33.773210] [DEBUG] [LOCAL ] BSBR: Trimmed 50660 records to 35612 (keeping 200 days of data) [2025-10-13T17:46:33.977335] [DEBUG] [LOCAL ] BSBR: Primary data saved (35612 records). [2025-10-13T17:46:33.977481] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-13T17:46:33.977578] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BSBR took 24.0s. Estimated remaining: 4h 36m 52s. Rate: 7.3 symbols/min [2025-10-13T17:46:34.023140] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-13T17:46:34.147734] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:34.167486] [DEBUG] [LOCAL ] BST: Loaded 19239 existing records from primary storage. [2025-10-13T17:46:34.167750] [INFO ] [MAIN ] BST: Loaded 19239 existing records. [2025-10-13T17:46:34.344910] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:34.345112] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-13T17:46:34.345158] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-13T17:46:34.345446] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-13T17:46:34.345502] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-13T17:46:34.715823] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T17:46:34.744121] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:34.766322] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:46:34.817883] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-13T17:46:35.618033] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-13T17:46:36.197000] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T17:46:36.417996] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-13T17:46:36.439573] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T17:46:37.217998] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-13T17:46:37.621081] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:46:38.017916] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-13T17:46:38.416615] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T17:46:38.817939] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-13T17:46:39.228529] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T17:46:39.617891] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-13T17:46:39.674979] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T17:46:40.417933] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-13T17:46:40.979702] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T17:46:41.189164] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T17:46:41.217887] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-13T17:46:41.970999] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T17:46:42.017888] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-13T17:46:42.712350] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T17:46:42.817922] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-13T17:46:43.617956] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-13T17:46:43.920301] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T17:46:44.418008] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-13T17:46:44.799846] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T17:46:44.803501] [INFO ] [REMOTE ] BSAC: Full fetch complete (44420 records). [2025-10-13T17:46:44.803624] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-13T17:46:45.179441] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-13T17:46:45.179524] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-13T17:46:45.180151] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-13T17:46:45.180271] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-13T17:46:45.181286] [DEBUG] [LOCAL ] BSAC: Trimmed 44420 records to 32825 (keeping 200 days of data) [2025-10-13T17:46:45.233149] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-13T17:46:45.381029] [DEBUG] [LOCAL ] BSAC: Primary data saved (32825 records). [2025-10-13T17:46:45.381184] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-13T17:46:45.382095] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSAC took 42.3s. Estimated remaining: 4h 37m 3s. Rate: 7.3 symbols/min [2025-10-13T17:46:45.556760] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:45.570030] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T17:46:45.597947] [DEBUG] [LOCAL ] BSTZ: Loaded 25316 existing records from primary storage. [2025-10-13T17:46:45.598252] [INFO ] [MAIN ] BSTZ: Loaded 25316 existing records. [2025-10-13T17:46:45.775852] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:45.776084] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-13T17:46:45.776129] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-13T17:46:45.776399] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-13T17:46:45.776457] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-13T17:46:46.024935] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-13T17:46:46.131369] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:46.688303] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T17:46:46.811467] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T17:46:46.817870] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-13T17:46:47.516009] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-13T17:46:47.617892] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-13T17:46:48.223142] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T17:46:48.417934] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-13T17:46:49.217939] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-13T17:46:49.634342] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T17:46:50.018094] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-13T17:46:50.124734] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T17:46:50.127101] [INFO ] [REMOTE ] BSL: Full fetch complete (12803 records). [2025-10-13T17:46:50.127196] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-13T17:46:50.493049] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-13T17:46:50.493126] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-13T17:46:50.493417] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-13T17:46:50.493453] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-13T17:46:50.493934] [DEBUG] [LOCAL ] BSL: Trimmed 12803 records to 8260 (keeping 200 days of data) [2025-10-13T17:46:50.545234] [DEBUG] [LOCAL ] BSL: Primary data saved (8260 records). [2025-10-13T17:46:50.545344] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-13T17:46:50.545416] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSL took 23.4s. Estimated remaining: 4h 36m 37s. Rate: 7.3 symbols/min [2025-10-13T17:46:50.711021] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:46:50.769208] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-10-13T17:46:50.769520] [INFO ] [MAIN ] BSX: Loaded 54468 existing records. [2025-10-13T17:46:50.823056] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-13T17:46:50.948225] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:46:50.948411] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-13T17:46:50.948455] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-13T17:46:50.948763] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-13T17:46:50.948818] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-13T17:46:51.307159] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:46:51.341782] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T17:46:51.617920] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-13T17:46:51.992384] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T17:46:52.417940] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-13T17:46:53.217896] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-13T17:46:53.540292] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T17:46:53.735187] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T17:46:54.017903] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-13T17:46:54.241229] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T17:46:54.817896] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-13T17:46:55.617916] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-13T17:46:55.818223] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T17:46:55.884276] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T17:46:56.417921] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-13T17:46:56.886702] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T17:46:57.217902] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-13T17:46:57.594898] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T17:46:58.017992] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-13T17:46:58.470990] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T17:46:58.817909] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-13T17:46:59.091668] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T17:46:59.618016] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-13T17:47:00.001881] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:47:00.417935] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-13T17:47:01.217912] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-13T17:47:01.268540] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T17:47:01.358085] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-13T17:47:02.017927] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-13T17:47:02.677244] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T17:47:02.817927] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-13T17:47:03.617893] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-13T17:47:04.045755] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T17:47:04.068144] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-13T17:47:04.417930] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-13T17:47:05.022823] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T17:47:05.217984] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-13T17:47:05.474850] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T17:47:06.018009] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-13T17:47:06.283083] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T17:47:06.817908] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-13T17:47:07.617941] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-13T17:47:07.993150] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T17:47:08.123982] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T17:47:08.417994] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-13T17:47:08.654386] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:47:08.657334] [INFO ] [REMOTE ] BST: Full fetch complete (28525 records). [2025-10-13T17:47:08.657452] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-13T17:47:09.172699] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-13T17:47:09.172835] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-13T17:47:09.173420] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-13T17:47:09.173468] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-13T17:47:09.174831] [DEBUG] [LOCAL ] BST: Trimmed 28525 records to 18945 (keeping 200 days of data) [2025-10-13T17:47:09.229775] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-13T17:47:09.304561] [DEBUG] [LOCAL ] BST: Primary data saved (18945 records). [2025-10-13T17:47:09.304750] [INFO ] [MAIN ] BST: Full history saved. [2025-10-13T17:47:09.304850] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BST took 35.3s. Estimated remaining: 4h 37m 31s. Rate: 7.3 symbols/min [2025-10-13T17:47:09.481495] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:09.488288] [DEBUG] [LOCAL ] BTA: Loaded 5614 existing records from primary storage. [2025-10-13T17:47:09.488481] [INFO ] [MAIN ] BTA: Loaded 5614 existing records. [2025-10-13T17:47:09.673431] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:47:09.682162] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-13T17:47:09.682624] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:47:09.682245] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-13T17:47:09.686577] [INFO ] [REMOTE ] BSM: Full fetch complete (46957 records). [2025-10-13T17:47:09.686623] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-13T17:47:09.686826] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-13T17:47:09.686881] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-13T17:47:10.021858] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-13T17:47:10.456770] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:10.472748] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-13T17:47:10.472837] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-13T17:47:10.473532] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-13T17:47:10.473574] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-13T17:47:10.474553] [DEBUG] [LOCAL ] BSM: Trimmed 46957 records to 32287 (keeping 200 days of data) [2025-10-13T17:47:10.675425] [DEBUG] [LOCAL ] BSM: Primary data saved (32287 records). [2025-10-13T17:47:10.675574] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-13T17:47:10.675680] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSM took 41.4s. Estimated remaining: 4h 36m 43s. Rate: 7.3 symbols/min [2025-10-13T17:47:10.821395] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-13T17:47:10.846754] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:10.865361] [DEBUG] [LOCAL ] BTCM: Loaded 16477 existing records from primary storage. [2025-10-13T17:47:10.865692] [INFO ] [MAIN ] BTCM: Loaded 16477 existing records. [2025-10-13T17:47:11.049439] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:47:11.050152] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-13T17:47:11.050261] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-13T17:47:11.050753] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-13T17:47:11.050902] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-13T17:47:11.375416] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-13T17:47:11.487917] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:11.503551] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T17:47:11.569599] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T17:47:11.617953] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-13T17:47:12.336860] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T17:47:12.417935] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-13T17:47:13.218025] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-13T17:47:14.017939] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-13T17:47:14.346328] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T17:47:14.403047] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T17:47:14.817917] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-13T17:47:15.082626] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T17:47:15.617992] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-13T17:47:15.645993] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:47:16.417923] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-13T17:47:17.208508] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T17:47:17.217872] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-13T17:47:17.511485] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T17:47:17.789029] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T17:47:18.018026] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-13T17:47:18.817998] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-13T17:47:19.218585] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T17:47:19.339996] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-13T17:47:19.617936] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-13T17:47:20.417955] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-13T17:47:20.935207] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T17:47:21.218043] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-13T17:47:21.218358] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T17:47:22.017925] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-13T17:47:22.332854] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T17:47:22.817985] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-13T17:47:23.617898] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-13T17:47:23.767350] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T17:47:24.001266] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T17:47:24.174995] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T17:47:24.417933] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-13T17:47:25.217986] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-13T17:47:25.861197] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-13T17:47:26.017913] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-13T17:47:26.421384] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-13T17:47:26.817923] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-13T17:47:27.157561] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T17:47:27.161205] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36754 records). [2025-10-13T17:47:27.161362] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-13T17:47:27.548347] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-13T17:47:27.548465] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-13T17:47:27.549137] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-13T17:47:27.549202] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-13T17:47:27.550224] [DEBUG] [LOCAL ] BSTZ: Trimmed 36754 records to 25020 (keeping 200 days of data) [2025-10-13T17:47:27.643837] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-13T17:47:27.721307] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25020 records). [2025-10-13T17:47:27.721527] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-13T17:47:27.721637] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BSTZ took 42.3s. Estimated remaining: 4h 37m 26s. Rate: 7.3 symbols/min [2025-10-13T17:47:27.890998] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T17:47:27.927852] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:27.930309] [INFO ] [REMOTE ] BSX: Full fetch complete (77700 records). [2025-10-13T17:47:27.930509] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-13T17:47:28.261107] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T17:47:28.321557] [DEBUG] [LOCAL ] BTE: Loaded 53492 existing records from primary storage. [2025-10-13T17:47:28.343691] [INFO ] [MAIN ] BTE: Loaded 53492 existing records. [2025-10-13T17:47:28.428313] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-13T17:47:28.625988] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-13T17:47:28.631287] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-13T17:47:28.648688] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-13T17:47:28.684151] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-13T17:47:28.728189] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:47:28.728510] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-13T17:47:28.728582] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-13T17:47:28.729261] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-13T17:47:28.729323] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-13T17:47:28.764084] [DEBUG] [LOCAL ] BSX: Trimmed 77700 records to 53688 (keeping 200 days of data) [2025-10-13T17:47:29.223322] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-13T17:47:29.336500] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:29.581782] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-13T17:47:29.581963] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-13T17:47:29.582064] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BSX took 39.0s. Estimated remaining: 4h 36m 41s. Rate: 7.3 symbols/min [2025-10-13T17:47:29.769669] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:29.769905] [DEBUG] [LOCAL ] BTI: No existing data file found in primary storage. [2025-10-13T17:47:29.769944] [WARN ] [MAIN ] BTI: No existing data found, performing full refresh instead. [2025-10-13T17:47:29.770080] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-13T17:47:29.770176] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-13T17:47:29.770234] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-10-13T17:47:29.770274] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-13T17:47:30.027315] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-13T17:47:30.033891] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T17:47:30.206514] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:30.236188] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T17:47:30.817977] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-13T17:47:31.431561] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T17:47:31.617899] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-13T17:47:31.890670] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T17:47:32.198042] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-13T17:47:32.417974] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-13T17:47:33.217936] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-13T17:47:34.017940] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-13T17:47:34.089125] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T17:47:34.541169] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T17:47:34.817993] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-13T17:47:35.617932] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-13T17:47:36.052316] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T17:47:36.133186] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:47:36.417977] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-13T17:47:36.940479] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T17:47:37.192350] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T17:47:37.217929] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-13T17:47:38.018016] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-13T17:47:38.573005] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T17:47:38.575492] [INFO ] [REMOTE ] BTCM: Full fetch complete (19679 records). [2025-10-13T17:47:38.575559] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-13T17:47:38.576013] [FATAL] [VALIDATOR ] BTCM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:47:38.576093] [FATAL] [MAIN ] BTCM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:47:38.576134] [WARN ] [MAIN ] BTCM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:47:38.576214] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-13T17:47:38.576291] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-10-13T17:47:38.576327] [INFO ] [LOCAL ] BTCM: Starting deletion of derivative data. [2025-10-13T17:47:38.576502] [DEBUG] [LOCAL ] BTCM: Deleted derivative data file. [2025-10-13T17:47:38.576586] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 27.9s. Estimated remaining: 4h 36m 37s. Rate: 7.3 symbols/min [2025-10-13T17:47:38.745128] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:38.754611] [DEBUG] [LOCAL ] BTO: Loaded 8861 existing records from primary storage. [2025-10-13T17:47:38.755046] [INFO ] [MAIN ] BTO: Loaded 8861 existing records. [2025-10-13T17:47:38.827741] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-13T17:47:38.930880] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:47:38.931138] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-13T17:47:38.931185] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-13T17:47:38.931380] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-13T17:47:38.931435] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-13T17:47:39.273609] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:39.403558] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-13T17:47:39.617956] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-13T17:47:39.954527] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-13T17:47:40.417901] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-13T17:47:40.473235] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T17:47:41.217915] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-13T17:47:42.017887] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-13T17:47:42.271412] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-13T17:47:42.458575] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-13T17:47:42.817953] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-13T17:47:42.921084] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T17:47:43.617920] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-13T17:47:43.996692] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-13T17:47:44.417890] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-13T17:47:44.794592] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-13T17:47:45.134014] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T17:47:45.217890] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-13T17:47:45.895478] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T17:47:46.017906] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-13T17:47:46.818009] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-13T17:47:47.564571] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T17:47:47.566685] [INFO ] [REMOTE ] BTA: Full fetch complete (9495 records). [2025-10-13T17:47:47.566798] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-13T17:47:47.623024] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-13T17:47:47.937198] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-13T17:47:47.937384] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-13T17:47:47.937688] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-13T17:47:47.937770] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-13T17:47:47.948623] [DEBUG] [LOCAL ] BTA: Trimmed 9495 records to 5590 (keeping 200 days of data) [2025-10-13T17:47:47.981468] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:47:48.013966] [DEBUG] [LOCAL ] BTA: Primary data saved (5590 records). [2025-10-13T17:47:48.014098] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-13T17:47:48.014177] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTA took 38.7s. Estimated remaining: 4h 36m 36s. Rate: 7.3 symbols/min [2025-10-13T17:47:48.189282] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:47:48.204594] [DEBUG] [LOCAL ] BTT: Loaded 16040 existing records from primary storage. [2025-10-13T17:47:48.204841] [INFO ] [MAIN ] BTT: Loaded 16040 existing records. [2025-10-13T17:47:48.380098] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:47:48.380285] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-13T17:47:48.380332] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-13T17:47:48.380953] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-13T17:47:48.381014] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-13T17:47:48.423144] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-13T17:47:48.550619] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T17:47:48.750276] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:47:49.217912] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-13T17:47:50.017943] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-13T17:47:50.412835] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T17:47:50.502502] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-13T17:47:50.817897] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-13T17:47:50.880037] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T17:47:51.617929] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-13T17:47:52.417910] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-13T17:47:53.087494] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-13T17:47:53.217914] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-13T17:47:53.318333] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T17:47:53.462992] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T17:47:54.017929] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-13T17:47:54.817916] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-13T17:47:54.838367] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T17:47:55.227813] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-13T17:47:55.617939] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-13T17:47:56.368235] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T17:47:56.416283] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T17:47:56.426231] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-13T17:47:57.217912] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-13T17:47:58.018930] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-13T17:47:58.024630] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T17:47:58.749854] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T17:47:58.817925] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-13T17:47:59.370439] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T17:47:59.621062] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-13T17:48:00.417991] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-13T17:48:01.041639] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-13T17:48:01.217920] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-13T17:48:01.359397] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T17:48:01.359824] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T17:48:02.018009] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-13T17:48:02.818012] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-13T17:48:03.241430] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-13T17:48:03.539793] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T17:48:03.541242] [INFO ] [REMOTE ] BTO: Full fetch complete (13134 records). [2025-10-13T17:48:03.541311] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-13T17:48:03.620557] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-13T17:48:03.910630] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-13T17:48:03.910761] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-13T17:48:03.911242] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-13T17:48:03.911318] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-13T17:48:03.911987] [DEBUG] [LOCAL ] BTO: Trimmed 13134 records to 8741 (keeping 200 days of data) [2025-10-13T17:48:03.985709] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T17:48:04.011429] [DEBUG] [LOCAL ] BTO: Primary data saved (8741 records). [2025-10-13T17:48:04.011588] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-13T17:48:04.011697] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTO took 25.4s. Estimated remaining: 4h 37m 13s. Rate: 7.3 symbols/min [2025-10-13T17:48:04.184625] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:04.235878] [DEBUG] [LOCAL ] BTU: Loaded 54095 existing records from primary storage. [2025-10-13T17:48:04.236274] [INFO ] [MAIN ] BTU: Loaded 54095 existing records. [2025-10-13T17:48:04.423463] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-13T17:48:04.428519] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:04.429369] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-13T17:48:04.429435] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-13T17:48:04.430399] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-13T17:48:04.430459] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-13T17:48:04.778536] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:05.218010] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-13T17:48:05.414385] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T17:48:05.420038] [INFO ] [REMOTE ] BTI: Full fetch complete (77471 records). [2025-10-13T17:48:05.420169] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-13T17:48:05.805096] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-13T17:48:05.805215] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-13T17:48:05.806222] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-13T17:48:05.806295] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-13T17:48:05.808047] [DEBUG] [LOCAL ] BTI: Trimmed 77471 records to 53591 (keeping 200 days of data) [2025-10-13T17:48:06.021878] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-13T17:48:06.143713] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T17:48:06.156421] [INFO ] [REMOTE ] BTE: Full fetch complete (76139 records). [2025-10-13T17:48:06.157044] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-13T17:48:06.233558] [DEBUG] [LOCAL ] BTI: Primary data saved (53591 records). [2025-10-13T17:48:06.257761] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-13T17:48:06.265507] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTI took 36.7s. Estimated remaining: 4h 36m 30s. Rate: 7.3 symbols/min [2025-10-13T17:48:06.400331] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:48:06.702934] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:06.721431] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-13T17:48:06.762014] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-13T17:48:06.758058] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-13T17:48:06.762271] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-13T17:48:06.762130] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-13T17:48:06.762422] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-13T17:48:06.763395] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-13T17:48:06.763549] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-13T17:48:06.763704] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-13T17:48:06.763773] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-13T17:48:06.822929] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-13T17:48:06.874066] [DEBUG] [LOCAL ] BTE: Trimmed 76139 records to 52723 (keeping 200 days of data) [2025-10-13T17:48:07.242985] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:07.463905] [DEBUG] [LOCAL ] BTE: Primary data saved (52723 records). [2025-10-13T17:48:07.464078] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-13T17:48:07.464169] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTE took 39.7s. Estimated remaining: 4h 35m 42s. Rate: 7.3 symbols/min [2025-10-13T17:48:07.618245] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-13T17:48:07.656018] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:07.685039] [DEBUG] [LOCAL ] BTZ: Loaded 23117 existing records from primary storage. [2025-10-13T17:48:07.685347] [INFO ] [MAIN ] BTZ: Loaded 23117 existing records. [2025-10-13T17:48:07.869336] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:48:07.874226] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:07.879952] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-13T17:48:07.885883] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-13T17:48:07.886155] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-13T17:48:07.885456] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:48:07.888135] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T17:48:07.888514] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-13T17:48:07.892124] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-13T17:48:07.892189] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:48:07.892754] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-13T17:48:07.892597] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-13T17:48:07.893623] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-13T17:48:07.899049] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-13T17:48:07.932785] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-13T17:48:07.953335] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTX took 1.7s. Estimated remaining: 4h 34m 50s. Rate: 7.3 symbols/min [2025-10-13T17:48:08.350099] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-13T17:48:08.424752] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-13T17:48:08.454797] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:08.531718] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:08.579155] [DEBUG] [LOCAL ] BUD: Loaded 53443 existing records from primary storage. [2025-10-13T17:48:08.579507] [INFO ] [MAIN ] BUD: Loaded 53443 existing records. [2025-10-13T17:48:08.779444] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:08.779748] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-13T17:48:08.779802] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-13T17:48:08.780127] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-13T17:48:08.780185] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-13T17:48:09.198185] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:09.217896] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-13T17:48:10.017890] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-13T17:48:10.210821] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T17:48:10.817909] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-13T17:48:10.924365] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T17:48:11.173571] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T17:48:11.618011] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-13T17:48:12.084098] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:48:12.417924] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-13T17:48:13.217991] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-13T17:48:13.444191] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T17:48:13.492460] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:48:14.017940] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-13T17:48:14.817927] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-13T17:48:15.019566] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T17:48:15.046811] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T17:48:15.617916] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-13T17:48:16.417896] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-13T17:48:16.684444] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T17:48:16.776720] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T17:48:17.217914] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-13T17:48:18.017883] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-13T17:48:18.125296] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:48:18.466481] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T17:48:18.817953] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-13T17:48:19.617952] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-13T17:48:19.837924] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T17:48:19.862353] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T17:48:20.352892] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T17:48:20.417883] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-13T17:48:21.208442] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T17:48:21.217881] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-13T17:48:22.017904] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-13T17:48:22.237695] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T17:48:22.817932] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-13T17:48:23.617889] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-13T17:48:23.836430] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T17:48:24.417987] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-13T17:48:24.505458] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T17:48:24.800526] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T17:48:25.217903] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-13T17:48:25.321294] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T17:48:26.017973] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-13T17:48:26.817908] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-13T17:48:26.911849] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T17:48:27.617915] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-13T17:48:27.925932] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T17:48:27.974263] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T17:48:28.417980] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-13T17:48:29.217910] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-13T17:48:29.423486] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T17:48:29.558569] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T17:48:30.017997] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-13T17:48:30.817901] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-13T17:48:31.043539] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T17:48:31.089708] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T17:48:31.617923] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-13T17:48:32.418007] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-13T17:48:32.704790] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:48:32.708694] [INFO ] [REMOTE ] BTZ: Full fetch complete (33523 records). [2025-10-13T17:48:32.708850] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-13T17:48:32.870076] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-13T17:48:33.162691] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-13T17:48:33.162828] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-13T17:48:33.163631] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-13T17:48:33.163723] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-13T17:48:33.165108] [DEBUG] [LOCAL ] BTZ: Trimmed 33523 records to 22651 (keeping 200 days of data) [2025-10-13T17:48:33.227622] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-13T17:48:33.313942] [DEBUG] [LOCAL ] BTZ: Primary data saved (22651 records). [2025-10-13T17:48:33.314137] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-13T17:48:33.314285] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTZ took 25.8s. Estimated remaining: 4h 36m 19s. Rate: 7.3 symbols/min [2025-10-13T17:48:33.514185] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:33.515826] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T17:48:33.535493] [DEBUG] [LOCAL ] BUI: Loaded 12043 existing records from primary storage. [2025-10-13T17:48:33.535851] [INFO ] [MAIN ] BUI: Loaded 12043 existing records. [2025-10-13T17:48:33.774779] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:33.775194] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-13T17:48:33.775258] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-13T17:48:33.776162] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-13T17:48:33.776223] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-13T17:48:34.025038] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-13T17:48:34.147047] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:34.817883] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-13T17:48:34.895146] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T17:48:34.963490] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T17:48:34.966296] [INFO ] [REMOTE ] BTT: Full fetch complete (23172 records). [2025-10-13T17:48:34.966365] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-13T17:48:35.323486] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-13T17:48:35.323566] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-13T17:48:35.323951] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-13T17:48:35.324011] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-13T17:48:35.324566] [DEBUG] [LOCAL ] BTT: Trimmed 23172 records to 15801 (keeping 200 days of data) [2025-10-13T17:48:35.419089] [DEBUG] [LOCAL ] BTT: Primary data saved (15801 records). [2025-10-13T17:48:35.419231] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-13T17:48:35.419322] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BTT took 47.4s. Estimated remaining: 4h 35m 37s. Rate: 7.3 symbols/min [2025-10-13T17:48:35.585385] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:35.617908] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-13T17:48:35.633186] [DEBUG] [LOCAL ] BUR: Loaded 45896 existing records from primary storage. [2025-10-13T17:48:35.633501] [INFO ] [MAIN ] BUR: Loaded 45896 existing records. [2025-10-13T17:48:35.811091] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:35.811347] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-13T17:48:35.811407] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-13T17:48:35.812219] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-13T17:48:35.812281] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-13T17:48:36.160044] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:36.417914] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-13T17:48:36.818748] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T17:48:37.217928] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-13T17:48:37.598345] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T17:48:37.889109] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T17:48:38.023120] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-13T17:48:38.039659] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T17:48:38.818052] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-13T17:48:38.853537] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T17:48:39.617935] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-13T17:48:40.417932] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-13T17:48:41.018967] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-13T17:48:41.024332] [INFO ] [REMOTE ] BTU: Full fetch complete (77059 records). [2025-10-13T17:48:41.024450] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-13T17:48:41.237261] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-13T17:48:41.435550] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-13T17:48:41.435669] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-13T17:48:41.436563] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-13T17:48:41.436784] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-13T17:48:41.468982] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T17:48:41.469121] [DEBUG] [LOCAL ] BTU: Trimmed 77059 records to 53318 (keeping 200 days of data) [2025-10-13T17:48:41.824453] [DEBUG] [LOCAL ] BTU: Primary data saved (53318 records). [2025-10-13T17:48:41.824691] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-13T17:48:41.824799] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BTU took 37.8s. Estimated remaining: 4h 35m 18s. Rate: 7.3 symbols/min [2025-10-13T17:48:41.996682] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:48:42.019399] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-13T17:48:42.023125] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T17:48:42.073808] [DEBUG] [LOCAL ] BURL: Loaded 46344 existing records from primary storage. [2025-10-13T17:48:42.074123] [INFO ] [MAIN ] BURL: Loaded 46344 existing records. [2025-10-13T17:48:42.260392] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:48:42.261180] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T17:48:42.261348] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-13T17:48:42.263726] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-13T17:48:42.265115] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-13T17:48:42.265185] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-13T17:48:42.619742] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:48:42.817928] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-13T17:48:43.617914] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-13T17:48:43.823849] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:48:44.183956] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T17:48:44.417927] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-13T17:48:45.041105] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T17:48:45.217972] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-13T17:48:45.936688] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:48:46.017885] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-13T17:48:46.818028] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-13T17:48:47.082028] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-13T17:48:47.090004] [INFO ] [REMOTE ] BUD: Full fetch complete (76406 records). [2025-10-13T17:48:47.090273] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-13T17:48:47.480232] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-13T17:48:47.480373] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-13T17:48:47.481391] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-13T17:48:47.481518] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-13T17:48:47.483410] [DEBUG] [LOCAL ] BUD: Trimmed 76406 records to 52658 (keeping 200 days of data) [2025-10-13T17:48:47.652138] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-13T17:48:47.719990] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T17:48:47.825178] [DEBUG] [LOCAL ] BUD: Primary data saved (52658 records). [2025-10-13T17:48:47.825320] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-13T17:48:47.825397] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUD took 39.9s. Estimated remaining: 4h 34m 58s. Rate: 7.3 symbols/min [2025-10-13T17:48:48.075046] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T17:48:48.417897] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-13T17:48:48.546177] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-13T17:48:49.217993] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-13T17:48:49.960879] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T17:48:50.004251] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T17:48:50.017877] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-13T17:48:50.817933] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-13T17:48:51.588070] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T17:48:51.605588] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T17:48:51.617879] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-13T17:48:52.377749] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T17:48:52.417890] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-13T17:48:53.217899] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-13T17:48:53.327826] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T17:48:54.017935] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-13T17:48:54.790740] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T17:48:54.817891] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-13T17:48:54.829566] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T17:48:55.617923] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-13T17:48:56.417903] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-13T17:48:56.468833] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:48:57.217914] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-13T17:48:57.241504] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-13T17:48:57.562692] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:48:58.018027] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-13T17:48:58.817992] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-13T17:48:58.875543] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T17:48:59.617894] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-13T17:48:59.752160] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T17:48:59.754017] [INFO ] [REMOTE ] BUI: Full fetch complete (16526 records). [2025-10-13T17:48:59.754087] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-13T17:49:00.072493] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-13T17:49:00.156287] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-13T17:49:00.156361] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-13T17:49:00.156737] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-13T17:49:00.156798] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-13T17:49:00.157281] [DEBUG] [LOCAL ] BUI: Trimmed 16526 records to 11920 (keeping 200 days of data) [2025-10-13T17:49:00.234052] [DEBUG] [LOCAL ] BUI: Primary data saved (11920 records). [2025-10-13T17:49:00.234178] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-13T17:49:00.234253] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUI took 26.9s. Estimated remaining: 4h 35m 13s. Rate: 7.3 symbols/min [2025-10-13T17:49:00.417946] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-13T17:49:01.444968] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T17:49:01.454857] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-13T17:49:02.135780] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T17:49:02.145868] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-13T17:49:02.969943] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T17:49:02.974529] [INFO ] [REMOTE ] BUR: Full fetch complete (63772 records). [2025-10-13T17:49:02.974678] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-13T17:49:03.359384] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-13T17:49:03.359485] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-13T17:49:03.360286] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-13T17:49:03.360373] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-13T17:49:03.361699] [DEBUG] [LOCAL ] BUR: Trimmed 63772 records to 45304 (keeping 200 days of data) [2025-10-13T17:49:03.651665] [DEBUG] [LOCAL ] BUR: Primary data saved (45304 records). [2025-10-13T17:49:03.651888] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-13T17:49:03.652008] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUR took 28.2s. Estimated remaining: 4h 34m 38s. Rate: 7.3 symbols/min [2025-10-13T17:49:03.692293] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T17:49:03.701884] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-13T17:49:05.319739] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T17:49:05.329524] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-13T17:49:06.957437] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T17:49:06.967103] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-13T17:49:08.479383] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T17:49:08.488962] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-13T17:49:10.070691] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T17:49:10.075783] [INFO ] [REMOTE ] BURL: Full fetch complete (65691 records). [2025-10-13T17:49:10.075907] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-13T17:49:10.466215] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-13T17:49:10.466312] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-13T17:49:10.467082] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-13T17:49:10.467144] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-13T17:49:10.468434] [DEBUG] [LOCAL ] BURL: Trimmed 65691 records to 45749 (keeping 200 days of data) [2025-10-13T17:49:10.748080] [DEBUG] [LOCAL ] BURL: Primary data saved (45749 records). [2025-10-13T17:49:10.748230] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-13T17:49:10.748343] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 28.9s. Estimated remaining: 4h 34m 24s. Rate: 7.3 symbols/min [2025-10-13T17:49:11.374287] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:11.396250] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:11.462088] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:11.461214] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:11.462704] [DEBUG] [LOCAL ] BVN: No existing data file found in primary storage. [2025-10-13T17:49:11.462892] [WARN ] [MAIN ] BVN: No existing data found, performing full refresh instead. [2025-10-13T17:49:11.463004] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-13T17:49:11.463047] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-13T17:49:11.463215] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-13T17:49:11.463266] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-13T17:49:11.571795] [DEBUG] [LOCAL ] BUXX: Loaded 15454 existing records from primary storage. [2025-10-13T17:49:11.639626] [INFO ] [MAIN ] BUXX: Loaded 15454 existing records. [2025-10-13T17:49:11.828950] [DEBUG] [LOCAL ] BW: Loaded 40915 existing records from primary storage. [2025-10-13T17:49:11.846306] [DEBUG] [LOCAL ] BV: Loaded 39079 existing records from primary storage. [2025-10-13T17:49:11.906588] [INFO ] [MAIN ] BV: Loaded 39079 existing records. [2025-10-13T17:49:11.906468] [INFO ] [MAIN ] BW: Loaded 40915 existing records. [2025-10-13T17:49:12.224816] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:12.264908] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-13T17:49:12.295205] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:12.327864] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-13T17:49:12.372946] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-13T17:49:12.390459] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:12.413258] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-13T17:49:12.413533] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-13T17:49:12.413447] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-13T17:49:12.422723] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-13T17:49:12.453084] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:12.462788] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-13T17:49:12.478132] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-13T17:49:12.462728] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-13T17:49:12.510947] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-13T17:49:12.563743] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-13T17:49:12.619221] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-13T17:49:13.348184] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:13.369147] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-13T17:49:13.495850] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:13.537593] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-13T17:49:13.578896] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:13.579330] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-13T17:49:13.986162] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T17:49:14.000006] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-13T17:49:14.495407] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T17:49:14.499037] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-13T17:49:14.956193] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:49:14.963091] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-13T17:49:15.067548] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T17:49:15.087248] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-13T17:49:15.088374] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T17:49:15.092927] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-13T17:49:15.318792] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T17:49:15.327158] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-13T17:49:15.913871] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T17:49:15.916584] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-13T17:49:16.182121] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T17:49:16.188877] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-13T17:49:16.326930] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T17:49:16.337133] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-13T17:49:16.436182] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-13T17:49:16.439623] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-13T17:49:16.717631] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:49:17.217913] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-13T17:49:17.458581] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T17:49:17.506777] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T17:49:17.649779] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T17:49:18.018015] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-13T17:49:18.546878] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T17:49:18.817927] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-13T17:49:19.617902] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-13T17:49:19.773388] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T17:49:20.424833] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-13T17:49:20.434142] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T17:49:21.075623] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T17:49:21.217953] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-13T17:49:22.017929] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-13T17:49:22.051986] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T17:49:22.514822] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T17:49:22.817952] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-13T17:49:23.130277] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T17:49:23.617889] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-13T17:49:23.775158] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T17:49:24.417940] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-13T17:49:25.141055] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T17:49:25.217929] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-13T17:49:25.430002] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T17:49:26.017945] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-13T17:49:26.635520] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T17:49:26.817950] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-13T17:49:27.617916] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-13T17:49:27.679937] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T17:49:28.230226] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T17:49:28.360337] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T17:49:28.418056] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-13T17:49:29.217949] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-13T17:49:29.968715] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T17:49:30.017890] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-13T17:49:30.629797] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T17:49:30.818082] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-13T17:49:31.576368] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T17:49:31.618056] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-13T17:49:32.266486] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T17:49:32.312025] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T17:49:32.417981] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-13T17:49:33.218015] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-13T17:49:33.788899] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T17:49:33.793630] [INFO ] [REMOTE ] BV: Full fetch complete (54559 records). [2025-10-13T17:49:33.793811] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-13T17:49:34.022292] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-13T17:49:34.161907] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T17:49:34.255486] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-13T17:49:34.255599] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-13T17:49:34.256436] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-13T17:49:34.256504] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-13T17:49:34.258105] [DEBUG] [LOCAL ] BV: Trimmed 54559 records to 38568 (keeping 200 days of data) [2025-10-13T17:49:34.506239] [DEBUG] [LOCAL ] BV: Primary data saved (38568 records). [2025-10-13T17:49:34.506436] [INFO ] [MAIN ] BV: Full history saved. [2025-10-13T17:49:34.506542] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BV took 23.7s. Estimated remaining: 4h 35m 42s. Rate: 7.3 symbols/min [2025-10-13T17:49:34.696241] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:34.749698] [DEBUG] [LOCAL ] BWA: Loaded 52923 existing records from primary storage. [2025-10-13T17:49:34.750146] [INFO ] [MAIN ] BWA: Loaded 52923 existing records. [2025-10-13T17:49:34.826866] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-13T17:49:34.938465] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:34.938778] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-13T17:49:34.938833] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-13T17:49:34.939307] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-13T17:49:34.939366] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-13T17:49:35.291337] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:35.537452] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T17:49:35.617913] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-13T17:49:35.870172] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T17:49:35.872227] [INFO ] [REMOTE ] BUXX: Full fetch complete (20447 records). [2025-10-13T17:49:35.872299] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-13T17:49:36.259192] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-13T17:49:36.259282] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-13T17:49:36.259743] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-13T17:49:36.259805] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-13T17:49:36.260419] [DEBUG] [LOCAL ] BUXX: Trimmed 20447 records to 15320 (keeping 200 days of data) [2025-10-13T17:49:36.359164] [DEBUG] [LOCAL ] BUXX: Primary data saved (15320 records). [2025-10-13T17:49:36.359351] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-13T17:49:36.359455] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BUXX took 25.6s. Estimated remaining: 4h 34m 59s. Rate: 7.3 symbols/min [2025-10-13T17:49:36.424184] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-13T17:49:36.549509] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:36.565456] [DEBUG] [LOCAL ] BWG: Loaded 12767 existing records from primary storage. [2025-10-13T17:49:36.565828] [INFO ] [MAIN ] BWG: Loaded 12767 existing records. [2025-10-13T17:49:36.764943] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:36.765224] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-13T17:49:36.765295] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-13T17:49:36.765603] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-13T17:49:36.765701] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-13T17:49:37.159357] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:37.217928] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-13T17:49:37.457381] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T17:49:38.017935] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-13T17:49:38.066248] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T17:49:38.811457] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T17:49:38.820405] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-13T17:49:39.535224] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:49:39.618006] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-13T17:49:39.732371] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T17:49:40.417944] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-13T17:49:41.080443] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T17:49:41.217918] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-13T17:49:42.015038] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T17:49:42.024440] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-13T17:49:42.817923] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-13T17:49:42.890431] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T17:49:43.617998] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-13T17:49:43.828890] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:49:44.417928] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-13T17:49:44.614597] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T17:49:45.217938] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-13T17:49:45.699709] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T17:49:46.027865] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-13T17:49:46.030930] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T17:49:46.036931] [INFO ] [REMOTE ] BW: Full fetch complete (59083 records). [2025-10-13T17:49:46.037037] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-13T17:49:46.427395] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-13T17:49:46.427593] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-13T17:49:46.428430] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-13T17:49:46.428495] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-13T17:49:46.430288] [DEBUG] [LOCAL ] BW: Trimmed 59083 records to 40411 (keeping 200 days of data) [2025-10-13T17:49:46.675731] [DEBUG] [LOCAL ] BW: Primary data saved (40411 records). [2025-10-13T17:49:46.675914] [INFO ] [MAIN ] BW: Full history saved. [2025-10-13T17:49:46.676029] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BW took 35.9s. Estimated remaining: 4h 35m 2s. Rate: 7.3 symbols/min [2025-10-13T17:49:46.831603] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-13T17:49:46.860172] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:46.899585] [DEBUG] [LOCAL ] BWLP: Loaded 32930 existing records from primary storage. [2025-10-13T17:49:46.899965] [INFO ] [MAIN ] BWLP: Loaded 32930 existing records. [2025-10-13T17:49:47.092063] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:47.106353] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-13T17:49:47.111591] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-13T17:49:47.127409] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-13T17:49:47.128009] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-13T17:49:47.129599] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T17:49:47.526918] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:47.617943] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-13T17:49:47.647015] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T17:49:47.652198] [INFO ] [REMOTE ] BVN: Full fetch complete (62904 records). [2025-10-13T17:49:47.652310] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-13T17:49:47.760456] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T17:49:48.055972] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-13T17:49:48.056052] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-13T17:49:48.056821] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-13T17:49:48.056883] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-13T17:49:48.058163] [DEBUG] [LOCAL ] BVN: Trimmed 62904 records to 44224 (keeping 200 days of data) [2025-10-13T17:49:48.316817] [DEBUG] [LOCAL ] BVN: Primary data saved (44224 records). [2025-10-13T17:49:48.316972] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-13T17:49:48.317053] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BVN took 37.6s. Estimated remaining: 4h 34m 18s. Rate: 7.3 symbols/min [2025-10-13T17:49:48.423076] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-13T17:49:48.487692] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:49:48.496683] [DEBUG] [LOCAL ] BWMX: Loaded 7816 existing records from primary storage. [2025-10-13T17:49:48.497229] [INFO ] [MAIN ] BWMX: Loaded 7816 existing records. [2025-10-13T17:49:48.682772] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:49:48.683013] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-13T17:49:48.683059] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-13T17:49:48.683241] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-13T17:49:48.683314] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-13T17:49:49.053472] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:49:49.215575] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T17:49:49.218327] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-13T17:49:49.559514] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-13T17:49:50.017896] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-13T17:49:50.156345] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-13T17:49:50.791164] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-13T17:49:50.817987] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-13T17:49:51.423525] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:49:51.617932] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-13T17:49:52.417984] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-13T17:49:52.993897] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T17:49:53.208349] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T17:49:53.217882] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-13T17:49:54.017917] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-13T17:49:54.467089] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T17:49:54.817893] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-13T17:49:54.892102] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T17:49:55.617943] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-13T17:49:55.952113] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T17:49:56.417941] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-13T17:49:56.763599] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-13T17:49:57.217935] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-13T17:49:57.358878] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T17:49:57.900905] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T17:49:58.017944] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-13T17:49:58.817950] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-13T17:49:59.397882] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T17:49:59.617901] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-13T17:49:59.772243] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T17:50:00.417998] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-13T17:50:01.187750] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:50:01.217879] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-13T17:50:01.322885] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-13T17:50:02.017916] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-13T17:50:02.557049] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T17:50:02.782415] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T17:50:02.817924] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-13T17:50:03.618021] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-13T17:50:04.417935] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-13T17:50:04.474693] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T17:50:04.755033] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T17:50:04.984380] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T17:50:05.217934] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-13T17:50:06.017987] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-13T17:50:06.032415] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T17:50:06.817937] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-13T17:50:07.617908] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-13T17:50:07.657165] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T17:50:07.768064] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T17:50:08.299987] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T17:50:08.417929] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-13T17:50:09.038997] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T17:50:09.040246] [INFO ] [REMOTE ] BWMX: Full fetch complete (10078 records). [2025-10-13T17:50:09.040319] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-13T17:50:09.221801] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-13T17:50:09.438512] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-13T17:50:09.438589] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-13T17:50:09.438894] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-13T17:50:09.438956] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-13T17:50:09.439386] [DEBUG] [LOCAL ] BWMX: Trimmed 10078 records to 7770 (keeping 200 days of data) [2025-10-13T17:50:09.487717] [DEBUG] [LOCAL ] BWMX: Primary data saved (7770 records). [2025-10-13T17:50:09.487867] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-13T17:50:09.487973] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWMX took 21.2s. Estimated remaining: 4h 35m 21s. Rate: 7.3 symbols/min [2025-10-13T17:50:09.662680] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:09.662890] [DEBUG] [LOCAL ] BWNB: No existing data file found in primary storage. [2025-10-13T17:50:09.662939] [WARN ] [MAIN ] BWNB: No existing data found, performing full refresh instead. [2025-10-13T17:50:09.663048] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-13T17:50:09.663090] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-13T17:50:09.663130] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-10-13T17:50:09.663162] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-13T17:50:10.021327] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:10.019892] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-13T17:50:10.674058] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T17:50:10.817940] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-13T17:50:10.951512] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T17:50:11.465279] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T17:50:11.617925] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-13T17:50:12.417915] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-13T17:50:12.975878] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T17:50:13.217920] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-13T17:50:14.017912] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-13T17:50:14.069571] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T17:50:14.071510] [INFO ] [REMOTE ] BWG: Full fetch complete (17820 records). [2025-10-13T17:50:14.071589] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-13T17:50:14.394805] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T17:50:14.491997] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T17:50:14.518262] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-13T17:50:14.518346] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-13T17:50:14.518937] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-13T17:50:14.519001] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-13T17:50:14.519676] [DEBUG] [LOCAL ] BWG: Trimmed 17820 records to 12657 (keeping 200 days of data) [2025-10-13T17:50:14.593954] [DEBUG] [LOCAL ] BWG: Primary data saved (12657 records). [2025-10-13T17:50:14.594093] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-13T17:50:14.594172] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWG took 38.2s. Estimated remaining: 4h 34m 55s. Rate: 7.3 symbols/min [2025-10-13T17:50:14.768459] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:14.774860] [DEBUG] [LOCAL ] BWSN: Loaded 5205 existing records from primary storage. [2025-10-13T17:50:14.775012] [INFO ] [MAIN ] BWSN: Loaded 5205 existing records. [2025-10-13T17:50:14.826123] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-13T17:50:14.951498] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:50:14.951749] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-13T17:50:14.951801] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-13T17:50:14.951980] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-13T17:50:14.952035] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-13T17:50:15.301487] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:15.617921] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-13T17:50:16.183576] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T17:50:16.417915] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-13T17:50:17.217898] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-13T17:50:17.319697] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T17:50:17.325011] [INFO ] [REMOTE ] BWA: Full fetch complete (75693 records). [2025-10-13T17:50:17.325104] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-13T17:50:17.720812] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T17:50:17.720634] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-13T17:50:17.722381] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-13T17:50:17.723299] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-13T17:50:17.723371] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-13T17:50:17.724893] [DEBUG] [LOCAL ] BWA: Trimmed 75693 records to 52168 (keeping 200 days of data) [2025-10-13T17:50:18.018204] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-13T17:50:18.038395] [DEBUG] [LOCAL ] BWA: Primary data saved (52168 records). [2025-10-13T17:50:18.038562] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-13T17:50:18.039353] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWA took 43.5s. Estimated remaining: 4h 34m 21s. Rate: 7.3 symbols/min [2025-10-13T17:50:18.196386] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T17:50:18.233808] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:18.278058] [DEBUG] [LOCAL ] BWXT: Loaded 47543 existing records from primary storage. [2025-10-13T17:50:18.278359] [INFO ] [MAIN ] BWXT: Loaded 47543 existing records. [2025-10-13T17:50:18.452695] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:50:18.453200] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-13T17:50:18.453249] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-13T17:50:18.453525] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-13T17:50:18.453580] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-13T17:50:18.556766] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T17:50:18.807407] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:18.817885] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-13T17:50:19.617921] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-13T17:50:20.290434] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T17:50:20.417892] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-13T17:50:20.468285] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T17:50:20.849054] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T17:50:21.217916] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-13T17:50:22.017921] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-13T17:50:22.444360] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T17:50:22.817906] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-13T17:50:22.846351] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:50:23.365421] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-13T17:50:23.617978] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-13T17:50:24.417978] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-13T17:50:24.992209] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T17:50:24.997519] [INFO ] [REMOTE ] BWLP: Full fetch complete (48043 records). [2025-10-13T17:50:24.997720] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-13T17:50:25.223103] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-13T17:50:25.380717] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-13T17:50:25.380811] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-13T17:50:25.381483] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-13T17:50:25.381525] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-13T17:50:25.382596] [DEBUG] [LOCAL ] BWLP: Trimmed 48043 records to 32405 (keeping 200 days of data) [2025-10-13T17:50:25.574310] [DEBUG] [LOCAL ] BWLP: Primary data saved (32405 records). [2025-10-13T17:50:25.574425] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-13T17:50:25.574505] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWLP took 38.9s. Estimated remaining: 4h 34m 9s. Rate: 7.3 symbols/min [2025-10-13T17:50:25.741181] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:25.793924] [DEBUG] [LOCAL ] BX: Loaded 54259 existing records from primary storage. [2025-10-13T17:50:25.794273] [INFO ] [MAIN ] BX: Loaded 54259 existing records. [2025-10-13T17:50:25.970232] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:50:25.970501] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-13T17:50:25.970555] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-13T17:50:25.970875] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-13T17:50:25.970931] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-13T17:50:26.023978] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-13T17:50:26.058100] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T17:50:26.356512] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:26.374087] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-13T17:50:26.746860] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T17:50:26.817901] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-13T17:50:27.530528] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T17:50:27.617897] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-13T17:50:28.203682] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T17:50:28.417906] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-13T17:50:29.217927] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-13T17:50:30.017971] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-13T17:50:30.401200] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T17:50:30.455834] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-13T17:50:30.817983] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-13T17:50:30.871362] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T17:50:31.617983] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-13T17:50:31.724746] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T17:50:32.417894] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-13T17:50:33.058398] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T17:50:33.218006] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-13T17:50:33.494769] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T17:50:33.971406] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T17:50:34.017881] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-13T17:50:34.464439] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-13T17:50:34.817930] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-13T17:50:35.445754] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T17:50:35.617933] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-13T17:50:36.417943] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-13T17:50:36.862882] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T17:50:37.217913] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-13T17:50:37.594495] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T17:50:37.767878] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T17:50:37.769023] [INFO ] [REMOTE ] BWSN: Full fetch complete (6286 records). [2025-10-13T17:50:37.769113] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-13T17:50:38.023137] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-13T17:50:38.145925] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-13T17:50:38.146032] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-13T17:50:38.146466] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-13T17:50:38.146535] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-13T17:50:38.147272] [DEBUG] [LOCAL ] BWSN: Trimmed 6286 records to 5132 (keeping 200 days of data) [2025-10-13T17:50:38.187190] [DEBUG] [LOCAL ] BWSN: Primary data saved (5132 records). [2025-10-13T17:50:38.187388] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-13T17:50:38.187591] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWSN took 23.6s. Estimated remaining: 4h 34m 25s. Rate: 7.3 symbols/min [2025-10-13T17:50:38.376502] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:38.395039] [DEBUG] [LOCAL ] BXC: Loaded 13860 existing records from primary storage. [2025-10-13T17:50:38.395440] [INFO ] [MAIN ] BXC: Loaded 13860 existing records. [2025-10-13T17:50:38.596575] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:50:38.596920] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-13T17:50:38.596975] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-13T17:50:38.597295] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-13T17:50:38.597377] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-13T17:50:38.823205] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-13T17:50:39.030357] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:39.474629] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T17:50:39.617927] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-13T17:50:39.924169] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T17:50:40.048028] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-13T17:50:40.049193] [INFO ] [REMOTE ] BWNB: Full fetch complete (5654 records). [2025-10-13T17:50:40.049285] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-13T17:50:40.413589] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-13T17:50:40.413694] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-13T17:50:40.413923] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-13T17:50:40.413964] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-13T17:50:40.414319] [DEBUG] [LOCAL ] BWNB: Trimmed 5654 records to 4239 (keeping 200 days of data) [2025-10-13T17:50:40.426678] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-13T17:50:40.443308] [DEBUG] [LOCAL ] BWNB: Primary data saved (4239 records). [2025-10-13T17:50:40.443394] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-13T17:50:40.443462] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BWNB took 31.0s. Estimated remaining: 4h 33m 44s. Rate: 7.3 symbols/min [2025-10-13T17:50:40.609271] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:50:40.657032] [DEBUG] [LOCAL ] BXMT: Loaded 47937 existing records from primary storage. [2025-10-13T17:50:40.657374] [INFO ] [MAIN ] BXMT: Loaded 47937 existing records. [2025-10-13T17:50:40.831515] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:50:40.831833] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-13T17:50:40.831880] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-13T17:50:40.832332] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-13T17:50:40.832389] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-13T17:50:41.195747] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:50:41.217889] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-13T17:50:41.283980] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T17:50:42.017918] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-13T17:50:42.800479] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T17:50:42.817920] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-13T17:50:42.970891] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T17:50:43.618054] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-13T17:50:43.663377] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T17:50:44.417929] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-13T17:50:45.217924] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-13T17:50:45.301563] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T17:50:45.372007] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T17:50:46.017978] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-13T17:50:46.817919] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-13T17:50:47.245634] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T17:50:47.617931] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-13T17:50:47.685697] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-13T17:50:48.417943] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-13T17:50:48.637638] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T17:50:49.217925] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-13T17:50:49.803192] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-13T17:50:50.017902] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-13T17:50:50.196111] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T17:50:50.690516] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T17:50:50.817915] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-13T17:50:51.617927] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-13T17:50:52.047013] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T17:50:52.417918] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-13T17:50:52.504165] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T17:50:52.756331] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T17:50:53.217936] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-13T17:50:54.017925] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-13T17:50:54.296358] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:50:54.817924] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-13T17:50:55.186573] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T17:50:55.467719] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T17:50:55.617917] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-13T17:50:56.417899] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-13T17:50:56.934179] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T17:50:57.145787] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T17:50:57.217893] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-13T17:50:57.256239] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T17:50:58.017947] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-13T17:50:58.822171] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-13T17:50:58.826438] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T17:50:59.075081] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T17:50:59.617942] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-13T17:51:00.024211] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T17:51:00.417903] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-13T17:51:00.689297] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T17:51:01.217912] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-13T17:51:02.017904] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-13T17:51:02.460408] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-13T17:51:02.680332] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T17:51:02.817917] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-13T17:51:02.994757] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T17:51:03.617930] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-13T17:51:04.052359] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T17:51:04.417980] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-13T17:51:04.477543] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T17:51:05.217938] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-13T17:51:06.017943] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-13T17:51:06.302216] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T17:51:06.817914] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-13T17:51:06.955953] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T17:51:06.957777] [INFO ] [REMOTE ] BXC: Full fetch complete (18186 records). [2025-10-13T17:51:06.957864] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-13T17:51:07.311535] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-13T17:51:07.359186] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-13T17:51:07.359045] [INFO ] [REMOTE ] BX: Full fetch complete (77409 records). [2025-10-13T17:51:07.359304] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-13T17:51:07.359462] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-13T17:51:07.359885] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-13T17:51:07.359963] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-13T17:51:07.459950] [DEBUG] [LOCAL ] BXC: Trimmed 18186 records to 13689 (keeping 200 days of data) [2025-10-13T17:51:07.618979] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-13T17:51:07.860125] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-13T17:51:07.860528] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-13T17:51:07.861797] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-13T17:51:07.861876] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-13T17:51:07.864867] [DEBUG] [LOCAL ] BXC: Primary data saved (13689 records). [2025-10-13T17:51:07.865038] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-13T17:51:07.865225] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BXC took 29.7s. Estimated remaining: 4h 35m 20s. Rate: 7.3 symbols/min [2025-10-13T17:51:07.929777] [DEBUG] [LOCAL ] BX: Trimmed 77409 records to 53483 (keeping 200 days of data) [2025-10-13T17:51:08.130010] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:08.166826] [DEBUG] [LOCAL ] BXMX: Loaded 19803 existing records from primary storage. [2025-10-13T17:51:08.167560] [INFO ] [MAIN ] BXMX: Loaded 19803 existing records. [2025-10-13T17:51:08.414558] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:08.424558] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-13T17:51:08.458412] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-13T17:51:08.460125] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-13T17:51:08.460633] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-13T17:51:08.859803] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:08.860994] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-13T17:51:08.881087] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-13T17:51:08.888898] [INFO ] [REMOTE ] BWXT: Full fetch complete (67566 records). [2025-10-13T17:51:08.889513] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-13T17:51:09.231999] [DEBUG] [LOCAL ] BX: Primary data saved (53483 records). [2025-10-13T17:51:09.253737] [INFO ] [MAIN ] BX: Full history saved. [2025-10-13T17:51:09.259001] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BX took 43.7s. Estimated remaining: 4h 34m 34s. Rate: 7.3 symbols/min [2025-10-13T17:51:09.501538] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-13T17:51:09.501727] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-13T17:51:09.526247] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-13T17:51:09.548342] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-13T17:51:09.551849] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:09.553486] [DEBUG] [LOCAL ] BWXT: Trimmed 67566 records to 46959 (keeping 200 days of data) [2025-10-13T17:51:09.672846] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-13T17:51:09.686461] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-13T17:51:09.736134] [DEBUG] [LOCAL ] BXP: Loaded 50547 existing records from primary storage. [2025-10-13T17:51:09.740456] [INFO ] [MAIN ] BXP: Loaded 50547 existing records. [2025-10-13T17:51:09.935069] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:09.937933] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-13T17:51:09.938110] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-13T17:51:09.992046] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-13T17:51:09.992316] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-13T17:51:10.361439] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T17:51:10.377380] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-13T17:51:10.439465] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:10.500876] [DEBUG] [LOCAL ] BWXT: Primary data saved (46959 records). [2025-10-13T17:51:10.501026] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-13T17:51:10.501849] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BWXT took 52.5s. Estimated remaining: 4h 33m 49s. Rate: 7.3 symbols/min [2025-10-13T17:51:10.667109] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:10.713152] [DEBUG] [LOCAL ] BXSL: Loaded 48607 existing records from primary storage. [2025-10-13T17:51:10.713496] [INFO ] [MAIN ] BXSL: Loaded 48607 existing records. [2025-10-13T17:51:10.823049] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-13T17:51:10.893252] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:10.893515] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-13T17:51:10.893565] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-13T17:51:10.894015] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-13T17:51:10.894072] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-13T17:51:11.251308] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:11.328008] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T17:51:11.333599] [INFO ] [REMOTE ] BXMT: Full fetch complete (69724 records). [2025-10-13T17:51:11.333754] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-13T17:51:11.622948] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-13T17:51:11.643630] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T17:51:11.743832] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-13T17:51:11.743911] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-13T17:51:11.744722] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-13T17:51:11.744810] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-13T17:51:11.746162] [DEBUG] [LOCAL ] BXMT: Trimmed 69724 records to 47241 (keeping 200 days of data) [2025-10-13T17:51:12.037175] [DEBUG] [LOCAL ] BXMT: Primary data saved (47241 records). [2025-10-13T17:51:12.037306] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-13T17:51:12.037387] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMT took 31.6s. Estimated remaining: 4h 33m 5s. Rate: 7.3 symbols/min [2025-10-13T17:51:12.209136] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:12.209410] [DEBUG] [LOCAL ] BY: No existing data file found in primary storage. [2025-10-13T17:51:12.209481] [WARN ] [MAIN ] BY: No existing data found, performing full refresh instead. [2025-10-13T17:51:12.209779] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-13T17:51:12.209847] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-13T17:51:12.209950] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-13T17:51:12.210001] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-13T17:51:12.429919] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-13T17:51:12.569986] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T17:51:12.607487] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:13.217897] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-13T17:51:13.431961] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T17:51:13.499636] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T17:51:14.017995] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-13T17:51:14.604210] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T17:51:14.817912] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-13T17:51:15.617983] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-13T17:51:15.828912] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T17:51:15.927264] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T17:51:16.417939] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-13T17:51:16.644887] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T17:51:17.218209] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-13T17:51:17.550413] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T17:51:18.017918] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-13T17:51:18.713855] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:51:18.817888] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-13T17:51:19.060411] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T17:51:19.617990] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-13T17:51:20.422134] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-13T17:51:20.427259] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T17:51:21.217930] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-13T17:51:21.373602] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T17:51:21.521224] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T17:51:22.018006] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-13T17:51:22.830354] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-13T17:51:22.844698] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T17:51:22.869987] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T17:51:23.617912] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-13T17:51:24.389501] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:51:24.417933] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-13T17:51:24.687912] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T17:51:25.217996] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-13T17:51:25.869253] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T17:51:26.017920] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-13T17:51:26.132121] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T17:51:26.817916] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-13T17:51:27.617915] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-13T17:51:27.756042] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:51:27.791612] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T17:51:28.417914] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-13T17:51:28.927450] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T17:51:29.217906] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-13T17:51:29.587223] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T17:51:29.590533] [INFO ] [REMOTE ] BXMX: Full fetch complete (28788 records). [2025-10-13T17:51:29.590685] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-13T17:51:29.991422] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-13T17:51:29.991516] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-13T17:51:29.992265] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-13T17:51:29.992331] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-13T17:51:29.993213] [DEBUG] [LOCAL ] BXMX: Trimmed 28788 records to 19531 (keeping 200 days of data) [2025-10-13T17:51:30.051576] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-13T17:51:30.134616] [DEBUG] [LOCAL ] BXMX: Primary data saved (19531 records). [2025-10-13T17:51:30.134932] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-13T17:51:30.135071] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXMX took 22.3s. Estimated remaining: 4h 33m 49s. Rate: 7.3 symbols/min [2025-10-13T17:51:30.275697] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T17:51:30.357395] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:30.403773] [DEBUG] [LOCAL ] BYD: Loaded 45519 existing records from primary storage. [2025-10-13T17:51:30.404110] [INFO ] [MAIN ] BYD: Loaded 45519 existing records. [2025-10-13T17:51:30.581252] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:30.581536] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-13T17:51:30.581614] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-13T17:51:30.582046] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-13T17:51:30.582108] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-13T17:51:30.823281] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-13T17:51:30.938729] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:31.617946] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-13T17:51:32.417927] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-13T17:51:32.538070] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:51:32.853612] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-10-13T17:51:33.223543] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-13T17:51:33.236386] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T17:51:33.995838] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T17:51:34.017886] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-13T17:51:34.638878] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T17:51:34.817922] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-13T17:51:35.617896] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-13T17:51:35.680235] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T17:51:36.025828] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T17:51:36.417938] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-13T17:51:37.166240] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T17:51:37.217897] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-13T17:51:38.017946] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-13T17:51:38.399979] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T17:51:38.807149] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T17:51:38.817884] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-13T17:51:39.219851] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T17:51:39.617927] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-13T17:51:40.410434] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T17:51:40.416053] [INFO ] [REMOTE ] BXSL: Full fetch complete (69694 records). [2025-10-13T17:51:40.416166] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-13T17:51:40.428066] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-13T17:51:40.815094] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-13T17:51:40.815191] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-13T17:51:40.816017] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-13T17:51:40.816078] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-13T17:51:40.817583] [DEBUG] [LOCAL ] BXSL: Trimmed 69694 records to 48025 (keeping 200 days of data) [2025-10-13T17:51:41.115545] [DEBUG] [LOCAL ] BXSL: Primary data saved (48025 records). [2025-10-13T17:51:41.115707] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-13T17:51:41.116362] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXSL took 30.6s. Estimated remaining: 4h 33m 56s. Rate: 7.3 symbols/min [2025-10-13T17:51:41.228226] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-13T17:51:41.289976] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:41.325429] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T17:51:41.344602] [DEBUG] [LOCAL ] BYM: Loaded 12105 existing records from primary storage. [2025-10-13T17:51:41.344856] [INFO ] [MAIN ] BYM: Loaded 12105 existing records. [2025-10-13T17:51:41.522875] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:41.523129] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-13T17:51:41.523174] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-13T17:51:41.523406] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-13T17:51:41.523462] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-13T17:51:41.879374] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:42.017908] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-13T17:51:42.067363] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T17:51:42.366398] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T17:51:42.817905] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-13T17:51:43.039887] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T17:51:43.617940] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-13T17:51:43.936746] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T17:51:44.417912] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-13T17:51:44.471076] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T17:51:45.217929] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-13T17:51:45.975215] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T17:51:46.017891] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-13T17:51:46.135592] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T17:51:46.141134] [INFO ] [REMOTE ] BXP: Full fetch complete (71786 records). [2025-10-13T17:51:46.141270] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-13T17:51:46.546354] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-13T17:51:46.546498] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-13T17:51:46.547823] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-13T17:51:46.547904] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-13T17:51:46.550094] [DEBUG] [LOCAL ] BXP: Trimmed 71786 records to 49840 (keeping 200 days of data) [2025-10-13T17:51:46.819095] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-13T17:51:46.884740] [DEBUG] [LOCAL ] BXP: Primary data saved (49840 records). [2025-10-13T17:51:46.884926] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-13T17:51:46.885025] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BXP took 37.6s. Estimated remaining: 4h 33m 34s. Rate: 7.3 symbols/min [2025-10-13T17:51:47.008142] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T17:51:47.085768] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:47.119089] [DEBUG] [LOCAL ] BZH: Loaded 32907 existing records from primary storage. [2025-10-13T17:51:47.119451] [INFO ] [MAIN ] BZH: Loaded 32907 existing records. [2025-10-13T17:51:47.304240] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:47.304535] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-13T17:51:47.304594] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-13T17:51:47.304987] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-13T17:51:47.305052] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-13T17:51:47.630181] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-13T17:51:47.671738] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:48.417924] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-13T17:51:48.612123] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T17:51:48.828452] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T17:51:49.217919] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-13T17:51:49.633337] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T17:51:50.017912] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-13T17:51:50.172634] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T17:51:50.817882] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-13T17:51:51.225031] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T17:51:51.617899] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-13T17:51:51.737525] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T17:51:52.417910] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-13T17:51:53.014201] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:51:53.217895] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-13T17:51:53.399692] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T17:51:54.017927] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-13T17:51:54.579203] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T17:51:54.817885] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-13T17:51:55.328583] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T17:51:55.617924] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-13T17:51:56.157145] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T17:51:56.401883] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T17:51:56.404265] [INFO ] [REMOTE ] BY: Full fetch complete (29679 records). [2025-10-13T17:51:56.404335] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-13T17:51:56.424811] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-13T17:51:56.774591] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-13T17:51:56.774683] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-13T17:51:56.775139] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-13T17:51:56.775179] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-13T17:51:56.775898] [DEBUG] [LOCAL ] BY: Trimmed 29679 records to 21757 (keeping 200 days of data) [2025-10-13T17:51:56.906249] [DEBUG] [LOCAL ] BY: Primary data saved (21757 records). [2025-10-13T17:51:56.906385] [INFO ] [MAIN ] BY: Full history saved. [2025-10-13T17:51:56.906456] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BY took 44.9s. Estimated remaining: 4h 33m 35s. Rate: 7.3 symbols/min [2025-10-13T17:51:57.073098] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:51:57.124228] [DEBUG] [LOCAL ] C: Loaded 54520 existing records from primary storage. [2025-10-13T17:51:57.124563] [INFO ] [MAIN ] C: Loaded 54520 existing records. [2025-10-13T17:51:57.223006] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-13T17:51:57.314108] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:51:57.315257] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T17:51:57.315503] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-13T17:51:57.318570] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-13T17:51:57.319635] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-13T17:51:57.319723] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-13T17:51:57.673391] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:51:58.017937] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-13T17:51:58.817998] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-13T17:51:59.100042] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T17:51:59.370077] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T17:51:59.617889] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-13T17:52:00.417946] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-13T17:52:00.648096] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T17:52:01.096836] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T17:52:01.217886] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-13T17:52:01.230505] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T17:52:02.018001] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-13T17:52:02.817915] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-13T17:52:03.219958] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-13T17:52:03.617928] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-13T17:52:03.681580] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T17:52:04.186883] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-13T17:52:04.417946] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-13T17:52:05.106165] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T17:52:05.217936] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-13T17:52:05.795163] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T17:52:06.017934] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-13T17:52:06.817972] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-13T17:52:07.115175] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T17:52:07.330458] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-13T17:52:07.619134] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-13T17:52:07.624363] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T17:52:08.417945] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-13T17:52:09.218018] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-13T17:52:09.266538] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T17:52:09.371787] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T17:52:10.017971] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-13T17:52:10.820048] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-13T17:52:10.822933] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T17:52:10.824801] [INFO ] [REMOTE ] BYM: Full fetch complete (17697 records). [2025-10-13T17:52:10.824872] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-13T17:52:11.203859] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-13T17:52:11.203957] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-13T17:52:11.204411] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-13T17:52:11.204558] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-13T17:52:11.205432] [DEBUG] [LOCAL ] BYM: Trimmed 17697 records to 11777 (keeping 200 days of data) [2025-10-13T17:52:11.306519] [DEBUG] [LOCAL ] BYM: Primary data saved (11777 records). [2025-10-13T17:52:11.306720] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-13T17:52:11.306820] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 30.2s. Estimated remaining: 4h 33m 60s. Rate: 7.3 symbols/min [2025-10-13T17:52:11.330469] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-13T17:52:11.497197] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:11.515867] [DEBUG] [LOCAL ] CAAP: Loaded 20121 existing records from primary storage. [2025-10-13T17:52:11.516115] [INFO ] [MAIN ] CAAP: Loaded 20121 existing records. [2025-10-13T17:52:11.620127] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-13T17:52:11.700619] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:11.701387] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-13T17:52:11.701462] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-13T17:52:11.701738] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-13T17:52:11.701823] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-13T17:52:12.085304] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:12.162012] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T17:52:12.417950] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-13T17:52:13.213227] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T17:52:13.222006] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-13T17:52:13.669824] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T17:52:13.673169] [INFO ] [REMOTE ] BZH: Full fetch complete (47056 records). [2025-10-13T17:52:13.673282] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-13T17:52:14.037094] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-13T17:52:14.055370] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-13T17:52:14.055452] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-13T17:52:14.056111] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-13T17:52:14.056175] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-13T17:52:14.057381] [DEBUG] [LOCAL ] BZH: Trimmed 47056 records to 32456 (keeping 200 days of data) [2025-10-13T17:52:14.240593] [DEBUG] [LOCAL ] BZH: Primary data saved (32456 records). [2025-10-13T17:52:14.240759] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-13T17:52:14.240844] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 27.4s. Estimated remaining: 4h 33m 24s. Rate: 7.3 symbols/min [2025-10-13T17:52:14.411467] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:14.428221] [DEBUG] [LOCAL ] CABO: Loaded 17073 existing records from primary storage. [2025-10-13T17:52:14.428461] [INFO ] [MAIN ] CABO: Loaded 17073 existing records. [2025-10-13T17:52:14.603221] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:14.603450] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-13T17:52:14.603537] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-13T17:52:14.603782] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-13T17:52:14.603840] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-13T17:52:14.840137] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-13T17:52:14.963481] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:15.311537] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-13T17:52:15.607905] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T17:52:15.612783] [INFO ] [REMOTE ] BYD: Full fetch complete (65101 records). [2025-10-13T17:52:15.612888] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-13T17:52:15.624805] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-13T17:52:15.996329] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-13T17:52:15.996553] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-13T17:52:15.997442] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-13T17:52:15.997500] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-13T17:52:15.998954] [DEBUG] [LOCAL ] BYD: Trimmed 65101 records to 44846 (keeping 200 days of data) [2025-10-13T17:52:16.113043] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:52:16.288513] [DEBUG] [LOCAL ] BYD: Primary data saved (44846 records). [2025-10-13T17:52:16.288679] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-13T17:52:16.288774] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. BYD took 46.2s. Estimated remaining: 4h 32m 43s. Rate: 7.3 symbols/min [2025-10-13T17:52:16.427362] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-13T17:52:16.459302] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:16.481971] [DEBUG] [LOCAL ] CACI: Loaded 24045 existing records from primary storage. [2025-10-13T17:52:16.482213] [INFO ] [MAIN ] CACI: Loaded 24045 existing records. [2025-10-13T17:52:16.663106] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:16.663493] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-13T17:52:16.669873] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T17:52:16.669658] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-13T17:52:16.672723] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-13T17:52:16.672781] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-13T17:52:17.024222] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:17.217904] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-13T17:52:18.017886] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-13T17:52:18.423412] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T17:52:18.745636] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-13T17:52:18.820348] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-13T17:52:18.823473] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T17:52:19.617998] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-13T17:52:20.149179] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T17:52:20.257117] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T17:52:20.417916] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-13T17:52:21.217926] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-13T17:52:21.815057] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:52:22.017918] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-13T17:52:22.817900] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-13T17:52:22.939007] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T17:52:23.188470] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-13T17:52:23.617986] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-13T17:52:24.322270] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:52:24.417903] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-13T17:52:24.766992] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T17:52:25.218013] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-13T17:52:25.995071] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T17:52:26.018543] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T17:52:26.018688] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-13T17:52:26.817966] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-13T17:52:27.072823] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T17:52:27.617922] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-13T17:52:28.417928] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-13T17:52:28.844470] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T17:52:29.190181] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-13T17:52:29.217906] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-13T17:52:29.256443] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T17:52:30.017919] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-13T17:52:30.248750] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T17:52:30.753458] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T17:52:30.818035] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-13T17:52:31.617945] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-13T17:52:32.417973] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-13T17:52:32.735951] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T17:52:32.886277] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-13T17:52:33.217908] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-13T17:52:33.464697] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T17:52:34.017976] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-13T17:52:34.228917] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T17:52:34.817902] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-13T17:52:34.982097] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T17:52:35.617918] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-13T17:52:36.417906] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-13T17:52:36.857397] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T17:52:37.002664] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T17:52:37.055349] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T17:52:37.217928] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-13T17:52:38.017896] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-13T17:52:38.390184] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T17:52:38.817918] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-13T17:52:39.086816] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T17:52:39.617903] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-13T17:52:39.821831] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T17:52:40.417909] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-13T17:52:40.575324] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T17:52:41.217927] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-13T17:52:42.017900] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-13T17:52:42.265513] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T17:52:42.483813] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-13T17:52:42.489326] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-13T17:52:42.489485] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-13T17:52:42.822991] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-13T17:52:42.904195] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-13T17:52:42.904370] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-13T17:52:42.905369] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-13T17:52:42.905461] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-13T17:52:42.907095] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 53740 (keeping 200 days of data) [2025-10-13T17:52:43.011156] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T17:52:43.015233] [INFO ] [REMOTE ] CACI: Full fetch complete (38318 records). [2025-10-13T17:52:43.016506] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-13T17:52:43.542030] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-13T17:52:43.542334] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-13T17:52:43.543161] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-13T17:52:43.543239] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-13T17:52:43.545948] [DEBUG] [LOCAL ] CACI: Trimmed 38318 records to 23367 (keeping 200 days of data) [2025-10-13T17:52:43.638358] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-13T17:52:43.783920] [DEBUG] [LOCAL ] CACI: Primary data saved (23367 records). [2025-10-13T17:52:43.792883] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-13T17:52:43.793617] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CACI took 27.5s. Estimated remaining: 4h 34m 15s. Rate: 7.3 symbols/min [2025-10-13T17:52:43.799835] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T17:52:43.830885] [INFO ] [REMOTE ] CABO: Full fetch complete (23127 records). [2025-10-13T17:52:43.846175] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-13T17:52:44.117616] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:44.235303] [DEBUG] [LOCAL ] C: Primary data saved (53740 records). [2025-10-13T17:52:44.280429] [INFO ] [MAIN ] C: Full history saved. [2025-10-13T17:52:44.308450] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. C took 47.4s. Estimated remaining: 4h 33m 27s. Rate: 7.3 symbols/min [2025-10-13T17:52:44.557933] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-13T17:52:44.564253] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-13T17:52:44.605080] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-13T17:52:44.606991] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-13T17:52:44.610203] [DEBUG] [LOCAL ] CADE: Loaded 49940 existing records from primary storage. [2025-10-13T17:52:44.611226] [INFO ] [MAIN ] CADE: Loaded 49940 existing records. [2025-10-13T17:52:44.606796] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:44.657423] [DEBUG] [LOCAL ] CABO: Trimmed 23127 records to 16807 (keeping 200 days of data) [2025-10-13T17:52:44.779915] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T17:52:44.868874] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-13T17:52:44.910463] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:44.913397] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-13T17:52:44.916311] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-13T17:52:44.920447] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-13T17:52:44.920884] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-13T17:52:45.044392] [DEBUG] [LOCAL ] CAE: Loaded 39779 existing records from primary storage. [2025-10-13T17:52:45.055737] [DEBUG] [LOCAL ] CABO: Primary data saved (16807 records). [2025-10-13T17:52:45.063847] [INFO ] [MAIN ] CAE: Loaded 39779 existing records. [2025-10-13T17:52:45.063094] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-13T17:52:45.080786] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CABO took 30.8s. Estimated remaining: 4h 32m 40s. Rate: 7.3 symbols/min [2025-10-13T17:52:45.662858] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:45.635900] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:45.722667] [DEBUG] [LOCAL ] CAF: Loaded 3477 existing records from primary storage. [2025-10-13T17:52:45.722864] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-13T17:52:45.726978] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:45.727615] [INFO ] [MAIN ] CAF: Loaded 3477 existing records. [2025-10-13T17:52:45.727803] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-13T17:52:45.728121] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-13T17:52:45.749087] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-13T17:52:45.760421] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-13T17:52:46.027458] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:46.027774] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-13T17:52:46.039768] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-13T17:52:46.050236] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-13T17:52:46.055468] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-13T17:52:46.531594] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:46.567177] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-13T17:52:46.569809] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:52:46.706925] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:46.817898] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-13T17:52:47.385524] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T17:52:47.518396] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-13T17:52:47.617901] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-13T17:52:47.809259] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T17:52:48.417918] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-13T17:52:49.217938] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-13T17:52:49.262680] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T17:52:49.865563] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T17:52:50.017933] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-13T17:52:50.306681] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T17:52:50.309719] [INFO ] [REMOTE ] CAAP: Full fetch complete (27792 records). [2025-10-13T17:52:50.309792] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-13T17:52:50.615600] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-13T17:52:50.690554] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-13T17:52:50.690630] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-13T17:52:50.691154] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-13T17:52:50.691202] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-13T17:52:50.691958] [DEBUG] [LOCAL ] CAAP: Trimmed 27792 records to 19758 (keeping 200 days of data) [2025-10-13T17:52:50.810538] [DEBUG] [LOCAL ] CAAP: Primary data saved (19758 records). [2025-10-13T17:52:50.810710] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-13T17:52:50.810804] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAAP took 39.5s. Estimated remaining: 4h 32m 18s. Rate: 7.3 symbols/min [2025-10-13T17:52:50.823084] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-13T17:52:50.983350] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:52:51.036519] [DEBUG] [LOCAL ] CAG: Loaded 54444 existing records from primary storage. [2025-10-13T17:52:51.036858] [INFO ] [MAIN ] CAG: Loaded 54444 existing records. [2025-10-13T17:52:51.209827] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:52:51.210075] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-13T17:52:51.210121] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-13T17:52:51.210757] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-13T17:52:51.210813] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-13T17:52:51.556579] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:52:51.617895] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-13T17:52:52.245601] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T17:52:52.417982] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-13T17:52:52.976687] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T17:52:53.166501] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T17:52:53.217888] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-13T17:52:54.017935] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-13T17:52:54.581277] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-13T17:52:54.817913] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-13T17:52:54.993054] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T17:52:55.416348] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-13T17:52:55.617924] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-13T17:52:56.199953] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T17:52:56.417948] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-13T17:52:56.899340] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-13T17:52:57.217905] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-13T17:52:58.017950] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-13T17:52:58.614595] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T17:52:58.817934] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-13T17:52:59.357627] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T17:52:59.617910] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-13T17:52:59.746248] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T17:53:00.417931] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-13T17:53:01.207236] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T17:53:01.217881] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-13T17:53:01.982670] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:53:02.017896] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-13T17:53:02.673048] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T17:53:02.817895] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-13T17:53:03.617896] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-13T17:53:03.789259] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T17:53:04.225533] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T17:53:04.417930] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-13T17:53:05.217904] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-13T17:53:05.576983] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T17:53:05.643633] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-13T17:53:06.017903] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-13T17:53:06.218224] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T17:53:06.592399] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T17:53:06.817920] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-13T17:53:07.617934] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-13T17:53:08.204899] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T17:53:08.206270] [INFO ] [REMOTE ] CAF: Full fetch complete (5592 records). [2025-10-13T17:53:08.206341] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-13T17:53:08.365283] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T17:53:08.427708] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-13T17:53:08.641045] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-13T17:53:08.641122] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-13T17:53:08.641272] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-13T17:53:08.641310] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-13T17:53:08.641690] [DEBUG] [LOCAL ] CAF: Trimmed 5592 records to 3452 (keeping 200 days of data) [2025-10-13T17:53:08.662684] [DEBUG] [LOCAL ] CAF: Primary data saved (3452 records). [2025-10-13T17:53:08.662767] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-13T17:53:08.662837] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CAF took 23.5s. Estimated remaining: 4h 32m 60s. Rate: 7.3 symbols/min [2025-10-13T17:53:08.860487] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:08.913487] [DEBUG] [LOCAL ] CAH: Loaded 52215 existing records from primary storage. [2025-10-13T17:53:08.913827] [INFO ] [MAIN ] CAH: Loaded 52215 existing records. [2025-10-13T17:53:09.089428] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:09.089680] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-13T17:53:09.089739] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-13T17:53:09.090070] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-13T17:53:09.090127] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-13T17:53:09.228532] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-13T17:53:09.443370] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:10.017894] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-13T17:53:10.365898] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T17:53:10.817906] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-13T17:53:11.012188] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T17:53:11.618019] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-13T17:53:11.876914] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T17:53:12.349693] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T17:53:12.417899] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-13T17:53:13.189338] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T17:53:13.217886] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-13T17:53:13.483183] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T17:53:13.487589] [INFO ] [REMOTE ] CAE: Full fetch complete (56071 records). [2025-10-13T17:53:13.487772] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-13T17:53:13.871158] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-13T17:53:13.871264] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-13T17:53:13.871962] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-13T17:53:13.872024] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-13T17:53:13.873170] [DEBUG] [LOCAL ] CAE: Trimmed 56071 records to 39244 (keeping 200 days of data) [2025-10-13T17:53:14.032345] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-13T17:53:14.099221] [DEBUG] [LOCAL ] CAE: Primary data saved (39244 records). [2025-10-13T17:53:14.099364] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-13T17:53:14.099447] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAE took 29.8s. Estimated remaining: 4h 32m 37s. Rate: 7.3 symbols/min [2025-10-13T17:53:14.286863] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:14.334697] [DEBUG] [LOCAL ] CAL: Loaded 43674 existing records from primary storage. [2025-10-13T17:53:14.335011] [INFO ] [MAIN ] CAL: Loaded 43674 existing records. [2025-10-13T17:53:14.542450] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:14.542756] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-13T17:53:14.542810] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-13T17:53:14.543138] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-13T17:53:14.543194] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-13T17:53:14.824704] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-13T17:53:14.947189] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:14.979164] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T17:53:15.386506] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T17:53:15.617930] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-13T17:53:16.417901] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-13T17:53:16.686357] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T17:53:17.217893] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-13T17:53:17.786785] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-13T17:53:18.017906] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-13T17:53:18.144299] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T17:53:18.442347] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T17:53:18.818017] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-13T17:53:19.617983] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-13T17:53:19.916990] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T17:53:20.418021] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-13T17:53:21.097698] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T17:53:21.217912] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-13T17:53:21.648581] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T17:53:22.018027] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-13T17:53:22.817992] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-13T17:53:23.246689] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-13T17:53:23.617983] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-13T17:53:23.754933] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T17:53:24.417924] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-13T17:53:24.744080] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T17:53:24.981079] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T17:53:25.196515] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (6.38 seconds). [2025-10-13T17:53:25.217880] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-13T17:53:25.760127] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T17:53:26.017971] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-13T17:53:26.336196] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T17:53:26.817935] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-13T17:53:27.617943] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-13T17:53:27.920174] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T17:53:28.417929] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-13T17:53:28.779538] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-13T17:53:28.785116] [INFO ] [REMOTE ] CAG: Full fetch complete (77655 records). [2025-10-13T17:53:28.785465] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-13T17:53:29.186283] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-13T17:53:29.186409] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-13T17:53:29.187431] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-13T17:53:29.187518] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-13T17:53:29.189543] [DEBUG] [LOCAL ] CAG: Trimmed 77655 records to 53665 (keeping 200 days of data) [2025-10-13T17:53:29.267421] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-13T17:53:29.313771] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T17:53:29.562893] [DEBUG] [LOCAL ] CAG: Primary data saved (53665 records). [2025-10-13T17:53:29.563041] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-13T17:53:29.563932] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAG took 38.8s. Estimated remaining: 4h 33m 6s. Rate: 7.3 symbols/min [2025-10-13T17:53:29.732244] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:29.772081] [DEBUG] [LOCAL ] CALX: Loaded 38212 existing records from primary storage. [2025-10-13T17:53:29.772455] [INFO ] [MAIN ] CALX: Loaded 38212 existing records. [2025-10-13T17:53:29.949107] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:29.949387] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-13T17:53:29.949493] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-13T17:53:29.949749] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-13T17:53:29.949817] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-13T17:53:30.023076] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-13T17:53:30.247062] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T17:53:30.363057] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:30.817917] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-13T17:53:30.978525] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:53:31.617899] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-13T17:53:31.679980] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T17:53:31.688008] [INFO ] [REMOTE ] CADE: Full fetch complete (70173 records). [2025-10-13T17:53:31.688185] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-13T17:53:32.091383] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-13T17:53:32.091483] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-13T17:53:32.092381] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-13T17:53:32.092489] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-13T17:53:32.094604] [DEBUG] [LOCAL ] CADE: Trimmed 70173 records to 49361 (keeping 200 days of data) [2025-10-13T17:53:32.200436] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:53:32.416728] [DEBUG] [LOCAL ] CADE: Primary data saved (49361 records). [2025-10-13T17:53:32.416868] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-13T17:53:32.416950] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CADE took 48.6s. Estimated remaining: 4h 32m 30s. Rate: 7.3 symbols/min [2025-10-13T17:53:32.427765] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-13T17:53:32.586233] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:32.586419] [DEBUG] [LOCAL ] CANG: No existing data file found in primary storage. [2025-10-13T17:53:32.586456] [WARN ] [MAIN ] CANG: No existing data found, performing full refresh instead. [2025-10-13T17:53:32.586564] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-13T17:53:32.586604] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-13T17:53:32.586675] [DEBUG] [LOCAL ] CANG: No primary data file found to delete. [2025-10-13T17:53:32.586728] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-13T17:53:32.936100] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:33.217898] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-13T17:53:33.293383] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T17:53:33.318813] [DEBUG] [REMOTE ] CANG: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-13T17:53:33.319100] [WARN ] [REMOTE ] CANG: No data returned for month 2024-12 [2025-10-13T17:53:33.319191] [FATAL] [REMOTE ] CANG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:53:33.319266] [FATAL] [MAIN ] CANG: Failed to fetch primary data. [2025-10-13T17:53:33.319373] [WARN ] [MAIN ] CANG: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:53:33.319446] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-13T17:53:33.319510] [DEBUG] [LOCAL ] CANG: No primary data file found to delete. [2025-10-13T17:53:33.319546] [INFO ] [LOCAL ] CANG: Starting deletion of derivative data. [2025-10-13T17:53:33.319585] [DEBUG] [LOCAL ] CANG: No derivative data file found to delete. [2025-10-13T17:53:33.319635] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CANG took 0.9s. Estimated remaining: 4h 31m 44s. Rate: 7.3 symbols/min [2025-10-13T17:53:33.525176] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:33.532520] [DEBUG] [LOCAL ] CAPL: Loaded 5797 existing records from primary storage. [2025-10-13T17:53:33.532712] [INFO ] [MAIN ] CAPL: Loaded 5797 existing records. [2025-10-13T17:53:33.729407] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:33.729702] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-13T17:53:33.729758] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-13T17:53:33.729914] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-13T17:53:33.729994] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-13T17:53:34.017904] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-13T17:53:34.110307] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:34.105048] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:53:34.818032] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-13T17:53:35.617903] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-13T17:53:35.655711] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T17:53:36.417902] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-13T17:53:36.757828] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T17:53:37.003295] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T17:53:37.215803] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T17:53:37.218267] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-13T17:53:37.903773] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T17:53:38.017914] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-13T17:53:38.622929] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T17:53:38.817928] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-13T17:53:39.618020] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-13T17:53:40.245131] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T17:53:40.417926] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-13T17:53:40.621691] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T17:53:41.218021] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-13T17:53:41.898814] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-13T17:53:41.925012] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T17:53:42.017888] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-13T17:53:42.637453] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T17:53:42.817915] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-13T17:53:43.617930] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-13T17:53:44.417913] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-13T17:53:44.466778] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T17:53:45.217904] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-13T17:53:45.279555] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T17:53:46.017918] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-13T17:53:46.064123] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T17:53:46.069378] [INFO ] [REMOTE ] CAH: Full fetch complete (74589 records). [2025-10-13T17:53:46.069513] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-13T17:53:46.452823] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-13T17:53:46.452913] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-13T17:53:46.453808] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-13T17:53:46.453874] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-13T17:53:46.455347] [DEBUG] [LOCAL ] CAH: Trimmed 74589 records to 51475 (keeping 200 days of data) [2025-10-13T17:53:46.699995] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T17:53:46.819194] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-13T17:53:46.830717] [DEBUG] [LOCAL ] CAH: Primary data saved (51475 records). [2025-10-13T17:53:46.831197] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-13T17:53:46.831430] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CAH took 38.2s. Estimated remaining: 4h 32m 3s. Rate: 7.3 symbols/min [2025-10-13T17:53:47.006680] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:47.060618] [DEBUG] [LOCAL ] CARR: Loaded 54377 existing records from primary storage. [2025-10-13T17:53:47.061265] [INFO ] [MAIN ] CARR: Loaded 54377 existing records. [2025-10-13T17:53:47.250612] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:47.251082] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-13T17:53:47.251146] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-13T17:53:47.251534] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-13T17:53:47.251595] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-13T17:53:47.639149] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-13T17:53:47.646517] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:47.690421] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T17:53:48.263551] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T17:53:48.349523] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T17:53:48.417945] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-13T17:53:49.217926] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-13T17:53:49.732043] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T17:53:50.017911] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-13T17:53:50.302062] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T17:53:50.724229] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-13T17:53:50.817897] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-13T17:53:51.617921] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-13T17:53:52.417987] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-13T17:53:52.507270] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T17:53:52.924807] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-13T17:53:53.214589] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T17:53:53.223101] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-13T17:53:54.017947] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-13T17:53:54.817899] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-13T17:53:54.925506] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T17:53:55.425808] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T17:53:55.617890] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-13T17:53:56.284359] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T17:53:56.288818] [INFO ] [REMOTE ] CAL: Full fetch complete (61743 records). [2025-10-13T17:53:56.288915] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-13T17:53:56.429308] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-13T17:53:56.683937] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-13T17:53:56.684016] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-13T17:53:56.684792] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-13T17:53:56.684854] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-13T17:53:56.686062] [DEBUG] [LOCAL ] CAL: Trimmed 61743 records to 43025 (keeping 200 days of data) [2025-10-13T17:53:56.950417] [DEBUG] [LOCAL ] CAL: Primary data saved (43025 records). [2025-10-13T17:53:56.950555] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-13T17:53:56.950633] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CAL took 42.9s. Estimated remaining: 4h 32m 4s. Rate: 7.3 symbols/min [2025-10-13T17:53:57.124692] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:57.160848] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T17:53:57.205948] [DEBUG] [LOCAL ] CARS: Loaded 40395 existing records from primary storage. [2025-10-13T17:53:57.206233] [INFO ] [MAIN ] CARS: Loaded 40395 existing records. [2025-10-13T17:53:57.226581] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-13T17:53:57.381594] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:57.381813] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-13T17:53:57.381858] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-13T17:53:57.382135] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-13T17:53:57.382194] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-13T17:53:57.726492] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:57.883969] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T17:53:57.885129] [INFO ] [REMOTE ] CAPL: Full fetch complete (8747 records). [2025-10-13T17:53:57.885200] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-13T17:53:58.018106] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-13T17:53:58.274774] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-13T17:53:58.274984] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-13T17:53:58.275443] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-13T17:53:58.275726] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-13T17:53:58.276253] [DEBUG] [LOCAL ] CAPL: Trimmed 8747 records to 5669 (keeping 200 days of data) [2025-10-13T17:53:58.340613] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T17:53:58.361182] [DEBUG] [LOCAL ] CAPL: Primary data saved (5669 records). [2025-10-13T17:53:58.361390] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-13T17:53:58.361500] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CAPL took 25.0s. Estimated remaining: 4h 31m 21s. Rate: 7.3 symbols/min [2025-10-13T17:53:58.553540] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:53:58.605007] [DEBUG] [LOCAL ] CAT: Loaded 53689 existing records from primary storage. [2025-10-13T17:53:58.605470] [INFO ] [MAIN ] CAT: Loaded 53689 existing records. [2025-10-13T17:53:58.782634] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:53:58.782927] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-13T17:53:58.782976] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-13T17:53:58.783183] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-13T17:53:58.783221] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-13T17:53:58.824728] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-13T17:53:59.136436] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:53:59.525024] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:53:59.617887] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-13T17:54:00.418027] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-13T17:54:00.728903] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T17:54:00.788625] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T17:54:01.218013] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-13T17:54:01.982450] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T17:54:02.017911] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-13T17:54:02.817943] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-13T17:54:03.071625] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T17:54:03.404879] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-13T17:54:03.618031] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-13T17:54:04.417901] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-13T17:54:04.602575] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T17:54:04.978866] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T17:54:04.982478] [INFO ] [REMOTE ] CALX: Full fetch complete (54013 records). [2025-10-13T17:54:04.982569] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-13T17:54:05.224145] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-13T17:54:05.358626] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-13T17:54:05.358734] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-13T17:54:05.359399] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-13T17:54:05.359438] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-13T17:54:05.360591] [DEBUG] [LOCAL ] CALX: Trimmed 54013 records to 37689 (keeping 200 days of data) [2025-10-13T17:54:05.575325] [DEBUG] [LOCAL ] CALX: Primary data saved (37689 records). [2025-10-13T17:54:05.575455] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-13T17:54:05.576118] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CALX took 36.0s. Estimated remaining: 4h 31m 8s. Rate: 7.3 symbols/min [2025-10-13T17:54:05.743128] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:05.752467] [DEBUG] [LOCAL ] CATO: Loaded 6958 existing records from primary storage. [2025-10-13T17:54:05.752743] [INFO ] [MAIN ] CATO: Loaded 6958 existing records. [2025-10-13T17:54:05.925567] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:05.925797] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-13T17:54:05.925845] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-13T17:54:05.926064] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-13T17:54:05.926119] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-13T17:54:06.022972] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-13T17:54:06.278966] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:06.492502] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-13T17:54:06.817902] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-13T17:54:07.150152] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T17:54:07.420780] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T17:54:07.618057] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-13T17:54:07.804587] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T17:54:08.418006] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-13T17:54:09.080984] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-13T17:54:09.109332] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T17:54:09.218001] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-13T17:54:10.017922] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-13T17:54:10.817986] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-13T17:54:11.207872] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T17:54:11.618104] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-13T17:54:11.761902] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T17:54:12.273343] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:54:12.417986] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-13T17:54:12.868141] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-13T17:54:13.217978] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-13T17:54:14.017939] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-13T17:54:14.056209] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T17:54:14.144245] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T17:54:14.817989] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-13T17:54:15.617922] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-13T17:54:16.230692] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T17:54:16.332058] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-13T17:54:16.417896] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-13T17:54:17.217993] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-13T17:54:17.609874] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-13T17:54:18.017936] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-13T17:54:18.602364] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-13T17:54:18.646696] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T17:54:18.671662] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T17:54:18.817985] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-13T17:54:19.434412] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T17:54:19.618040] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-13T17:54:20.276175] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T17:54:20.418006] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-13T17:54:21.217980] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-13T17:54:22.017996] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-13T17:54:22.470826] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-13T17:54:22.635259] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T17:54:22.817981] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-13T17:54:22.945482] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T17:54:22.951528] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-13T17:54:22.951728] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-13T17:54:23.377990] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-13T17:54:23.378143] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-13T17:54:23.379278] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-13T17:54:23.379348] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-13T17:54:23.381479] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 53602 (keeping 200 days of data) [2025-10-13T17:54:23.502320] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T17:54:23.639031] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-13T17:54:23.768130] [DEBUG] [LOCAL ] CARR: Primary data saved (53602 records). [2025-10-13T17:54:23.768341] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-13T17:54:23.768484] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CARR took 36.9s. Estimated remaining: 4h 31m 50s. Rate: 7.3 symbols/min [2025-10-13T17:54:23.946956] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:24.001549] [DEBUG] [LOCAL ] CAVA: Loaded 54334 existing records from primary storage. [2025-10-13T17:54:24.001968] [INFO ] [MAIN ] CAVA: Loaded 54334 existing records. [2025-10-13T17:54:24.184291] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:24.184605] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-13T17:54:24.184698] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-13T17:54:24.185125] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-13T17:54:24.185183] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-13T17:54:24.437343] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-13T17:54:24.473019] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T17:54:24.574724] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:25.217985] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-13T17:54:26.017926] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-13T17:54:26.150306] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T17:54:26.726677] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T17:54:26.728087] [INFO ] [REMOTE ] CATO: Full fetch complete (10967 records). [2025-10-13T17:54:26.728217] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-13T17:54:26.826721] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-13T17:54:27.129299] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-13T17:54:27.129402] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-13T17:54:27.129877] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-13T17:54:27.129959] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-13T17:54:27.130925] [DEBUG] [LOCAL ] CATO: Trimmed 10967 records to 6798 (keeping 200 days of data) [2025-10-13T17:54:27.171580] [DEBUG] [LOCAL ] CATO: Primary data saved (6798 records). [2025-10-13T17:54:27.171754] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-13T17:54:27.171916] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CATO took 21.6s. Estimated remaining: 4h 31m 17s. Rate: 7.3 symbols/min [2025-10-13T17:54:27.342952] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-13T17:54:27.409625] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:27.455334] [DEBUG] [LOCAL ] CB: Loaded 50652 existing records from primary storage. [2025-10-13T17:54:27.455636] [INFO ] [MAIN ] CB: Loaded 50652 existing records. [2025-10-13T17:54:27.624377] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-13T17:54:27.684295] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:27.684591] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-13T17:54:27.684668] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-13T17:54:27.684915] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-13T17:54:27.684954] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-13T17:54:28.039308] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:28.418029] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-13T17:54:28.725677] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T17:54:29.217921] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-13T17:54:29.778399] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-13T17:54:30.017980] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-13T17:54:30.130816] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T17:54:30.818006] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-13T17:54:31.230666] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-13T17:54:31.617917] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-13T17:54:31.773474] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T17:54:32.227875] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T17:54:32.417930] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-13T17:54:33.217919] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-13T17:54:33.540417] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T17:54:34.018013] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-13T17:54:34.591826] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-13T17:54:34.698591] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T17:54:34.817925] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-13T17:54:35.617905] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-13T17:54:35.887137] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T17:54:36.417894] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-13T17:54:36.857796] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-13T17:54:37.217930] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-13T17:54:37.674899] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T17:54:38.017906] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-13T17:54:38.345565] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-13T17:54:38.709783] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T17:54:38.715764] [INFO ] [REMOTE ] CARS: Full fetch complete (55880 records). [2025-10-13T17:54:38.715924] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-13T17:54:38.823058] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-13T17:54:39.145275] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-13T17:54:39.145364] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-13T17:54:39.146082] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-13T17:54:39.146143] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-13T17:54:39.147355] [DEBUG] [LOCAL ] CARS: Trimmed 55880 records to 39733 (keeping 200 days of data) [2025-10-13T17:54:39.375060] [DEBUG] [LOCAL ] CARS: Primary data saved (39733 records). [2025-10-13T17:54:39.375197] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-13T17:54:39.375275] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CARS took 42.4s. Estimated remaining: 4h 31m 29s. Rate: 7.3 symbols/min [2025-10-13T17:54:39.617914] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-13T17:54:40.176465] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-13T17:54:40.181859] [INFO ] [REMOTE ] CAT: Full fetch complete (76698 records). [2025-10-13T17:54:40.181971] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-13T17:54:40.641404] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-13T17:54:40.641518] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-13T17:54:40.642696] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-13T17:54:40.642784] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-13T17:54:40.654571] [DEBUG] [LOCAL ] CAT: Trimmed 76698 records to 52927 (keeping 200 days of data) [2025-10-13T17:54:40.673970] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T17:54:40.782925] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-13T17:54:41.050620] [DEBUG] [LOCAL ] CAT: Primary data saved (52927 records). [2025-10-13T17:54:41.050898] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-13T17:54:41.051087] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CAT took 42.7s. Estimated remaining: 4h 30m 48s. Rate: 7.3 symbols/min [2025-10-13T17:54:41.747574] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-13T17:54:41.758862] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-13T17:54:42.700505] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T17:54:42.715218] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-13T17:54:43.773847] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-13T17:54:43.785905] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-13T17:54:44.008052] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T17:54:44.019558] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-13T17:54:45.726721] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T17:54:45.738178] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-13T17:54:45.775952] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T17:54:45.788699] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-13T17:54:47.863711] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-13T17:54:47.875423] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-13T17:54:48.016216] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-13T17:54:48.027482] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-13T17:54:49.372327] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T17:54:49.383875] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-13T17:54:49.956949] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T17:54:49.968547] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-13T17:54:50.925150] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T17:54:50.936202] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-13T17:54:52.035693] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-13T17:54:52.041192] [INFO ] [REMOTE ] CAVA: Full fetch complete (77335 records). [2025-10-13T17:54:52.041339] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-13T17:54:52.432147] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-13T17:54:52.432492] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-13T17:54:52.433396] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-13T17:54:52.433563] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-13T17:54:52.435742] [DEBUG] [LOCAL ] CAVA: Trimmed 77335 records to 53568 (keeping 200 days of data) [2025-10-13T17:54:52.755474] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T17:54:52.772058] [INFO ] [REMOTE ] CB: Full fetch complete (72533 records). [2025-10-13T17:54:52.776724] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-13T17:54:52.787177] [DEBUG] [LOCAL ] CAVA: Primary data saved (53568 records). [2025-10-13T17:54:52.787275] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-13T17:54:52.787393] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAVA took 29.0s. Estimated remaining: 4h 30m 57s. Rate: 7.3 symbols/min [2025-10-13T17:54:53.178575] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-13T17:54:53.178691] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-13T17:54:53.179586] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-13T17:54:53.179672] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-13T17:54:53.182222] [DEBUG] [LOCAL ] CB: Trimmed 72533 records to 49917 (keeping 200 days of data) [2025-10-13T17:54:53.504871] [DEBUG] [LOCAL ] CB: Primary data saved (49917 records). [2025-10-13T17:54:53.505021] [INFO ] [MAIN ] CB: Full history saved. [2025-10-13T17:54:53.505135] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 26.3s. Estimated remaining: 4h 30m 12s. Rate: 7.3 symbols/min [2025-10-13T17:54:54.251685] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:54.168262] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:54.239309] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:54.257842] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:54.258436] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-13T17:54:54.260187] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-13T17:54:54.260425] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-13T17:54:54.260486] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-13T17:54:54.260532] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-13T17:54:54.260582] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-13T17:54:54.377627] [DEBUG] [LOCAL ] CBNA: Loaded 2931 existing records from primary storage. [2025-10-13T17:54:54.386090] [INFO ] [MAIN ] CBNA: Loaded 2931 existing records. [2025-10-13T17:54:54.392385] [DEBUG] [LOCAL ] CBAN: Loaded 10765 existing records from primary storage. [2025-10-13T17:54:54.413772] [DEBUG] [LOCAL ] CBL: Loaded 16498 existing records from primary storage. [2025-10-13T17:54:54.514470] [INFO ] [MAIN ] CBL: Loaded 16498 existing records. [2025-10-13T17:54:54.522414] [INFO ] [MAIN ] CBAN: Loaded 10765 existing records. [2025-10-13T17:54:54.983034] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:55.121731] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-13T17:54:55.177187] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-13T17:54:55.216045] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:55.209265] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:55.227436] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-13T17:54:55.230311] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-13T17:54:55.229779] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-13T17:54:55.246824] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-13T17:54:55.261804] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-13T17:54:55.292047] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-13T17:54:55.291946] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:55.306210] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-13T17:54:55.314495] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-13T17:54:55.363983] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-13T17:54:55.448242] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-13T17:54:55.453546] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-13T17:54:55.503338] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:54:55.592206] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-13T17:54:55.739137] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:54:55.815394] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-13T17:54:55.886086] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:54:55.977902] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-13T17:54:56.028691] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-13T17:54:56.043622] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-13T17:54:56.099703] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-13T17:54:56.194714] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 2.7s. Estimated remaining: 4h 29m 36s. Rate: 7.3 symbols/min [2025-10-13T17:54:56.276880] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:56.287611] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-13T17:54:56.236713] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:56.309928] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-13T17:54:56.565523] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:56.598889] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-13T17:54:56.622329] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:54:56.681792] [DEBUG] [LOCAL ] CBRE: Loaded 51146 existing records from primary storage. [2025-10-13T17:54:56.682201] [INFO ] [MAIN ] CBRE: Loaded 51146 existing records. [2025-10-13T17:54:56.886782] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:54:56.887113] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-13T17:54:56.887167] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-13T17:54:56.887695] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-13T17:54:56.887756] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-13T17:54:56.997776] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-13T17:54:57.000444] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-13T17:54:57.280759] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:54:57.281129] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-13T17:54:57.431171] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T17:54:57.434520] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-13T17:54:57.551412] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T17:54:57.557264] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-13T17:54:57.610169] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:54:57.612034] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-13T17:54:58.151990] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T17:54:58.153552] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-13T17:54:58.220145] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T17:54:58.223546] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-13T17:54:58.405144] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T17:54:58.589929] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-13T17:54:58.817919] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-13T17:54:59.051295] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-13T17:54:59.255986] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T17:54:59.291088] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-13T17:54:59.618003] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-13T17:55:00.417949] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-13T17:55:00.671076] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T17:55:00.957723] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T17:55:01.217979] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-13T17:55:02.017933] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-13T17:55:02.277768] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-13T17:55:02.817944] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-13T17:55:03.617922] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-13T17:55:03.625719] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T17:55:03.900166] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T17:55:04.418081] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-13T17:55:04.745910] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-13T17:55:04.893006] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T17:55:05.217938] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-13T17:55:06.017941] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-13T17:55:06.061486] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T17:55:06.817914] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-13T17:55:07.005725] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-13T17:55:07.617898] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-13T17:55:07.657553] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T17:55:08.417888] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-13T17:55:08.692611] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-13T17:55:09.151987] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T17:55:09.217907] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-13T17:55:10.017890] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-13T17:55:10.207055] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T17:55:10.643679] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T17:55:10.817904] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-13T17:55:11.273363] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T17:55:11.617935] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-13T17:55:12.417973] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-13T17:55:13.214985] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T17:55:13.218731] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-13T17:55:13.325774] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T17:55:13.870188] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T17:55:14.018035] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-13T17:55:14.817943] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-13T17:55:15.012157] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T17:55:15.373726] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T17:55:15.617938] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-13T17:55:16.417934] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-13T17:55:17.133421] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T17:55:17.217905] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-13T17:55:17.283948] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T17:55:18.017900] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-13T17:55:18.207485] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T17:55:18.209856] [INFO ] [REMOTE ] CBL: Full fetch complete (25269 records). [2025-10-13T17:55:18.209928] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-13T17:55:18.566194] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-13T17:55:18.566271] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-13T17:55:18.566702] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-13T17:55:18.566763] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-13T17:55:18.567661] [DEBUG] [LOCAL ] CBL: Trimmed 25269 records to 16249 (keeping 200 days of data) [2025-10-13T17:55:18.670184] [DEBUG] [LOCAL ] CBL: Primary data saved (16249 records). [2025-10-13T17:55:18.670323] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-13T17:55:18.670418] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBL took 25.1s. Estimated remaining: 4h 30m 38s. Rate: 7.3 symbols/min [2025-10-13T17:55:18.840426] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:18.836717] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-13T17:55:18.849159] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T17:55:18.882947] [DEBUG] [LOCAL ] CBT: Loaded 31283 existing records from primary storage. [2025-10-13T17:55:18.883219] [INFO ] [MAIN ] CBT: Loaded 31283 existing records. [2025-10-13T17:55:19.055394] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:55:19.055619] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-13T17:55:19.055695] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-13T17:55:19.056037] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-13T17:55:19.056094] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-13T17:55:19.330629] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T17:55:19.352212] [INFO ] [REMOTE ] CBNA: Full fetch complete (4440 records). [2025-10-13T17:55:19.380922] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-13T17:55:19.477339] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:19.624043] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-13T17:55:19.779009] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-13T17:55:19.779090] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-13T17:55:19.779250] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-13T17:55:19.779289] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-13T17:55:19.779711] [DEBUG] [LOCAL ] CBNA: Trimmed 4440 records to 2916 (keeping 200 days of data) [2025-10-13T17:55:19.798148] [DEBUG] [LOCAL ] CBNA: Primary data saved (2916 records). [2025-10-13T17:55:19.798235] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-13T17:55:19.798316] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBNA took 26.3s. Estimated remaining: 4h 29m 55s. Rate: 7.3 symbols/min [2025-10-13T17:55:19.975786] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:19.975949] [DEBUG] [LOCAL ] CBU: No existing data file found in primary storage. [2025-10-13T17:55:19.975987] [WARN ] [MAIN ] CBU: No existing data found, performing full refresh instead. [2025-10-13T17:55:19.976131] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-13T17:55:19.976210] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-13T17:55:19.976281] [DEBUG] [LOCAL ] CBU: No primary data file found to delete. [2025-10-13T17:55:19.976317] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-13T17:55:20.339051] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:20.417905] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-13T17:55:20.464254] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T17:55:20.465573] [INFO ] [REMOTE ] CBAN: Full fetch complete (16104 records). [2025-10-13T17:55:20.465638] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-13T17:55:20.839885] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-13T17:55:20.839965] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-13T17:55:20.840311] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-13T17:55:20.840350] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-13T17:55:20.840862] [DEBUG] [LOCAL ] CBAN: Trimmed 16104 records to 10523 (keeping 200 days of data) [2025-10-13T17:55:20.903512] [DEBUG] [LOCAL ] CBAN: Primary data saved (10523 records). [2025-10-13T17:55:20.903673] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-13T17:55:20.903774] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBAN took 27.4s. Estimated remaining: 4h 29m 12s. Rate: 7.3 symbols/min [2025-10-13T17:55:21.066662] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:21.066851] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-13T17:55:21.066889] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-13T17:55:21.066999] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-13T17:55:21.067039] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-13T17:55:21.067078] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-13T17:55:21.067109] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-13T17:55:21.243564] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-13T17:55:21.428177] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:21.728579] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T17:55:22.017932] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-13T17:55:22.817942] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-13T17:55:23.134520] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T17:55:23.395548] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T17:55:23.617907] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-13T17:55:23.634965] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-13T17:55:24.417924] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-13T17:55:25.217985] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-13T17:55:25.447044] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:55:25.447387] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-13T17:55:25.447491] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:55:25.447585] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-13T17:55:25.447695] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:55:25.447787] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-13T17:55:25.447866] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-13T17:55:25.447905] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-13T17:55:25.447946] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-13T17:55:25.448183] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBX took 4.5s. Estimated remaining: 4h 28m 46s. Rate: 7.3 symbols/min [2025-10-13T17:55:25.607381] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T17:55:25.645379] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:25.680033] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-13T17:55:25.724028] [DEBUG] [LOCAL ] CBZ: Loaded 34491 existing records from primary storage. [2025-10-13T17:55:25.724422] [INFO ] [MAIN ] CBZ: Loaded 34491 existing records. [2025-10-13T17:55:25.908100] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:55:25.908402] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-13T17:55:25.908473] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-13T17:55:25.908989] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-13T17:55:25.909046] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-13T17:55:26.023117] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-13T17:55:26.280948] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:26.817947] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-13T17:55:27.617943] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-13T17:55:27.863027] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T17:55:28.118481] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T17:55:28.417949] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-13T17:55:28.619267] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T17:55:29.218061] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-13T17:55:29.961258] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T17:55:30.017947] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-13T17:55:30.411618] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T17:55:30.817934] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-13T17:55:30.958343] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T17:55:31.617940] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-13T17:55:32.131297] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T17:55:32.418006] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-13T17:55:33.129965] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T17:55:33.217922] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-13T17:55:33.619404] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T17:55:34.017947] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-13T17:55:34.817985] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-13T17:55:34.847465] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T17:55:35.348683] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T17:55:35.617890] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-13T17:55:35.987481] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T17:55:36.417981] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-13T17:55:36.840224] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-13T17:55:37.217980] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-13T17:55:37.584279] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T17:55:38.018016] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-13T17:55:38.202267] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T17:55:38.817903] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-13T17:55:39.053364] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T17:55:39.618011] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-13T17:55:40.170180] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T17:55:40.417919] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-13T17:55:41.014205] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T17:55:41.217927] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-13T17:55:41.743270] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T17:55:42.017934] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-13T17:55:42.817909] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-13T17:55:42.877182] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T17:55:42.882208] [INFO ] [REMOTE ] CBRE: Full fetch complete (73720 records). [2025-10-13T17:55:42.882319] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-13T17:55:43.281124] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-13T17:55:43.281215] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-13T17:55:43.282055] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-13T17:55:43.282118] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-13T17:55:43.283603] [DEBUG] [LOCAL ] CBRE: Trimmed 73720 records to 50384 (keeping 200 days of data) [2025-10-13T17:55:43.523520] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T17:55:43.619834] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-13T17:55:43.626038] [DEBUG] [LOCAL ] CBRE: Primary data saved (50384 records). [2025-10-13T17:55:43.627309] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-13T17:55:43.627413] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBRE took 47.4s. Estimated remaining: 4h 29m 26s. Rate: 7.3 symbols/min [2025-10-13T17:55:43.810236] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:43.862309] [DEBUG] [LOCAL ] CC: Loaded 53769 existing records from primary storage. [2025-10-13T17:55:43.862622] [INFO ] [MAIN ] CC: Loaded 53769 existing records. [2025-10-13T17:55:44.050154] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:55:44.050745] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-13T17:55:44.050882] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-13T17:55:44.051630] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-13T17:55:44.051738] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-13T17:55:44.379056] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T17:55:44.426539] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-13T17:55:44.452107] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:45.013337] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T17:55:45.217888] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-13T17:55:45.541221] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T17:55:46.017931] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-13T17:55:46.817934] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-13T17:55:47.033125] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T17:55:47.307505] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T17:55:47.617922] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-13T17:55:47.840433] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T17:55:47.844344] [INFO ] [REMOTE ] CBZ: Full fetch complete (45755 records). [2025-10-13T17:55:47.844455] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-13T17:55:48.257189] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-13T17:55:48.257281] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-13T17:55:48.257942] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-13T17:55:48.258038] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-13T17:55:48.259257] [DEBUG] [LOCAL ] CBZ: Trimmed 45755 records to 34102 (keeping 200 days of data) [2025-10-13T17:55:48.419027] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-13T17:55:48.469951] [DEBUG] [LOCAL ] CBZ: Primary data saved (34102 records). [2025-10-13T17:55:48.470103] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-13T17:55:48.470185] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBZ took 23.0s. Estimated remaining: 4h 29m 1s. Rate: 7.3 symbols/min [2025-10-13T17:55:48.644744] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:48.697529] [DEBUG] [LOCAL ] CCI: Loaded 53905 existing records from primary storage. [2025-10-13T17:55:48.697917] [INFO ] [MAIN ] CCI: Loaded 53905 existing records. [2025-10-13T17:55:48.887430] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:55:48.887695] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-13T17:55:48.887752] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-13T17:55:48.888164] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-13T17:55:48.888223] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-13T17:55:49.220241] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-13T17:55:49.242211] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T17:55:49.296533] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:50.018089] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-13T17:55:50.026207] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T17:55:50.105257] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T17:55:50.818026] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-13T17:55:51.617908] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-13T17:55:51.897627] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T17:55:51.994332] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T17:55:52.417977] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-13T17:55:53.228063] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-13T17:55:53.233422] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:55:53.524596] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T17:55:54.018040] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-13T17:55:54.817979] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-13T17:55:55.151109] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T17:55:55.154816] [INFO ] [REMOTE ] CBU: Full fetch complete (32386 records). [2025-10-13T17:55:55.154999] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-13T17:55:55.501029] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-13T17:55:55.622409] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-13T17:55:55.622837] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-13T17:55:55.622930] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-13T17:55:55.623787] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-13T17:55:55.623884] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-13T17:55:55.625886] [DEBUG] [LOCAL ] CBU: Trimmed 32386 records to 22651 (keeping 200 days of data) [2025-10-13T17:55:55.786461] [DEBUG] [LOCAL ] CBU: Primary data saved (22651 records). [2025-10-13T17:55:55.786602] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-13T17:55:55.786696] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CBU took 36.0s. Estimated remaining: 4h 28m 49s. Rate: 7.3 symbols/min [2025-10-13T17:55:55.979970] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:55:55.980149] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-13T17:55:55.980190] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-13T17:55:55.980303] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-13T17:55:55.980344] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-13T17:55:55.980395] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-13T17:55:55.980454] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-13T17:55:56.360660] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T17:55:56.397548] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:55:56.417882] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-13T17:55:57.218022] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-13T17:55:57.398764] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T17:55:57.648296] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T17:55:57.665606] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-13T17:55:58.018012] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-13T17:55:58.817948] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-13T17:55:59.617909] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-13T17:55:59.712698] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T17:56:00.051918] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T17:56:00.417900] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-13T17:56:00.947697] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-13T17:56:01.217912] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-13T17:56:01.901147] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T17:56:01.905324] [INFO ] [REMOTE ] CBT: Full fetch complete (45525 records). [2025-10-13T17:56:01.905490] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-13T17:56:02.023173] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-13T17:56:02.317477] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-13T17:56:02.317566] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-13T17:56:02.318543] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-13T17:56:02.318638] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-13T17:56:02.320185] [DEBUG] [LOCAL ] CBT: Trimmed 45525 records to 30960 (keeping 200 days of data) [2025-10-13T17:56:02.515918] [DEBUG] [LOCAL ] CBT: Primary data saved (30960 records). [2025-10-13T17:56:02.516069] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-13T17:56:02.516151] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CBT took 43.8s. Estimated remaining: 4h 28m 34s. Rate: 7.3 symbols/min [2025-10-13T17:56:02.686458] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:02.701979] [DEBUG] [LOCAL ] CCIF: Loaded 15808 existing records from primary storage. [2025-10-13T17:56:02.702192] [INFO ] [MAIN ] CCIF: Loaded 15808 existing records. [2025-10-13T17:56:02.821245] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-13T17:56:02.888619] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:02.889734] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-13T17:56:02.889845] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-13T17:56:02.890190] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-13T17:56:02.890366] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-13T17:56:03.226794] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T17:56:03.318552] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:03.321634] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T17:56:03.617993] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-13T17:56:03.981282] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:56:04.417944] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-13T17:56:05.217983] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-13T17:56:05.311848] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T17:56:05.412927] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T17:56:05.483530] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-13T17:56:06.017920] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-13T17:56:06.776699] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T17:56:06.817879] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-13T17:56:07.617900] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-13T17:56:07.654889] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T17:56:08.417912] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-13T17:56:09.217918] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-13T17:56:09.363752] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T17:56:09.364946] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T17:56:10.017931] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-13T17:56:10.788987] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T17:56:10.817894] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-13T17:56:11.034770] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T17:56:11.617914] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-13T17:56:11.658511] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T17:56:12.417927] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-13T17:56:13.218021] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-13T17:56:13.237837] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T17:56:13.656826] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T17:56:14.017981] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-13T17:56:14.817900] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-13T17:56:15.068186] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:56:15.617915] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-13T17:56:15.742460] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T17:56:15.914151] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T17:56:16.103065] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T17:56:16.418051] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-13T17:56:16.892630] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T17:56:17.217923] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-13T17:56:18.017944] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-13T17:56:18.817987] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-13T17:56:18.912753] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T17:56:19.618026] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-13T17:56:19.844414] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T17:56:19.878226] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T17:56:20.417894] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-13T17:56:21.217886] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-13T17:56:21.385544] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T17:56:21.499389] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T17:56:21.505017] [INFO ] [REMOTE ] CCI: Full fetch complete (76977 records). [2025-10-13T17:56:21.505151] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-13T17:56:21.900077] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-13T17:56:21.900169] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-13T17:56:21.901033] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-13T17:56:21.901143] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-13T17:56:21.902678] [DEBUG] [LOCAL ] CCI: Trimmed 76977 records to 53123 (keeping 200 days of data) [2025-10-13T17:56:22.018189] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-13T17:56:22.235560] [DEBUG] [LOCAL ] CCI: Primary data saved (53123 records). [2025-10-13T17:56:22.235723] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-13T17:56:22.235836] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CCI took 33.8s. Estimated remaining: 4h 29m 20s. Rate: 7.3 symbols/min [2025-10-13T17:56:22.393004] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-13T17:56:22.415938] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:22.463985] [DEBUG] [LOCAL ] CCJ: Loaded 54455 existing records from primary storage. [2025-10-13T17:56:22.464325] [INFO ] [MAIN ] CCJ: Loaded 54455 existing records. [2025-10-13T17:56:22.652959] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:22.653222] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-13T17:56:22.653270] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-13T17:56:22.653619] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-13T17:56:22.653711] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-13T17:56:22.821289] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-13T17:56:23.042191] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:23.092469] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T17:56:23.237198] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-13T17:56:23.617942] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-13T17:56:24.417945] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-13T17:56:24.896571] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T17:56:25.217991] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-13T17:56:25.727509] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T17:56:26.017925] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-13T17:56:26.817933] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-13T17:56:27.109469] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T17:56:27.618005] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-13T17:56:28.053014] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-13T17:56:28.079992] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T17:56:28.082079] [INFO ] [REMOTE ] CCIF: Full fetch complete (21876 records). [2025-10-13T17:56:28.082157] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-13T17:56:28.167895] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-13T17:56:28.423230] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-13T17:56:28.465955] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-13T17:56:28.466032] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-13T17:56:28.466458] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-13T17:56:28.466497] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-13T17:56:28.467183] [DEBUG] [LOCAL ] CCIF: Trimmed 21876 records to 15647 (keeping 200 days of data) [2025-10-13T17:56:28.558547] [DEBUG] [LOCAL ] CCIF: Primary data saved (15647 records). [2025-10-13T17:56:28.558746] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-13T17:56:28.558850] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCIF took 26.0s. Estimated remaining: 4h 29m 3s. Rate: 7.3 symbols/min [2025-10-13T17:56:28.731333] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:28.731532] [DEBUG] [LOCAL ] CCK: No existing data file found in primary storage. [2025-10-13T17:56:28.731570] [WARN ] [MAIN ] CCK: No existing data found, performing full refresh instead. [2025-10-13T17:56:28.731707] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-13T17:56:28.731760] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-13T17:56:28.731803] [DEBUG] [LOCAL ] CCK: No primary data file found to delete. [2025-10-13T17:56:28.731836] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-13T17:56:29.092558] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:29.217990] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-13T17:56:30.018151] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-13T17:56:30.369128] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-13T17:56:30.579340] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T17:56:30.580165] [INFO ] [REMOTE ] CCIA: Full fetch complete (2164 records). [2025-10-13T17:56:30.580234] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-13T17:56:30.754553] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T17:56:30.754773] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:56:30.754823] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:56:30.754862] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-13T17:56:30.754918] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-13T17:56:30.754955] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-13T17:56:30.754994] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-13T17:56:30.755048] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCIA took 35.0s. Estimated remaining: 4h 28m 26s. Rate: 7.3 symbols/min [2025-10-13T17:56:30.827543] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-13T17:56:30.927083] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:30.977204] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-10-13T17:56:30.977511] [INFO ] [MAIN ] CCL: Loaded 54580 existing records. [2025-10-13T17:56:31.153462] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:31.153709] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-13T17:56:31.158952] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-13T17:56:31.166729] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-13T17:56:31.167471] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-13T17:56:31.201117] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-13T17:56:31.275363] [INFO ] [REMOTE ] CC: Full fetch complete (75768 records). [2025-10-13T17:56:31.278220] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-13T17:56:31.636539] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-13T17:56:31.770728] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:31.924030] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-13T17:56:31.924109] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-13T17:56:31.924920] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-13T17:56:31.924982] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-13T17:56:31.926429] [DEBUG] [LOCAL ] CC: Trimmed 75768 records to 52999 (keeping 200 days of data) [2025-10-13T17:56:32.238669] [DEBUG] [LOCAL ] CC: Primary data saved (52999 records). [2025-10-13T17:56:32.238806] [INFO ] [MAIN ] CC: Full history saved. [2025-10-13T17:56:32.239569] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CC took 48.6s. Estimated remaining: 4h 27m 46s. Rate: 7.3 symbols/min [2025-10-13T17:56:32.407936] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:32.418013] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-13T17:56:32.458077] [DEBUG] [LOCAL ] CCO: Loaded 48697 existing records from primary storage. [2025-10-13T17:56:32.458396] [INFO ] [MAIN ] CCO: Loaded 48697 existing records. [2025-10-13T17:56:32.641834] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:32.642254] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-13T17:56:32.642375] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-13T17:56:32.642855] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-13T17:56:32.642912] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-13T17:56:33.035625] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-13T17:56:33.033826] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:33.217894] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-13T17:56:33.489621] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T17:56:34.017921] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-13T17:56:34.826388] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-13T17:56:34.831855] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-13T17:56:35.063568] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T17:56:35.593313] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T17:56:35.617933] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-13T17:56:36.190583] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T17:56:36.417937] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-13T17:56:37.217926] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-13T17:56:37.927462] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T17:56:37.926429] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-13T17:56:38.017890] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-13T17:56:38.817948] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-13T17:56:39.139386] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T17:56:39.178892] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T17:56:39.617929] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-13T17:56:40.417922] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-13T17:56:40.836906] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-13T17:56:41.217998] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-13T17:56:41.673445] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-13T17:56:42.017942] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-13T17:56:42.131183] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T17:56:42.817931] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-13T17:56:43.623745] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-13T17:56:43.630513] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-13T17:56:44.200099] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T17:56:44.303234] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-13T17:56:44.417895] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-13T17:56:45.217888] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-13T17:56:45.391260] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T17:56:46.017906] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-13T17:56:46.509770] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-13T17:56:46.775863] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T17:56:46.817878] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-13T17:56:47.617890] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-13T17:56:47.662878] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T17:56:48.177737] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T17:56:48.417908] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-13T17:56:49.217926] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-13T17:56:50.006585] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-13T17:56:50.017943] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-13T17:56:50.088508] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T17:56:50.817936] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-13T17:56:51.581807] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-13T17:56:51.617897] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-13T17:56:51.968030] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T17:56:51.973451] [INFO ] [REMOTE ] CCJ: Full fetch complete (77687 records). [2025-10-13T17:56:51.973601] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-13T17:56:52.367115] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-13T17:56:52.367502] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-13T17:56:52.368416] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-13T17:56:52.368482] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-13T17:56:52.369953] [DEBUG] [LOCAL ] CCJ: Trimmed 77687 records to 53684 (keeping 200 days of data) [2025-10-13T17:56:52.418630] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-13T17:56:52.609496] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T17:56:52.729058] [DEBUG] [LOCAL ] CCJ: Primary data saved (53684 records). [2025-10-13T17:56:52.729200] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-13T17:56:52.729320] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCJ took 30.5s. Estimated remaining: 4h 28m 36s. Rate: 7.3 symbols/min [2025-10-13T17:56:52.895707] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:52.905223] [DEBUG] [LOCAL ] CCRD: Loaded 9338 existing records from primary storage. [2025-10-13T17:56:52.905406] [INFO ] [MAIN ] CCRD: Loaded 9338 existing records. [2025-10-13T17:56:53.079092] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:53.079346] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-13T17:56:53.079394] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-13T17:56:53.079780] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-13T17:56:53.079890] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-13T17:56:53.221791] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-13T17:56:53.440428] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:56:53.944045] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-13T17:56:54.017909] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-13T17:56:54.106493] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T17:56:54.817905] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-13T17:56:54.922084] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T17:56:55.617980] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-13T17:56:55.756301] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T17:56:56.205310] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-13T17:56:56.418053] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-13T17:56:57.133377] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T17:56:57.152101] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-13T17:56:57.217896] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-13T17:56:58.018002] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-13T17:56:58.675956] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T17:56:58.762799] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T17:56:58.768362] [INFO ] [REMOTE ] CCO: Full fetch complete (66830 records). [2025-10-13T17:56:58.768515] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-13T17:56:58.823639] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-13T17:56:59.164284] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-13T17:56:59.164371] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-13T17:56:59.165252] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-13T17:56:59.165317] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-13T17:56:59.166840] [DEBUG] [LOCAL ] CCO: Trimmed 66830 records to 48214 (keeping 200 days of data) [2025-10-13T17:56:59.451615] [DEBUG] [LOCAL ] CCO: Primary data saved (48214 records). [2025-10-13T17:56:59.451854] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-13T17:56:59.452946] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCO took 27.2s. Estimated remaining: 4h 28m 20s. Rate: 7.3 symbols/min [2025-10-13T17:56:59.619522] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-13T17:56:59.641371] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:56:59.684674] [DEBUG] [LOCAL ] CCS: Loaded 30681 existing records from primary storage. [2025-10-13T17:56:59.685074] [INFO ] [MAIN ] CCS: Loaded 30681 existing records. [2025-10-13T17:56:59.871351] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:56:59.871787] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-13T17:56:59.871844] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-13T17:56:59.872699] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-13T17:56:59.872761] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-13T17:57:00.238367] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:00.244855] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T17:57:00.418006] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-13T17:57:00.955052] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T17:57:01.217935] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-13T17:57:01.382535] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-13T17:57:02.017941] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-13T17:57:02.687200] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T17:57:02.817901] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-13T17:57:03.617992] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-13T17:57:04.417998] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-13T17:57:04.480781] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-13T17:57:04.562006] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T17:57:04.823883] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-13T17:57:04.892082] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T17:57:05.217927] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-13T17:57:06.018028] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-13T17:57:06.605289] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T17:57:06.817916] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-13T17:57:06.971855] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T17:57:07.617995] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-13T17:57:08.012188] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T17:57:08.417929] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-13T17:57:09.217901] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-13T17:57:09.281428] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T17:57:09.583788] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T17:57:10.018015] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-13T17:57:10.456623] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T17:57:10.818026] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-13T17:57:11.289495] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T17:57:11.617929] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-13T17:57:12.417925] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-13T17:57:12.923191] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-13T17:57:12.928939] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-13T17:57:12.929100] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-13T17:57:13.229271] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-13T17:57:13.331204] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-13T17:57:13.331333] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-13T17:57:13.332254] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-13T17:57:13.332330] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-13T17:57:13.334277] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-10-13T17:57:13.363895] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T17:57:13.696861] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-13T17:57:13.697100] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-13T17:57:13.697206] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCL took 42.9s. Estimated remaining: 4h 28m 40s. Rate: 7.3 symbols/min [2025-10-13T17:57:13.882609] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:13.904230] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T17:57:13.934136] [DEBUG] [LOCAL ] CCU: Loaded 23079 existing records from primary storage. [2025-10-13T17:57:13.934407] [INFO ] [MAIN ] CCU: Loaded 23079 existing records. [2025-10-13T17:57:14.023067] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-13T17:57:14.114046] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:57:14.114452] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-13T17:57:14.114514] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-13T17:57:14.114734] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-13T17:57:14.114790] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-13T17:57:14.213845] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T17:57:14.483243] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:14.817900] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-13T17:57:15.617918] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-13T17:57:15.671950] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T17:57:15.679831] [INFO ] [REMOTE ] CCK: Full fetch complete (67547 records). [2025-10-13T17:57:15.679946] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-13T17:57:16.093225] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-13T17:57:16.095095] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-13T17:57:16.096065] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-13T17:57:16.096705] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-13T17:57:16.097263] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T17:57:16.103674] [DEBUG] [LOCAL ] CCK: Trimmed 67547 records to 46359 (keeping 200 days of data) [2025-10-13T17:57:16.398609] [DEBUG] [LOCAL ] CCK: Primary data saved (46359 records). [2025-10-13T17:57:16.398837] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-13T17:57:16.399048] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCK took 47.8s. Estimated remaining: 4h 28m 6s. Rate: 7.3 symbols/min [2025-10-13T17:57:16.426840] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T17:57:16.426488] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-13T17:57:16.582889] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:16.583094] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-13T17:57:16.583132] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-13T17:57:16.583252] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-13T17:57:16.583314] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-13T17:57:16.583356] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-13T17:57:16.583386] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-13T17:57:16.927732] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:17.217929] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-13T17:57:17.861225] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T17:57:18.017929] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-13T17:57:18.118002] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T17:57:18.120852] [INFO ] [REMOTE ] CCRD: Full fetch complete (11833 records). [2025-10-13T17:57:18.120950] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-13T17:57:18.504252] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-13T17:57:18.504350] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-13T17:57:18.504734] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-13T17:57:18.504805] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-13T17:57:18.505428] [DEBUG] [LOCAL ] CCRD: Trimmed 11833 records to 9386 (keeping 200 days of data) [2025-10-13T17:57:18.572474] [DEBUG] [LOCAL ] CCRD: Primary data saved (9386 records). [2025-10-13T17:57:18.572624] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-13T17:57:18.572741] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCRD took 25.8s. Estimated remaining: 4h 27m 30s. Rate: 7.3 symbols/min [2025-10-13T17:57:18.742599] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:18.793856] [DEBUG] [LOCAL ] CDE: Loaded 54422 existing records from primary storage. [2025-10-13T17:57:18.794193] [INFO ] [MAIN ] CDE: Loaded 54422 existing records. [2025-10-13T17:57:18.824345] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-13T17:57:18.972237] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:57:18.972457] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-13T17:57:18.972503] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-13T17:57:18.973995] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-13T17:57:18.974053] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-13T17:57:19.325733] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:19.343952] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T17:57:19.617908] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-13T17:57:19.836973] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T17:57:20.417927] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-13T17:57:20.938029] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T17:57:21.217941] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-13T17:57:21.611363] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-13T17:57:22.017900] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-13T17:57:22.258989] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T17:57:22.654450] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T17:57:22.817931] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-13T17:57:23.617897] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-13T17:57:24.054313] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T17:57:24.417929] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-13T17:57:24.666814] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-13T17:57:25.217890] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-13T17:57:25.407088] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T17:57:26.017925] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-13T17:57:26.529185] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T17:57:26.817931] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-13T17:57:27.617903] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-13T17:57:27.691564] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T17:57:28.161909] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T17:57:28.418008] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-13T17:57:28.713416] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T17:57:29.217928] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-13T17:57:29.488438] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-13T17:57:30.017933] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-13T17:57:30.347611] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T17:57:30.817944] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-13T17:57:31.136597] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T17:57:31.618011] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-13T17:57:32.417924] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-13T17:57:32.794436] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-13T17:57:32.923632] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-13T17:57:32.943591] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T17:57:32.946469] [INFO ] [REMOTE ] CCS: Full fetch complete (44631 records). [2025-10-13T17:57:32.946695] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-13T17:57:32.947316] [FATAL] [VALIDATOR ] CCS: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:57:32.947414] [FATAL] [MAIN ] CCS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:57:32.947486] [WARN ] [MAIN ] CCS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:57:32.947572] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-13T17:57:32.947676] [DEBUG] [LOCAL ] CCS: No primary data file found to delete. [2025-10-13T17:57:32.947747] [INFO ] [LOCAL ] CCS: Starting deletion of derivative data. [2025-10-13T17:57:32.947981] [DEBUG] [LOCAL ] CCS: Deleted derivative data file. [2025-10-13T17:57:32.948801] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCS took 33.5s. Estimated remaining: 4h 27m 50s. Rate: 7.3 symbols/min [2025-10-13T17:57:33.116451] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:33.129317] [DEBUG] [LOCAL ] CDLR: Loaded 10107 existing records from primary storage. [2025-10-13T17:57:33.129542] [INFO ] [MAIN ] CDLR: Loaded 10107 existing records. [2025-10-13T17:57:33.224107] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-13T17:57:33.305452] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:57:33.305728] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-13T17:57:33.305781] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-13T17:57:33.305921] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-13T17:57:33.305958] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-13T17:57:33.653220] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:34.017987] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-13T17:57:34.318816] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T17:57:34.817917] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-13T17:57:34.852263] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T17:57:35.617921] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-13T17:57:36.224735] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:57:36.417890] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-13T17:57:36.984172] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-13T17:57:37.217932] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-13T17:57:37.390847] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T17:57:37.544280] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-13T17:57:38.017985] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-13T17:57:38.786625] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T17:57:38.817877] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-13T17:57:39.617941] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-13T17:57:39.872877] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-13T17:57:39.907194] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T17:57:40.417926] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-13T17:57:41.217984] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-13T17:57:41.467072] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T17:57:41.469383] [INFO ] [REMOTE ] CCU: Full fetch complete (32361 records). [2025-10-13T17:57:41.469474] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-13T17:57:41.842917] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-13T17:57:41.843038] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-13T17:57:41.843533] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-13T17:57:41.843595] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-13T17:57:41.844317] [DEBUG] [LOCAL ] CCU: Trimmed 32361 records to 22590 (keeping 200 days of data) [2025-10-13T17:57:41.989764] [DEBUG] [LOCAL ] CCU: Primary data saved (22590 records). [2025-10-13T17:57:41.989967] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-13T17:57:41.990112] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CCU took 28.3s. Estimated remaining: 4h 27m 46s. Rate: 7.3 symbols/min [2025-10-13T17:57:42.023045] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-13T17:57:42.171501] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:42.211844] [DEBUG] [LOCAL ] CDP: Loaded 43086 existing records from primary storage. [2025-10-13T17:57:42.212211] [INFO ] [MAIN ] CDP: Loaded 43086 existing records. [2025-10-13T17:57:42.361765] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:57:42.394052] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-13T17:57:42.401884] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:57:42.401795] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:57:42.402247] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-13T17:57:42.402118] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-13T17:57:42.402453] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-13T17:57:42.402389] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:57:42.402636] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-13T17:57:42.402773] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-13T17:57:42.402828] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-13T17:57:42.402878] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-13T17:57:42.402931] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CCZ took 26.0s. Estimated remaining: 4h 27m 1s. Rate: 7.3 symbols/min [2025-10-13T17:57:42.408428] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-13T17:57:42.408539] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-13T17:57:42.822169] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-13T17:57:42.822048] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:57:43.003258] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:43.013431] [DEBUG] [LOCAL ] CDRE: Loaded 25069 existing records from primary storage. [2025-10-13T17:57:43.013724] [INFO ] [MAIN ] CDRE: Loaded 25069 existing records. [2025-10-13T17:57:43.193717] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:57:43.194074] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-13T17:57:43.194152] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-13T17:57:43.194525] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-13T17:57:43.194583] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-13T17:57:43.474248] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-13T17:57:43.525406] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T17:57:43.629124] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-13T17:57:43.634182] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:57:44.417916] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-13T17:57:45.217911] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-13T17:57:45.295517] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T17:57:46.017907] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-13T17:57:46.079159] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T17:57:46.406699] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T17:57:46.817923] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-13T17:57:47.518149] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T17:57:47.617949] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-13T17:57:47.954460] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T17:57:48.417929] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-13T17:57:49.116500] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T17:57:49.217886] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-13T17:57:49.343693] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T17:57:50.017923] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-13T17:57:50.817934] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-13T17:57:50.872001] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T17:57:51.109927] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-13T17:57:51.617905] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-13T17:57:51.961968] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T17:57:52.351848] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T17:57:52.417888] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-13T17:57:53.180463] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T17:57:53.217942] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-13T17:57:54.017897] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-13T17:57:54.035421] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T17:57:54.818018] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-13T17:57:55.121320] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T17:57:55.617971] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-13T17:57:56.417910] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-13T17:57:56.631074] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T17:57:56.866172] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T17:57:57.217904] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-13T17:57:57.243314] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T17:57:58.017931] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-13T17:57:58.786341] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T17:57:58.829575] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-13T17:57:58.834719] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T17:57:59.617993] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-13T17:57:59.896757] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T17:58:00.384119] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T17:58:00.417885] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-13T17:58:01.207004] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T17:58:01.208962] [INFO ] [REMOTE ] CDLR: Full fetch complete (13698 records). [2025-10-13T17:58:01.209039] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-13T17:58:01.223090] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-13T17:58:01.568570] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-13T17:58:01.568673] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-13T17:58:01.568996] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-13T17:58:01.569037] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-13T17:58:01.569570] [DEBUG] [LOCAL ] CDLR: Trimmed 13698 records to 9992 (keeping 200 days of data) [2025-10-13T17:58:01.629318] [DEBUG] [LOCAL ] CDLR: Primary data saved (9992 records). [2025-10-13T17:58:01.629456] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-13T17:58:01.629536] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDLR took 28.7s. Estimated remaining: 4h 27m 44s. Rate: 7.3 symbols/min [2025-10-13T17:58:01.794814] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:01.855769] [DEBUG] [LOCAL ] CE: Loaded 52193 existing records from primary storage. [2025-10-13T17:58:01.856100] [INFO ] [MAIN ] CE: Loaded 52193 existing records. [2025-10-13T17:58:02.018029] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-13T17:58:02.038395] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:02.039780] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-13T17:58:02.039833] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-13T17:58:02.040886] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-13T17:58:02.040947] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-13T17:58:02.405806] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T17:58:02.424441] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:02.817984] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-13T17:58:03.617937] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-13T17:58:04.007878] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T17:58:04.127843] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-13T17:58:04.417927] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-13T17:58:04.779705] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:58:05.217895] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-13T17:58:05.379934] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T17:58:06.017939] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-13T17:58:06.817940] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-13T17:58:07.253013] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T17:58:07.256235] [INFO ] [REMOTE ] CDRE: Full fetch complete (35111 records). [2025-10-13T17:58:07.256341] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-13T17:58:07.623089] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-13T17:58:07.669915] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-13T17:58:07.670018] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-13T17:58:07.670790] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-13T17:58:07.671137] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-13T17:58:07.672810] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-13T17:58:07.685000] [DEBUG] [LOCAL ] CDRE: Trimmed 35111 records to 24847 (keeping 200 days of data) [2025-10-13T17:58:07.835010] [DEBUG] [LOCAL ] CDRE: Primary data saved (24847 records). [2025-10-13T17:58:07.835149] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-13T17:58:07.835234] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CDRE took 25.4s. Estimated remaining: 4h 27m 26s. Rate: 7.3 symbols/min [2025-10-13T17:58:08.006921] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:08.013758] [DEBUG] [LOCAL ] CEE: Loaded 5690 existing records from primary storage. [2025-10-13T17:58:08.013907] [INFO ] [MAIN ] CEE: Loaded 5690 existing records. [2025-10-13T17:58:08.194007] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:08.194283] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-13T17:58:08.194360] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-13T17:58:08.194680] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-13T17:58:08.194797] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-13T17:58:08.449328] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-13T17:58:08.465524] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:58:08.585493] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:09.217920] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-13T17:58:09.654837] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T17:58:10.018020] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-13T17:58:10.424953] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-13T17:58:10.430472] [INFO ] [REMOTE ] CDE: Full fetch complete (77599 records). [2025-10-13T17:58:10.430600] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-13T17:58:10.822506] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-13T17:58:10.868431] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T17:58:10.866441] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-13T17:58:10.877452] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-13T17:58:10.878490] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-13T17:58:10.878580] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-13T17:58:10.880560] [DEBUG] [LOCAL ] CDE: Trimmed 77599 records to 53643 (keeping 200 days of data) [2025-10-13T17:58:11.191861] [DEBUG] [LOCAL ] CDE: Primary data saved (53643 records). [2025-10-13T17:58:11.191999] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-13T17:58:11.192079] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDE took 52.6s. Estimated remaining: 4h 26m 55s. Rate: 7.3 symbols/min [2025-10-13T17:58:11.362406] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:11.387599] [DEBUG] [LOCAL ] CEPU: Loaded 26570 existing records from primary storage. [2025-10-13T17:58:11.388001] [INFO ] [MAIN ] CEPU: Loaded 26570 existing records. [2025-10-13T17:58:11.506086] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T17:58:11.577431] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:11.577786] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-13T17:58:11.577896] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-13T17:58:11.578727] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-13T17:58:11.578787] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-13T17:58:11.620929] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-13T17:58:11.963311] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:11.965765] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-13T17:58:12.417897] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-13T17:58:13.227430] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-13T17:58:13.232545] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T17:58:13.979790] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T17:58:14.017890] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-13T17:58:14.616786] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T17:58:14.817931] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-13T17:58:15.430918] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T17:58:15.617908] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-13T17:58:16.032833] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T17:58:16.417921] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-13T17:58:17.137888] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T17:58:17.143041] [INFO ] [REMOTE ] CDP: Full fetch complete (61720 records). [2025-10-13T17:58:17.143211] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-13T17:58:17.223069] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-13T17:58:17.541631] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-13T17:58:17.541740] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-13T17:58:17.542427] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-13T17:58:17.542466] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-13T17:58:17.543703] [DEBUG] [LOCAL ] CDP: Trimmed 61720 records to 42558 (keeping 200 days of data) [2025-10-13T17:58:17.828377] [DEBUG] [LOCAL ] CDP: Primary data saved (42558 records). [2025-10-13T17:58:17.828519] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-13T17:58:17.828607] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CDP took 35.8s. Estimated remaining: 4h 26m 40s. Rate: 7.3 symbols/min [2025-10-13T17:58:18.030560] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-13T17:58:18.035195] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:18.091342] [DEBUG] [LOCAL ] CF: Loaded 52873 existing records from primary storage. [2025-10-13T17:58:18.091833] [INFO ] [MAIN ] CF: Loaded 52873 existing records. [2025-10-13T17:58:18.287795] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:18.288317] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-13T17:58:18.288395] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-13T17:58:18.300692] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-13T17:58:18.318917] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-13T17:58:18.378784] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T17:58:18.707927] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:18.726855] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T17:58:18.742454] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T17:58:18.817904] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-13T17:58:19.617994] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-13T17:58:20.417989] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-13T17:58:20.715407] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T17:58:21.217910] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-13T17:58:21.497832] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T17:58:21.523279] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T17:58:22.017929] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-13T17:58:22.825537] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-13T17:58:22.844417] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T17:58:23.052553] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T17:58:23.617979] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-13T17:58:23.758620] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T17:58:24.418008] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-13T17:58:24.783013] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T17:58:25.217977] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-13T17:58:25.993330] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T17:58:26.029700] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-13T17:58:26.035664] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:58:26.817905] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-13T17:58:27.085716] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T17:58:27.617939] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-13T17:58:28.424150] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-13T17:58:28.430230] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T17:58:29.043435] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T17:58:29.217885] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-13T17:58:29.395359] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T17:58:30.017934] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-13T17:58:30.635944] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T17:58:30.817923] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-13T17:58:31.060526] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T17:58:31.617917] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-13T17:58:32.417899] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-13T17:58:32.598891] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T17:58:32.811932] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-13T17:58:33.066307] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T17:58:33.217887] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-13T17:58:34.017922] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-13T17:58:34.817916] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-13T17:58:34.953613] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T17:58:35.625156] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-13T17:58:35.631973] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T17:58:35.660413] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-13T17:58:36.417924] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-13T17:58:37.217936] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-13T17:58:37.351398] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T17:58:37.911169] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-13T17:58:38.017902] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-13T17:58:38.036550] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T17:58:38.041915] [INFO ] [REMOTE ] CE: Full fetch complete (74758 records). [2025-10-13T17:58:38.042044] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-13T17:58:38.492507] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-13T17:58:38.492623] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-13T17:58:38.493812] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-13T17:58:38.493890] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-13T17:58:38.495696] [DEBUG] [LOCAL ] CE: Trimmed 74758 records to 51411 (keeping 200 days of data) [2025-10-13T17:58:38.822295] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-13T17:58:38.846788] [DEBUG] [LOCAL ] CE: Primary data saved (51411 records). [2025-10-13T17:58:38.846988] [INFO ] [MAIN ] CE: Full history saved. [2025-10-13T17:58:38.847797] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CE took 37.2s. Estimated remaining: 4h 27m 30s. Rate: 7.3 symbols/min [2025-10-13T17:58:39.020220] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:39.020404] [DEBUG] [LOCAL ] CFG: No existing data file found in primary storage. [2025-10-13T17:58:39.020458] [WARN ] [MAIN ] CFG: No existing data found, performing full refresh instead. [2025-10-13T17:58:39.020565] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-13T17:58:39.020607] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-13T17:58:39.020675] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-10-13T17:58:39.020728] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-13T17:58:39.378241] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:39.408097] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T17:58:39.617892] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-13T17:58:39.903500] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T17:58:40.200800] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T17:58:40.201821] [INFO ] [REMOTE ] CEE: Full fetch complete (10144 records). [2025-10-13T17:58:40.201889] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-13T17:58:40.423849] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-13T17:58:40.578081] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-13T17:58:40.578158] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-13T17:58:40.578403] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-13T17:58:40.578443] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-13T17:58:40.578894] [DEBUG] [LOCAL ] CEE: Trimmed 10144 records to 5436 (keeping 200 days of data) [2025-10-13T17:58:40.611470] [DEBUG] [LOCAL ] CEE: Primary data saved (5436 records). [2025-10-13T17:58:40.611595] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-13T17:58:40.611699] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CEE took 32.8s. Estimated remaining: 4h 26m 52s. Rate: 7.3 symbols/min [2025-10-13T17:58:40.786452] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:40.786628] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-13T17:58:40.786700] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-13T17:58:40.786820] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-13T17:58:40.786884] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-13T17:58:40.786928] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-13T17:58:40.786962] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-13T17:58:41.163359] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:41.217933] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-13T17:58:41.970145] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T17:58:42.017895] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-13T17:58:42.817913] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-13T17:58:42.901680] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T17:58:43.617911] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-13T17:58:43.763891] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T17:58:43.820291] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T17:58:44.417915] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-13T17:58:45.217899] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-13T17:58:45.538230] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T17:58:46.017900] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-13T17:58:46.158002] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T17:58:46.217421] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T17:58:46.238248] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T17:58:46.238586] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-13T17:58:46.238716] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T17:58:46.238805] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-13T17:58:46.238873] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T17:58:46.238944] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-13T17:58:46.239080] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-13T17:58:46.239123] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-13T17:58:46.239164] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-13T17:58:46.239257] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFND took 5.6s. Estimated remaining: 4h 26m 32s. Rate: 7.3 symbols/min [2025-10-13T17:58:46.407468] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:46.442930] [DEBUG] [LOCAL ] CFR: Loaded 33311 existing records from primary storage. [2025-10-13T17:58:46.443221] [INFO ] [MAIN ] CFR: Loaded 33311 existing records. [2025-10-13T17:58:46.615302] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:46.615490] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-13T17:58:46.615537] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-13T17:58:46.616132] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-13T17:58:46.616198] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-13T17:58:46.823125] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-13T17:58:46.986054] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:47.617915] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-13T17:58:48.176678] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T17:58:48.417943] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-13T17:58:49.168891] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T17:58:49.174481] [INFO ] [REMOTE ] CF: Full fetch complete (75245 records). [2025-10-13T17:58:49.174638] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-13T17:58:49.223074] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-13T17:58:49.564016] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-13T17:58:49.564103] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-13T17:58:49.564987] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-13T17:58:49.565052] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-13T17:58:49.566978] [DEBUG] [LOCAL ] CF: Trimmed 75245 records to 52116 (keeping 200 days of data) [2025-10-13T17:58:49.912967] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T17:58:49.934205] [DEBUG] [LOCAL ] CF: Primary data saved (52116 records). [2025-10-13T17:58:49.934738] [INFO ] [MAIN ] CF: Full history saved. [2025-10-13T17:58:49.934866] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CF took 32.1s. Estimated remaining: 4h 26m 4s. Rate: 7.3 symbols/min [2025-10-13T17:58:50.026925] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-13T17:58:50.108348] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:50.148177] [DEBUG] [LOCAL ] CGAU: Loaded 43834 existing records from primary storage. [2025-10-13T17:58:50.148477] [INFO ] [MAIN ] CGAU: Loaded 43834 existing records. [2025-10-13T17:58:50.330022] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:50.330238] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-13T17:58:50.330285] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-13T17:58:50.331286] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-13T17:58:50.331348] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-13T17:58:50.708449] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:50.725965] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T17:58:50.817918] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-13T17:58:51.618031] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-13T17:58:51.677662] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T17:58:52.185096] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T17:58:52.417934] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-13T17:58:52.813525] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T17:58:53.217937] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-13T17:58:53.453248] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T17:58:54.017929] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-13T17:58:54.694969] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T17:58:54.700320] [INFO ] [REMOTE ] CEPU: Full fetch complete (39558 records). [2025-10-13T17:58:54.700583] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-13T17:58:54.823102] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-13T17:58:55.172544] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-13T17:58:55.172695] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-13T17:58:55.174131] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-13T17:58:55.174206] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-13T17:58:55.175774] [DEBUG] [LOCAL ] CEPU: Trimmed 39558 records to 26365 (keeping 200 days of data) [2025-10-13T17:58:55.352348] [DEBUG] [LOCAL ] CEPU: Primary data saved (26365 records). [2025-10-13T17:58:55.352557] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-13T17:58:55.352696] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CEPU took 44.2s. Estimated remaining: 4h 25m 43s. Rate: 7.3 symbols/min [2025-10-13T17:58:55.542234] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:58:55.568748] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T17:58:55.567673] [DEBUG] [LOCAL ] CGV: Loaded 1406 existing records from primary storage. [2025-10-13T17:58:55.576242] [INFO ] [MAIN ] CGV: Loaded 1406 existing records. [2025-10-13T17:58:55.626956] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-13T17:58:55.770020] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:58:55.770246] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-13T17:58:55.770292] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-13T17:58:55.770458] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-13T17:58:55.770513] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-13T17:58:56.119850] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:58:56.288797] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T17:58:56.417974] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-13T17:58:56.956124] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-13T17:58:57.217943] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-13T17:58:57.283011] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T17:58:58.017927] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-13T17:58:58.449433] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T17:58:58.817907] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-13T17:58:58.857277] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T17:58:59.401077] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T17:58:59.617925] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-13T17:59:00.417947] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-13T17:59:01.217997] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-13T17:59:01.466365] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T17:59:01.642866] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T17:59:01.883274] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T17:59:02.017981] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-13T17:59:02.817939] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-13T17:59:03.338006] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-13T17:59:03.589523] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T17:59:03.617887] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-13T17:59:04.417920] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-13T17:59:04.912251] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T17:59:05.218008] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-13T17:59:05.564723] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T17:59:06.017988] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-13T17:59:06.603794] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T17:59:06.817906] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-13T17:59:07.355357] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T17:59:07.358340] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T17:59:07.617935] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-13T17:59:08.417916] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-13T17:59:08.920352] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T17:59:09.218002] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-13T17:59:09.704216] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T17:59:10.017937] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-13T17:59:10.592164] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-13T17:59:10.612587] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T17:59:10.817988] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-13T17:59:11.617945] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-13T17:59:12.417939] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-13T17:59:12.663197] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T17:59:13.012453] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T17:59:13.217924] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-13T17:59:14.018003] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-13T17:59:14.068666] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T17:59:14.817914] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-13T17:59:15.111089] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T17:59:15.141921] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T17:59:15.617938] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-13T17:59:16.212790] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T17:59:16.417916] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-13T17:59:17.163822] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T17:59:17.169350] [INFO ] [REMOTE ] CFG: Full fetch complete (77579 records). [2025-10-13T17:59:17.169478] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-13T17:59:17.224069] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-13T17:59:17.600525] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-13T17:59:17.600618] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-13T17:59:17.601481] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-13T17:59:17.601547] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-13T17:59:17.603284] [DEBUG] [LOCAL ] CFG: Trimmed 77579 records to 53622 (keeping 200 days of data) [2025-10-13T17:59:17.869278] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T17:59:17.959302] [DEBUG] [LOCAL ] CFG: Primary data saved (53622 records). [2025-10-13T17:59:17.959472] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-13T17:59:17.959553] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CFG took 39.1s. Estimated remaining: 4h 26m 39s. Rate: 7.3 symbols/min [2025-10-13T17:59:18.024860] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-13T17:59:18.176176] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:18.173084] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T17:59:18.209095] [DEBUG] [LOCAL ] CHCT: Loaded 24273 existing records from primary storage. [2025-10-13T17:59:18.209372] [INFO ] [MAIN ] CHCT: Loaded 24273 existing records. [2025-10-13T17:59:18.391072] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:18.391325] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-13T17:59:18.391372] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-13T17:59:18.391581] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-13T17:59:18.391637] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-13T17:59:18.757300] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:18.817931] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-13T17:59:19.450416] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T17:59:19.453575] [INFO ] [REMOTE ] CFR: Full fetch complete (48173 records). [2025-10-13T17:59:19.453681] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-13T17:59:19.632751] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-13T17:59:19.868989] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-13T17:59:19.869119] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-13T17:59:19.869787] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-13T17:59:19.869856] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-13T17:59:19.870976] [DEBUG] [LOCAL ] CFR: Trimmed 48173 records to 32698 (keeping 200 days of data) [2025-10-13T17:59:20.091716] [DEBUG] [LOCAL ] CFR: Primary data saved (32698 records). [2025-10-13T17:59:20.091906] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-13T17:59:20.092001] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CFR took 33.9s. Estimated remaining: 4h 26m 4s. Rate: 7.3 symbols/min [2025-10-13T17:59:20.259365] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:20.308365] [DEBUG] [LOCAL ] CHD: Loaded 52964 existing records from primary storage. [2025-10-13T17:59:20.308703] [INFO ] [MAIN ] CHD: Loaded 52964 existing records. [2025-10-13T17:59:20.423052] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-13T17:59:20.494150] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:20.507306] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-13T17:59:20.507919] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T17:59:20.508226] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-13T17:59:20.513487] [INFO ] [REMOTE ] CGAU: Full fetch complete (60800 records). [2025-10-13T17:59:20.513618] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-13T17:59:20.513685] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-13T17:59:20.513959] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-13T17:59:20.519842] [FATAL] [VALIDATOR ] CGAU: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T17:59:20.534820] [FATAL] [MAIN ] CGAU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T17:59:20.592531] [WARN ] [MAIN ] CGAU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T17:59:20.603623] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-13T17:59:20.615875] [DEBUG] [LOCAL ] CGAU: No primary data file found to delete. [2025-10-13T17:59:20.624188] [INFO ] [LOCAL ] CGAU: Starting deletion of derivative data. [2025-10-13T17:59:20.627129] [DEBUG] [LOCAL ] CGAU: Deleted derivative data file. [2025-10-13T17:59:20.627310] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGAU took 30.7s. Estimated remaining: 4h 25m 21s. Rate: 7.3 symbols/min [2025-10-13T17:59:20.991159] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:20.991340] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T17:59:21.127736] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:21.145517] [DEBUG] [LOCAL ] CHE: Loaded 15536 existing records from primary storage. [2025-10-13T17:59:21.147246] [INFO ] [MAIN ] CHE: Loaded 15536 existing records. [2025-10-13T17:59:21.146923] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T17:59:21.223052] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-13T17:59:21.343792] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:21.344100] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-13T17:59:21.344154] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-13T17:59:21.344441] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-13T17:59:21.344501] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-13T17:59:21.714856] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-13T17:59:21.729599] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:22.017916] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-13T17:59:22.817941] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-13T17:59:23.139558] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T17:59:23.617932] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-13T17:59:24.414288] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T17:59:24.424052] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-13T17:59:24.690841] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T17:59:24.846910] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T17:59:24.848111] [INFO ] [REMOTE ] CGV: Full fetch complete (2273 records). [2025-10-13T17:59:24.848208] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-13T17:59:25.205973] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-13T17:59:25.206062] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-13T17:59:25.206178] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-13T17:59:25.206217] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-13T17:59:25.206548] [DEBUG] [LOCAL ] CGV: Trimmed 2273 records to 1391 (keeping 200 days of data) [2025-10-13T17:59:25.215525] [DEBUG] [LOCAL ] CGV: Primary data saved (1391 records). [2025-10-13T17:59:25.215609] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-13T17:59:25.215720] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CGV took 29.9s. Estimated remaining: 4h 24m 56s. Rate: 7.3 symbols/min [2025-10-13T17:59:25.225788] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-13T17:59:25.386790] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:25.433627] [DEBUG] [LOCAL ] CHGG: Loaded 48509 existing records from primary storage. [2025-10-13T17:59:25.434024] [INFO ] [MAIN ] CHGG: Loaded 48509 existing records. [2025-10-13T17:59:25.607591] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:25.607821] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-13T17:59:25.607867] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-13T17:59:25.608181] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-13T17:59:25.608238] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-13T17:59:25.959496] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:26.017931] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-13T17:59:26.220260] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T17:59:26.817940] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-13T17:59:27.617979] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-13T17:59:27.683170] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-13T17:59:27.912677] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T17:59:28.417913] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-13T17:59:28.677976] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-13T17:59:29.217919] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-13T17:59:29.981162] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T17:59:30.017918] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-13T17:59:30.102079] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T17:59:30.817899] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-13T17:59:30.955198] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T17:59:31.617930] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-13T17:59:32.417920] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-13T17:59:32.540933] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T17:59:32.954435] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T17:59:33.217922] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-13T17:59:34.024192] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-13T17:59:34.041291] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T17:59:34.103048] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T17:59:34.818037] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-13T17:59:35.116457] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T17:59:35.617928] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-13T17:59:36.417976] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-13T17:59:36.753886] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T17:59:36.777063] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T17:59:37.127592] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T17:59:37.217921] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-13T17:59:38.017925] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-13T17:59:38.817891] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-13T17:59:38.903728] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T17:59:38.971849] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T17:59:39.617945] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-13T17:59:40.417908] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-13T17:59:40.662304] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T17:59:41.217902] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-13T17:59:41.472849] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T17:59:41.637901] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T17:59:42.017903] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-13T17:59:42.035393] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-13T17:59:42.817890] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-13T17:59:43.208882] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T17:59:43.617925] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-13T17:59:44.377261] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T17:59:44.417880] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-13T17:59:44.541188] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T17:59:45.217913] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-13T17:59:46.017896] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-13T17:59:46.049659] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T17:59:46.817912] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-13T17:59:46.920539] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T17:59:46.985216] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T17:59:47.617902] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-13T17:59:47.670880] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T17:59:48.417910] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-13T17:59:49.217924] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-13T17:59:49.399249] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T17:59:49.417021] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T17:59:49.420420] [INFO ] [REMOTE ] CHCT: Full fetch complete (34709 records). [2025-10-13T17:59:49.420519] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-13T17:59:49.787325] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-13T17:59:49.787400] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-13T17:59:49.787894] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-13T17:59:49.787971] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-13T17:59:49.788746] [DEBUG] [LOCAL ] CHCT: Trimmed 34709 records to 24096 (keeping 200 days of data) [2025-10-13T17:59:49.934717] [DEBUG] [LOCAL ] CHCT: Primary data saved (24096 records). [2025-10-13T17:59:49.934862] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-13T17:59:49.934967] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHCT took 32.0s. Estimated remaining: 4h 26m 2s. Rate: 7.3 symbols/min [2025-10-13T17:59:50.023334] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-13T17:59:50.104954] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:50.136367] [DEBUG] [LOCAL ] CHH: Loaded 32827 existing records from primary storage. [2025-10-13T17:59:50.136626] [INFO ] [MAIN ] CHH: Loaded 32827 existing records. [2025-10-13T17:59:50.311229] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:50.311444] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-13T17:59:50.311491] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-13T17:59:50.311782] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-13T17:59:50.311846] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-13T17:59:50.665446] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:50.817945] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-13T17:59:50.940778] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T17:59:51.191829] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T17:59:51.193994] [INFO ] [REMOTE ] CHE: Full fetch complete (20239 records). [2025-10-13T17:59:51.194064] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-13T17:59:51.557797] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-13T17:59:51.557888] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-13T17:59:51.558296] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-13T17:59:51.558355] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-13T17:59:51.558996] [DEBUG] [LOCAL ] CHE: Trimmed 20239 records to 15364 (keeping 200 days of data) [2025-10-13T17:59:51.631412] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-13T17:59:51.660460] [DEBUG] [LOCAL ] CHE: Primary data saved (15364 records). [2025-10-13T17:59:51.660554] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-13T17:59:51.660627] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHE took 31.0s. Estimated remaining: 4h 25m 25s. Rate: 7.3 symbols/min [2025-10-13T17:59:51.830350] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T17:59:51.849564] [DEBUG] [LOCAL ] CHMI: Loaded 21964 existing records from primary storage. [2025-10-13T17:59:51.849858] [INFO ] [MAIN ] CHMI: Loaded 21964 existing records. [2025-10-13T17:59:52.027099] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T17:59:52.027313] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-13T17:59:52.027358] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-13T17:59:52.027555] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-13T17:59:52.027610] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-13T17:59:52.406804] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T17:59:52.417882] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-13T17:59:52.582608] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T17:59:53.217969] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-13T17:59:53.510273] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T17:59:53.651503] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T17:59:54.017924] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-13T17:59:54.527473] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T17:59:54.817938] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-13T17:59:55.081069] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T17:59:55.617929] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-13T17:59:55.901739] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T17:59:56.418004] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-13T17:59:57.217914] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-13T17:59:57.458435] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T17:59:58.017946] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-13T17:59:58.343161] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T17:59:58.395401] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T17:59:58.817936] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-13T17:59:59.367635] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T17:59:59.617906] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-13T18:00:00.133053] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T18:00:00.418069] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-13T18:00:00.642143] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T18:00:01.217989] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-13T18:00:02.018030] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-13T18:00:02.401567] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T18:00:02.817943] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-13T18:00:03.111828] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T18:00:03.405896] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T18:00:03.618028] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-13T18:00:04.417924] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-13T18:00:04.722323] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T18:00:05.218035] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-13T18:00:05.760523] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-13T18:00:05.766582] [INFO ] [REMOTE ] CHD: Full fetch complete (74513 records). [2025-10-13T18:00:05.766778] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-13T18:00:06.018433] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-13T18:00:06.146879] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:00:06.200905] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-13T18:00:06.201019] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-13T18:00:06.201906] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-13T18:00:06.201971] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-13T18:00:06.203480] [DEBUG] [LOCAL ] CHD: Trimmed 74513 records to 52293 (keeping 200 days of data) [2025-10-13T18:00:06.524832] [DEBUG] [LOCAL ] CHD: Primary data saved (52293 records). [2025-10-13T18:00:06.524981] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-13T18:00:06.525063] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHD took 46.4s. Estimated remaining: 4h 25m 46s. Rate: 7.3 symbols/min [2025-10-13T18:00:06.818063] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-13T18:00:07.123544] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-13T18:00:07.128636] [INFO ] [REMOTE ] CHGG: Full fetch complete (70302 records). [2025-10-13T18:00:07.128777] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-13T18:00:07.480482] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T18:00:07.624134] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-13T18:00:07.625165] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-13T18:00:07.625327] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-13T18:00:07.626494] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-13T18:00:07.627460] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-13T18:00:07.629613] [DEBUG] [LOCAL ] CHGG: Trimmed 70302 records to 47763 (keeping 200 days of data) [2025-10-13T18:00:07.947436] [DEBUG] [LOCAL ] CHGG: Primary data saved (47763 records). [2025-10-13T18:00:07.947688] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-13T18:00:07.947797] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHGG took 42.7s. Estimated remaining: 4h 25m 7s. Rate: 7.3 symbols/min [2025-10-13T18:00:08.272631] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:00:08.417989] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-13T18:00:08.809949] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T18:00:09.217919] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-13T18:00:09.706257] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T18:00:10.017925] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-13T18:00:10.494622] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T18:00:10.818003] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-13T18:00:11.279795] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T18:00:11.617886] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-13T18:00:11.856179] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T18:00:12.417997] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-13T18:00:12.678619] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T18:00:13.217910] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-13T18:00:13.943498] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T18:00:14.017890] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-13T18:00:15.354986] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T18:00:15.357430] [INFO ] [REMOTE ] CHMI: Full fetch complete (31769 records). [2025-10-13T18:00:15.357505] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-13T18:00:15.721560] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-13T18:00:15.721680] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-13T18:00:15.722177] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-13T18:00:15.722220] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-13T18:00:15.723184] [DEBUG] [LOCAL ] CHMI: Trimmed 31769 records to 21617 (keeping 200 days of data) [2025-10-13T18:00:15.849855] [DEBUG] [LOCAL ] CHMI: Primary data saved (21617 records). [2025-10-13T18:00:15.849998] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-13T18:00:15.850082] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHMI took 24.2s. Estimated remaining: 4h 24m 58s. Rate: 7.3 symbols/min [2025-10-13T18:00:17.647567] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (4.43 seconds). [2025-10-13T18:00:17.651327] [INFO ] [REMOTE ] CHH: Full fetch complete (46980 records). [2025-10-13T18:00:17.651458] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-13T18:00:17.652174] [FATAL] [VALIDATOR ] CHH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:00:17.652263] [FATAL] [MAIN ] CHH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:00:17.652306] [WARN ] [MAIN ] CHH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:00:17.652344] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-13T18:00:17.652399] [DEBUG] [LOCAL ] CHH: No primary data file found to delete. [2025-10-13T18:00:17.652433] [INFO ] [LOCAL ] CHH: Starting deletion of derivative data. [2025-10-13T18:00:17.652621] [DEBUG] [LOCAL ] CHH: Deleted derivative data file. [2025-10-13T18:00:17.653441] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHH took 27.7s. Estimated remaining: 4h 24m 21s. Rate: 7.3 symbols/min [2025-10-13T18:00:18.347664] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:18.328168] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:18.404138] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:18.427022] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:18.432711] [DEBUG] [LOCAL ] CHN: Loaded 4832 existing records from primary storage. [2025-10-13T18:00:18.433004] [INFO ] [MAIN ] CHN: Loaded 4832 existing records. [2025-10-13T18:00:18.551551] [DEBUG] [LOCAL ] CHT: Loaded 19798 existing records from primary storage. [2025-10-13T18:00:18.590350] [INFO ] [MAIN ] CHT: Loaded 19798 existing records. [2025-10-13T18:00:18.700518] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:18.722481] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-13T18:00:18.786493] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-13T18:00:18.797879] [DEBUG] [LOCAL ] CHPT: Loaded 48725 existing records from primary storage. [2025-10-13T18:00:18.810092] [DEBUG] [LOCAL ] CHWY: Loaded 54433 existing records from primary storage. [2025-10-13T18:00:18.815560] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-13T18:00:18.808806] [INFO ] [MAIN ] CHPT: Loaded 48725 existing records. [2025-10-13T18:00:18.830792] [INFO ] [MAIN ] CHWY: Loaded 54433 existing records. [2025-10-13T18:00:18.895914] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-13T18:00:19.016369] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:19.109591] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-13T18:00:19.109754] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-13T18:00:19.153471] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-13T18:00:19.244052] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-13T18:00:19.352243] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:19.472735] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:19.426332] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-13T18:00:19.542371] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-13T18:00:19.580207] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-13T18:00:19.601366] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-13T18:00:19.592882] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-13T18:00:19.611793] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-13T18:00:19.642963] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-13T18:00:19.767255] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-13T18:00:20.070787] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:20.129398] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-13T18:00:20.493611] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:20.535509] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-13T18:00:20.670746] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:20.690220] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-13T18:00:20.725696] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:20.726025] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-13T18:00:20.997446] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-13T18:00:20.999369] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-13T18:00:21.651292] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T18:00:21.655151] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-13T18:00:21.756704] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T18:00:21.758635] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-13T18:00:22.151546] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-13T18:00:22.153437] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-13T18:00:22.575987] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T18:00:22.579803] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-13T18:00:22.636615] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T18:00:22.638555] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-13T18:00:22.818084] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T18:00:22.829169] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-13T18:00:22.914078] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-13T18:00:23.425939] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T18:00:23.534140] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T18:00:23.617882] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-13T18:00:24.417928] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-13T18:00:24.668464] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T18:00:24.798974] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T18:00:25.217927] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-13T18:00:26.017894] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-13T18:00:26.290020] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T18:00:26.443177] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-13T18:00:26.817986] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-13T18:00:27.631546] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-13T18:00:27.662795] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:00:27.954916] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T18:00:28.418000] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-13T18:00:29.217921] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-13T18:00:29.801082] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-13T18:00:30.012325] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T18:00:30.022725] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-13T18:00:30.190938] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:00:30.817925] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-13T18:00:31.556760] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T18:00:31.617948] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-13T18:00:32.096005] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-13T18:00:32.131850] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-13T18:00:32.418196] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-13T18:00:33.021199] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T18:00:33.217931] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-13T18:00:33.980885] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T18:00:34.017911] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-13T18:00:34.749906] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-13T18:00:34.817891] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-13T18:00:35.237541] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-13T18:00:35.238562] [INFO ] [REMOTE ] CHN: Full fetch complete (7371 records). [2025-10-13T18:00:35.238631] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-13T18:00:35.239065] [FATAL] [VALIDATOR ] CHN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:00:35.239148] [FATAL] [MAIN ] CHN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:00:35.239190] [WARN ] [MAIN ] CHN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:00:35.239229] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-13T18:00:35.239283] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-13T18:00:35.239316] [INFO ] [LOCAL ] CHN: Starting deletion of derivative data. [2025-10-13T18:00:35.239436] [DEBUG] [LOCAL ] CHN: Deleted derivative data file. [2025-10-13T18:00:35.239504] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHN took 17.6s. Estimated remaining: 4h 24m 54s. Rate: 7.3 symbols/min [2025-10-13T18:00:35.407069] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:35.407241] [DEBUG] [LOCAL ] CI: No existing data file found in primary storage. [2025-10-13T18:00:35.407277] [WARN ] [MAIN ] CI: No existing data found, performing full refresh instead. [2025-10-13T18:00:35.407389] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-13T18:00:35.407428] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-13T18:00:35.407518] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-13T18:00:35.407566] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-13T18:00:35.623040] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-13T18:00:35.763113] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:36.417926] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-13T18:00:36.823041] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T18:00:37.217932] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-13T18:00:38.017899] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-13T18:00:38.349433] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T18:00:38.817983] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-13T18:00:39.070592] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T18:00:39.617934] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-13T18:00:39.944025] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T18:00:40.210062] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-13T18:00:40.417898] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-13T18:00:41.217978] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-13T18:00:41.348266] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:00:41.389903] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:00:42.017913] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-13T18:00:42.817923] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-13T18:00:42.942547] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T18:00:42.945243] [INFO ] [REMOTE ] CHT: Full fetch complete (27461 records). [2025-10-13T18:00:42.945420] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-13T18:00:43.088441] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T18:00:43.343297] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-13T18:00:43.343372] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-13T18:00:43.343813] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-13T18:00:43.343873] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-13T18:00:43.344499] [DEBUG] [LOCAL ] CHT: Trimmed 27461 records to 19498 (keeping 200 days of data) [2025-10-13T18:00:43.458916] [DEBUG] [LOCAL ] CHT: Primary data saved (19498 records). [2025-10-13T18:00:43.459076] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-13T18:00:43.459180] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHT took 25.8s. Estimated remaining: 4h 24m 46s. Rate: 7.3 symbols/min [2025-10-13T18:00:43.623132] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-13T18:00:43.626299] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:43.642543] [DEBUG] [LOCAL ] CIA: Loaded 17004 existing records from primary storage. [2025-10-13T18:00:43.642827] [INFO ] [MAIN ] CIA: Loaded 17004 existing records. [2025-10-13T18:00:43.814903] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:43.815111] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-13T18:00:43.815156] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-13T18:00:43.815346] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-13T18:00:43.815402] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-13T18:00:44.169174] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:44.417916] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-13T18:00:44.859066] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-13T18:00:45.217558] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:00:45.227038] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-13T18:00:46.017975] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-13T18:00:46.236535] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T18:00:46.817922] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-13T18:00:47.374459] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-13T18:00:47.617941] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-13T18:00:47.849505] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T18:00:47.883737] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T18:00:48.417921] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-13T18:00:49.217920] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-13T18:00:49.934584] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-13T18:00:50.017889] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-13T18:00:50.405570] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T18:00:50.817896] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-13T18:00:51.316824] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-13T18:00:51.617889] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-13T18:00:51.650516] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T18:00:51.704561] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T18:00:52.417926] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-13T18:00:53.218027] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-13T18:00:53.472383] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T18:00:54.003915] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:00:54.018448] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-13T18:00:54.817915] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-13T18:00:55.060032] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T18:00:55.617933] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-13T18:00:55.966248] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T18:00:55.970495] [INFO ] [REMOTE ] CHPT: Full fetch complete (71928 records). [2025-10-13T18:00:55.970631] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-13T18:00:56.357794] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-13T18:00:56.357966] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-13T18:00:56.358910] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-13T18:00:56.358976] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-13T18:00:56.360401] [DEBUG] [LOCAL ] CHPT: Trimmed 71928 records to 47848 (keeping 200 days of data) [2025-10-13T18:00:56.443884] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-13T18:00:56.488376] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T18:00:56.656470] [DEBUG] [LOCAL ] CHPT: Primary data saved (47848 records). [2025-10-13T18:00:56.656612] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-13T18:00:56.656724] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CHPT took 39.0s. Estimated remaining: 4h 24m 59s. Rate: 7.3 symbols/min [2025-10-13T18:00:56.825837] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:00:56.855760] [DEBUG] [LOCAL ] CIB: Loaded 31088 existing records from primary storage. [2025-10-13T18:00:56.856138] [INFO ] [MAIN ] CIB: Loaded 31088 existing records. [2025-10-13T18:00:57.037909] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:00:57.038439] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-13T18:00:57.038508] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-13T18:00:57.039293] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-13T18:00:57.039354] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-13T18:00:57.188313] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-13T18:00:57.227002] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-13T18:00:57.465279] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:00:58.017896] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-13T18:00:58.132402] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:00:58.587840] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T18:00:58.817969] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-13T18:00:59.617924] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-13T18:01:00.011383] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-13T18:01:00.017392] [INFO ] [REMOTE ] CHWY: Full fetch complete (77634 records). [2025-10-13T18:01:00.017587] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-13T18:01:00.419711] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-13T18:01:00.446517] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-13T18:01:00.446859] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-13T18:01:00.448042] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-13T18:01:00.448453] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-13T18:01:00.450382] [DEBUG] [LOCAL ] CHWY: Trimmed 77634 records to 53653 (keeping 200 days of data) [2025-10-13T18:01:00.577846] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-13T18:01:00.733626] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T18:01:00.830858] [DEBUG] [LOCAL ] CHWY: Primary data saved (53653 records). [2025-10-13T18:01:00.831001] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-13T18:01:00.832199] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHWY took 43.2s. Estimated remaining: 4h 24m 33s. Rate: 7.3 symbols/min [2025-10-13T18:01:01.029557] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:01.029757] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-13T18:01:01.029801] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-13T18:01:01.029909] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-13T18:01:01.029950] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-13T18:01:01.029990] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-13T18:01:01.030022] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-13T18:01:01.223122] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-13T18:01:01.407582] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:02.017902] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-13T18:01:02.188400] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T18:01:02.590430] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T18:01:02.757856] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T18:01:02.817992] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-13T18:01:03.270948] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T18:01:03.617916] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-13T18:01:04.417897] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-13T18:01:04.562929] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T18:01:05.051843] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T18:01:05.218052] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-13T18:01:06.018016] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-13T18:01:06.595708] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T18:01:06.817895] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-13T18:01:07.188533] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T18:01:07.617906] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-13T18:01:07.865261] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T18:01:08.417891] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-13T18:01:08.476330] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T18:01:09.218006] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-13T18:01:10.017898] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-13T18:01:10.221560] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:01:10.700559] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T18:01:10.817932] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-13T18:01:10.845782] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:01:11.617924] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-13T18:01:12.418385] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-13T18:01:12.424706] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T18:01:12.984833] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:01:13.217978] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-13T18:01:13.406571] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T18:01:14.017914] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-13T18:01:14.122096] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T18:01:14.126378] [INFO ] [REMOTE ] CIA: Full fetch complete (23463 records). [2025-10-13T18:01:14.126449] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-13T18:01:14.415949] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-13T18:01:14.499396] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-13T18:01:14.499464] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-13T18:01:14.499940] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-13T18:01:14.500003] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-13T18:01:14.500673] [DEBUG] [LOCAL ] CIA: Trimmed 23463 records to 16686 (keeping 200 days of data) [2025-10-13T18:01:14.591672] [DEBUG] [LOCAL ] CIA: Primary data saved (16686 records). [2025-10-13T18:01:14.591801] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-13T18:01:14.591879] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CIA took 31.1s. Estimated remaining: 4h 24m 49s. Rate: 7.3 symbols/min [2025-10-13T18:01:14.761995] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:14.762140] [DEBUG] [LOCAL ] CIEN: No existing data file found in primary storage. [2025-10-13T18:01:14.762175] [WARN ] [MAIN ] CIEN: No existing data found, performing full refresh instead. [2025-10-13T18:01:14.762282] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-13T18:01:14.762322] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-13T18:01:14.762382] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-13T18:01:14.762450] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-13T18:01:14.824104] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-13T18:01:15.119262] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:15.618004] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-13T18:01:15.936080] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:01:16.417946] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-13T18:01:17.217886] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-13T18:01:17.316481] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:01:17.583936] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-13T18:01:17.778746] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T18:01:18.017937] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-13T18:01:18.773307] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T18:01:18.778777] [INFO ] [REMOTE ] CI: Full fetch complete (72128 records). [2025-10-13T18:01:18.778879] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-13T18:01:18.823099] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-13T18:01:19.162079] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-13T18:01:19.162156] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-13T18:01:19.162932] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-13T18:01:19.162993] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-13T18:01:19.164359] [DEBUG] [LOCAL ] CI: Trimmed 72128 records to 49808 (keeping 200 days of data) [2025-10-13T18:01:19.469941] [DEBUG] [LOCAL ] CI: Primary data saved (49808 records). [2025-10-13T18:01:19.470085] [INFO ] [MAIN ] CI: Full history saved. [2025-10-13T18:01:19.470162] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CI took 44.2s. Estimated remaining: 4h 24m 26s. Rate: 7.3 symbols/min [2025-10-13T18:01:19.621851] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-13T18:01:19.642303] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:19.648043] [DEBUG] [LOCAL ] CIF: Loaded 4139 existing records from primary storage. [2025-10-13T18:01:19.648300] [INFO ] [MAIN ] CIF: Loaded 4139 existing records. [2025-10-13T18:01:19.823702] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:01:19.823918] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-13T18:01:19.823973] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-13T18:01:19.824176] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-13T18:01:19.824233] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-13T18:01:20.130169] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T18:01:20.195903] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:20.417901] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-13T18:01:20.973863] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-13T18:01:21.217903] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-13T18:01:21.400448] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T18:01:21.863185] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-13T18:01:22.017933] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-13T18:01:22.463333] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T18:01:22.817911] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-13T18:01:23.310092] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-13T18:01:23.617978] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-13T18:01:24.417933] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-13T18:01:24.947109] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T18:01:25.060938] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T18:01:25.217908] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-13T18:01:25.830635] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T18:01:26.017986] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-13T18:01:26.668245] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T18:01:26.817908] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-13T18:01:27.617978] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-13T18:01:28.053897] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T18:01:28.072883] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T18:01:28.417991] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-13T18:01:29.217926] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-13T18:01:29.656283] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T18:01:29.664070] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T18:01:29.666872] [INFO ] [REMOTE ] CIB: Full fetch complete (44591 records). [2025-10-13T18:01:29.666967] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-13T18:01:29.667695] [FATAL] [VALIDATOR ] CIB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:01:29.667779] [FATAL] [MAIN ] CIB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:01:29.667822] [WARN ] [MAIN ] CIB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:01:29.668353] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-13T18:01:29.668496] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-13T18:01:29.668537] [INFO ] [LOCAL ] CIB: Starting deletion of derivative data. [2025-10-13T18:01:29.668793] [DEBUG] [LOCAL ] CIB: Deleted derivative data file. [2025-10-13T18:01:29.668960] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIB took 33.0s. Estimated remaining: 4h 24m 26s. Rate: 7.3 symbols/min [2025-10-13T18:01:29.837221] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:29.837401] [DEBUG] [LOCAL ] CIG: No existing data file found in primary storage. [2025-10-13T18:01:29.837445] [WARN ] [MAIN ] CIG: No existing data found, performing full refresh instead. [2025-10-13T18:01:29.837558] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-13T18:01:29.837598] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-13T18:01:29.837637] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-13T18:01:29.837712] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-13T18:01:30.025321] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-13T18:01:30.192160] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:30.758994] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T18:01:30.817879] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-13T18:01:31.319911] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-13T18:01:31.617930] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-13T18:01:32.239091] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T18:01:32.417905] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-13T18:01:33.217939] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-13T18:01:34.017907] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-13T18:01:34.243437] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-13T18:01:34.503543] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T18:01:34.504232] [INFO ] [REMOTE ] CICB: Full fetch complete (1976 records). [2025-10-13T18:01:34.504300] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-13T18:01:34.504626] [FATAL] [VALIDATOR ] CICB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:01:34.504731] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:01:34.504804] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:01:34.504885] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-13T18:01:34.504961] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-13T18:01:34.505011] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-13T18:01:34.505067] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-13T18:01:34.505140] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CICB took 33.7s. Estimated remaining: 4h 24m 3s. Rate: 7.3 symbols/min [2025-10-13T18:01:34.677131] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:34.701205] [DEBUG] [LOCAL ] CII: Loaded 15532 existing records from primary storage. [2025-10-13T18:01:34.701434] [INFO ] [MAIN ] CII: Loaded 15532 existing records. [2025-10-13T18:01:34.825397] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-13T18:01:34.904075] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:01:34.904507] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-13T18:01:34.904568] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-13T18:01:34.924044] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-13T18:01:34.924763] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-13T18:01:34.924702] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T18:01:35.315551] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:35.467574] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T18:01:35.617911] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-13T18:01:36.417929] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-13T18:01:36.691214] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T18:01:36.922095] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T18:01:37.217904] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-13T18:01:38.017926] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-13T18:01:38.599946] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T18:01:38.817905] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-13T18:01:38.918919] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T18:01:39.617979] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-13T18:01:40.184255] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T18:01:40.417895] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-13T18:01:41.093469] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T18:01:41.094328] [INFO ] [REMOTE ] CIF: Full fetch complete (6586 records). [2025-10-13T18:01:41.094393] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-13T18:01:41.222686] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-13T18:01:41.461558] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-13T18:01:41.461740] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-13T18:01:41.461987] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-13T18:01:41.462061] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-13T18:01:41.462605] [DEBUG] [LOCAL ] CIF: Trimmed 6586 records to 4061 (keeping 200 days of data) [2025-10-13T18:01:41.508819] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T18:01:41.525313] [DEBUG] [LOCAL ] CIF: Primary data saved (4061 records). [2025-10-13T18:01:41.525393] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-13T18:01:41.525462] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIF took 22.1s. Estimated remaining: 4h 23m 50s. Rate: 7.3 symbols/min [2025-10-13T18:01:41.688486] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:01:41.688610] [DEBUG] [LOCAL ] CIM: No existing data file found in primary storage. [2025-10-13T18:01:41.688672] [WARN ] [MAIN ] CIM: No existing data found, performing full refresh instead. [2025-10-13T18:01:41.688780] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-13T18:01:41.688821] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-13T18:01:41.688861] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-13T18:01:41.688893] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-13T18:01:42.039812] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-13T18:01:42.045567] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:01:42.181031] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T18:01:42.817914] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-13T18:01:43.499056] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:01:43.617885] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-13T18:01:43.776970] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T18:01:44.417935] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-13T18:01:45.217922] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-13T18:01:45.254457] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:01:45.828810] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T18:01:46.017938] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-13T18:01:46.817922] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-13T18:01:47.245535] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-13T18:01:47.618022] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-13T18:01:47.827481] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T18:01:47.849238] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T18:01:48.418036] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-13T18:01:49.218000] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-13T18:01:49.818426] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-13T18:01:50.023019] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-13T18:01:50.041932] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T18:01:50.349093] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T18:01:50.817944] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-13T18:01:51.516003] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T18:01:51.617942] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-13T18:01:52.417983] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-13T18:01:52.483569] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T18:01:53.217934] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-13T18:01:53.294691] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T18:01:53.731703] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T18:01:54.017940] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-13T18:01:54.794163] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T18:01:54.817914] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-13T18:01:54.949858] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T18:01:55.617928] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-13T18:01:56.290200] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T18:01:56.417894] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-13T18:01:57.224518] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-13T18:01:57.239516] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T18:01:58.017913] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-13T18:01:58.178459] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T18:01:58.672436] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T18:01:58.817912] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-13T18:01:58.911004] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T18:01:59.617916] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-13T18:02:00.424115] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-13T18:02:00.440727] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T18:02:00.558189] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-13T18:02:01.217929] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-13T18:02:02.017993] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-13T18:02:02.117842] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T18:02:02.817995] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-13T18:02:03.173845] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-13T18:02:03.178274] [INFO ] [REMOTE ] CIG: Full fetch complete (61378 records). [2025-10-13T18:02:03.178364] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-13T18:02:03.178945] [FATAL] [VALIDATOR ] CIG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:02:03.179027] [FATAL] [MAIN ] CIG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:02:03.179069] [WARN ] [MAIN ] CIG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:02:03.179106] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-13T18:02:03.179159] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-13T18:02:03.179193] [INFO ] [LOCAL ] CIG: Starting deletion of derivative data. [2025-10-13T18:02:03.179232] [DEBUG] [LOCAL ] CIG: No derivative data file found to delete. [2025-10-13T18:02:03.179286] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CIG took 33.5s. Estimated remaining: 4h 24m 39s. Rate: 7.3 symbols/min [2025-10-13T18:02:03.343134] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:03.343267] [DEBUG] [LOCAL ] CIMN: No existing data file found in primary storage. [2025-10-13T18:02:03.343303] [WARN ] [MAIN ] CIMN: No existing data found, performing full refresh instead. [2025-10-13T18:02:03.343408] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-13T18:02:03.343449] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-13T18:02:03.343489] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-13T18:02:03.343520] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-13T18:02:03.619741] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-13T18:02:03.709517] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T18:02:03.714597] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:03.720359] [INFO ] [REMOTE ] CIEN: Full fetch complete (75197 records). [2025-10-13T18:02:03.720463] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-13T18:02:03.721262] [FATAL] [VALIDATOR ] CIEN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:02:03.721368] [FATAL] [MAIN ] CIEN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:02:03.721444] [WARN ] [MAIN ] CIEN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:02:03.721528] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-13T18:02:03.721606] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-13T18:02:03.721706] [INFO ] [LOCAL ] CIEN: Starting deletion of derivative data. [2025-10-13T18:02:03.721813] [DEBUG] [LOCAL ] CIEN: No derivative data file found to delete. [2025-10-13T18:02:03.721890] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIEN took 49.1s. Estimated remaining: 4h 23m 58s. Rate: 7.3 symbols/min [2025-10-13T18:02:03.897149] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:03.897338] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-13T18:02:03.897376] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-13T18:02:03.897489] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-13T18:02:03.897543] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-13T18:02:03.897618] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-13T18:02:03.897706] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-13T18:02:04.256773] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:04.374951] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T18:02:04.417908] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-13T18:02:04.504732] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T18:02:05.217923] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-13T18:02:05.250909] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T18:02:06.017913] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-13T18:02:06.029348] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T18:02:06.031530] [INFO ] [REMOTE ] CII: Full fetch complete (22915 records). [2025-10-13T18:02:06.031597] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-13T18:02:06.389273] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-13T18:02:06.389352] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-13T18:02:06.389779] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-13T18:02:06.389839] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-13T18:02:06.390456] [DEBUG] [LOCAL ] CII: Trimmed 22915 records to 15346 (keeping 200 days of data) [2025-10-13T18:02:06.491043] [DEBUG] [LOCAL ] CII: Primary data saved (15346 records). [2025-10-13T18:02:06.491249] [INFO ] [MAIN ] CII: Full history saved. [2025-10-13T18:02:06.491359] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CII took 32.0s. Estimated remaining: 4h 23m 26s. Rate: 7.3 symbols/min [2025-10-13T18:02:06.668606] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:06.668927] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-13T18:02:06.668984] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-13T18:02:06.669116] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-13T18:02:06.669163] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-13T18:02:06.669216] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-13T18:02:06.669253] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-13T18:02:06.823106] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-13T18:02:07.051133] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:07.368265] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T18:02:07.466797] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T18:02:07.617923] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-13T18:02:08.417936] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-13T18:02:08.621269] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:02:08.621489] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-13T18:02:08.621580] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:02:08.621625] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-13T18:02:08.621705] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:02:08.621781] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-13T18:02:08.621914] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-13T18:02:08.621971] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-13T18:02:08.622035] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-13T18:02:08.622108] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMP took 2.1s. Estimated remaining: 4h 22m 52s. Rate: 7.3 symbols/min [2025-10-13T18:02:08.793696] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:08.811879] [DEBUG] [LOCAL ] CINT: Loaded 19896 existing records from primary storage. [2025-10-13T18:02:08.812121] [INFO ] [MAIN ] CINT: Loaded 19896 existing records. [2025-10-13T18:02:08.992595] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:02:08.992928] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-13T18:02:08.993050] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-13T18:02:08.993395] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-13T18:02:08.993452] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-13T18:02:09.114728] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T18:02:09.222436] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-13T18:02:09.403781] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:09.747499] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-13T18:02:10.017937] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-13T18:02:10.817935] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-13T18:02:10.935269] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T18:02:11.392333] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T18:02:11.617929] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-13T18:02:12.153729] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-13T18:02:12.417937] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-13T18:02:13.218007] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-13T18:02:13.485119] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T18:02:14.017901] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-13T18:02:14.374789] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T18:02:14.756030] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T18:02:14.817893] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-13T18:02:15.617915] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-13T18:02:15.812626] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-13T18:02:16.072362] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T18:02:16.417934] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-13T18:02:17.220160] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-13T18:02:17.222268] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T18:02:17.785937] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:02:18.017922] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-13T18:02:18.692600] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T18:02:18.817896] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-13T18:02:19.276155] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T18:02:19.617927] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-13T18:02:20.417921] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-13T18:02:20.845229] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T18:02:21.217898] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-13T18:02:21.294801] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T18:02:22.017913] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-13T18:02:22.244354] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T18:02:22.674594] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T18:02:22.818007] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-13T18:02:23.397615] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T18:02:23.617922] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-13T18:02:24.417928] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-13T18:02:24.708502] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:02:24.742211] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-13T18:02:25.217915] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-13T18:02:25.511016] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-13T18:02:26.017936] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-13T18:02:26.817929] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-13T18:02:27.167510] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-13T18:02:27.490557] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:02:27.494674] [INFO ] [REMOTE ] CIM: Full fetch complete (54703 records). [2025-10-13T18:02:27.494780] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-13T18:02:27.495442] [FATAL] [VALIDATOR ] CIM: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:02:27.495528] [FATAL] [MAIN ] CIM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:02:27.495572] [WARN ] [MAIN ] CIM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:02:27.495622] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-13T18:02:27.495737] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-13T18:02:27.495799] [INFO ] [LOCAL ] CIM: Starting deletion of derivative data. [2025-10-13T18:02:27.495857] [DEBUG] [LOCAL ] CIM: No derivative data file found to delete. [2025-10-13T18:02:27.495933] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIM took 46.0s. Estimated remaining: 4h 23m 29s. Rate: 7.3 symbols/min [2025-10-13T18:02:27.622997] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-13T18:02:27.670768] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:27.689540] [DEBUG] [LOCAL ] CIO: Loaded 20876 existing records from primary storage. [2025-10-13T18:02:27.690107] [INFO ] [MAIN ] CIO: Loaded 20876 existing records. [2025-10-13T18:02:27.868214] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:02:27.868431] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-13T18:02:27.868482] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-13T18:02:27.868783] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-13T18:02:27.868839] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-13T18:02:28.228831] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:28.417889] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-13T18:02:28.549859] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T18:02:29.082634] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T18:02:29.217918] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-13T18:02:29.651800] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-13T18:02:30.017927] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-13T18:02:30.817977] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-13T18:02:31.205376] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T18:02:31.617923] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-13T18:02:31.969060] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-13T18:02:32.283023] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:02:32.286291] [INFO ] [REMOTE ] CINT: Full fetch complete (27482 records). [2025-10-13T18:02:32.286369] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-13T18:02:32.286870] [FATAL] [VALIDATOR ] CINT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:02:32.286965] [FATAL] [MAIN ] CINT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:02:32.287037] [WARN ] [MAIN ] CINT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:02:32.287129] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-13T18:02:32.287207] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-13T18:02:32.287243] [INFO ] [LOCAL ] CINT: Starting deletion of derivative data. [2025-10-13T18:02:32.287397] [DEBUG] [LOCAL ] CINT: Deleted derivative data file. [2025-10-13T18:02:32.287480] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CINT took 23.7s. Estimated remaining: 4h 23m 6s. Rate: 7.3 symbols/min [2025-10-13T18:02:32.430094] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-13T18:02:32.463958] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:32.492117] [DEBUG] [LOCAL ] CION: Loaded 28885 existing records from primary storage. [2025-10-13T18:02:32.492399] [INFO ] [MAIN ] CION: Loaded 28885 existing records. [2025-10-13T18:02:32.666733] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:02:32.667021] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-13T18:02:32.667098] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-13T18:02:32.667326] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-13T18:02:32.667383] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-13T18:02:33.016675] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:33.217915] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-13T18:02:33.563993] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-13T18:02:33.564734] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T18:02:34.017925] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-13T18:02:34.596888] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T18:02:34.597785] [INFO ] [REMOTE ] CIMN: Full fetch complete (3900 records). [2025-10-13T18:02:34.597855] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-13T18:02:34.823001] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-13T18:02:34.976294] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-13T18:02:34.976376] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-13T18:02:34.976514] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-13T18:02:34.976551] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-13T18:02:34.976988] [DEBUG] [LOCAL ] CIMN: Trimmed 3900 records to 2757 (keeping 200 days of data) [2025-10-13T18:02:34.993764] [DEBUG] [LOCAL ] CIMN: Primary data saved (2757 records). [2025-10-13T18:02:34.993894] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-13T18:02:34.993972] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CIMN took 31.8s. Estimated remaining: 4h 22m 35s. Rate: 7.3 symbols/min [2025-10-13T18:02:35.160086] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:35.212366] [DEBUG] [LOCAL ] CIVI: Loaded 53392 existing records from primary storage. [2025-10-13T18:02:35.212716] [INFO ] [MAIN ] CIVI: Loaded 53392 existing records. [2025-10-13T18:02:35.392043] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:02:35.392290] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-13T18:02:35.392337] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-13T18:02:35.392791] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-13T18:02:35.392850] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-13T18:02:35.628569] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-13T18:02:35.745808] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:36.283410] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:02:36.298967] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T18:02:36.417939] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-13T18:02:37.217982] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-13T18:02:37.241879] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T18:02:38.017927] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-13T18:02:38.817938] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-13T18:02:39.016479] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T18:02:39.054900] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T18:02:39.278126] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T18:02:39.617943] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-13T18:02:40.417922] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-13T18:02:41.217898] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-13T18:02:41.376353] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T18:02:41.496808] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:02:42.017945] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-13T18:02:42.180427] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-13T18:02:42.817935] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-13T18:02:43.294147] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T18:02:43.371435] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T18:02:43.618011] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-13T18:02:44.281051] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-13T18:02:44.419594] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-13T18:02:45.217921] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-13T18:02:45.842138] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T18:02:45.843151] [INFO ] [REMOTE ] CIMO: Full fetch complete (5066 records). [2025-10-13T18:02:45.843218] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-13T18:02:46.020768] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-13T18:02:46.026718] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T18:02:46.027797] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:02:46.028110] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:02:46.028204] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-13T18:02:46.028339] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-13T18:02:46.028465] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-13T18:02:46.028711] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-13T18:02:46.028835] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CIMO took 42.3s. Estimated remaining: 4h 22m 38s. Rate: 7.3 symbols/min [2025-10-13T18:02:46.206839] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T18:02:46.229910] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:46.291224] [DEBUG] [LOCAL ] CL: Loaded 54428 existing records from primary storage. [2025-10-13T18:02:46.291577] [INFO ] [MAIN ] CL: Loaded 54428 existing records. [2025-10-13T18:02:46.465155] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:02:46.465390] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-13T18:02:46.465437] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-13T18:02:46.465778] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-13T18:02:46.465834] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-13T18:02:46.824571] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-13T18:02:46.829049] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:02:47.109553] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T18:02:47.617916] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-13T18:02:48.247798] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T18:02:48.417888] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-13T18:02:48.438852] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T18:02:49.217920] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-13T18:02:50.023047] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-13T18:02:50.038166] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T18:02:50.164737] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T18:02:50.817924] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-13T18:02:51.617934] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-13T18:02:51.661895] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:02:52.417899] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-13T18:02:52.572991] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T18:02:52.831020] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T18:02:53.217933] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-13T18:02:53.472454] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T18:02:54.017973] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-13T18:02:54.817909] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-13T18:02:55.143924] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T18:02:55.617916] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-13T18:02:55.753800] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T18:02:55.788108] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T18:02:56.417887] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-13T18:02:56.445027] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:02:57.217895] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-13T18:02:57.609076] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T18:02:58.017927] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-13T18:02:58.818036] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-13T18:02:58.833865] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T18:02:58.837036] [INFO ] [REMOTE ] CIO: Full fetch complete (29338 records). [2025-10-13T18:02:58.837138] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-13T18:02:59.227830] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-13T18:02:59.227971] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-13T18:02:59.228604] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-13T18:02:59.228818] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-13T18:02:59.229802] [DEBUG] [LOCAL ] CIO: Trimmed 29338 records to 20708 (keeping 200 days of data) [2025-10-13T18:02:59.349783] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-13T18:02:59.397513] [DEBUG] [LOCAL ] CIO: Primary data saved (20708 records). [2025-10-13T18:02:59.397672] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-13T18:02:59.397772] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CIO took 31.9s. Estimated remaining: 4h 22m 51s. Rate: 7.3 symbols/min [2025-10-13T18:02:59.567207] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:02:59.567417] [DEBUG] [LOCAL ] CLB: No existing data file found in primary storage. [2025-10-13T18:02:59.567454] [WARN ] [MAIN ] CLB: No existing data found, performing full refresh instead. [2025-10-13T18:02:59.567562] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-13T18:02:59.567601] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-13T18:02:59.567662] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-10-13T18:02:59.567718] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-13T18:02:59.630207] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-13T18:02:59.932929] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:00.417930] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-13T18:03:00.903367] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-13T18:03:01.133458] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T18:03:01.218037] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-13T18:03:02.018025] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-13T18:03:02.509064] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-13T18:03:02.818017] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-13T18:03:03.540344] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-13T18:03:03.610302] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:03:03.617873] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-13T18:03:04.417906] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-13T18:03:04.723849] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T18:03:04.784986] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T18:03:04.788483] [INFO ] [REMOTE ] CION: Full fetch complete (40242 records). [2025-10-13T18:03:04.788790] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-13T18:03:04.789399] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:03:04.789488] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:03:04.789531] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:03:04.789569] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-13T18:03:04.789624] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-13T18:03:04.789696] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-13T18:03:04.789867] [DEBUG] [LOCAL ] CION: Deleted derivative data file. [2025-10-13T18:03:04.789952] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CION took 32.5s. Estimated remaining: 4h 22m 31s. Rate: 7.3 symbols/min [2025-10-13T18:03:04.976234] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:04.991278] [DEBUG] [LOCAL ] CLCO: Loaded 13109 existing records from primary storage. [2025-10-13T18:03:04.991505] [INFO ] [MAIN ] CLCO: Loaded 13109 existing records. [2025-10-13T18:03:05.183846] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:03:05.184076] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-13T18:03:05.184159] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-13T18:03:05.184489] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-13T18:03:05.184587] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-13T18:03:05.227724] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-13T18:03:05.560189] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:05.772228] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T18:03:06.017914] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-13T18:03:06.818021] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-13T18:03:07.123069] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T18:03:07.242767] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T18:03:07.618142] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-13T18:03:08.417927] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-13T18:03:08.536760] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T18:03:09.217946] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-13T18:03:09.475337] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T18:03:09.675055] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-13T18:03:10.017905] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-13T18:03:10.823079] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-13T18:03:10.849125] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T18:03:11.391027] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T18:03:11.617921] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-13T18:03:12.417888] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-13T18:03:12.569754] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T18:03:12.603292] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T18:03:13.217901] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-13T18:03:13.323356] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T18:03:14.017942] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-13T18:03:14.817913] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-13T18:03:14.887029] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:03:15.323401] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T18:03:15.618193] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-13T18:03:16.419828] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-13T18:03:16.422468] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T18:03:16.428519] [INFO ] [REMOTE ] CL: Full fetch complete (77620 records). [2025-10-13T18:03:16.428725] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-13T18:03:16.856112] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-13T18:03:16.856285] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-13T18:03:16.857291] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-13T18:03:16.857377] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-13T18:03:16.888392] [DEBUG] [LOCAL ] CL: Trimmed 77620 records to 53648 (keeping 200 days of data) [2025-10-13T18:03:16.890229] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-13T18:03:17.222685] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-13T18:03:17.247404] [DEBUG] [LOCAL ] CL: Primary data saved (53648 records). [2025-10-13T18:03:17.247525] [INFO ] [MAIN ] CL: Full history saved. [2025-10-13T18:03:17.247634] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CL took 31.2s. Estimated remaining: 4h 22m 41s. Rate: 7.3 symbols/min [2025-10-13T18:03:17.414721] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:17.438987] [DEBUG] [LOCAL ] CLDT: Loaded 25799 existing records from primary storage. [2025-10-13T18:03:17.439217] [INFO ] [MAIN ] CLDT: Loaded 25799 existing records. [2025-10-13T18:03:17.623358] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:03:17.623522] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-13T18:03:17.623568] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-13T18:03:17.623788] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-13T18:03:17.623844] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-13T18:03:18.001409] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:18.003076] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T18:03:18.017891] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-13T18:03:18.360637] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T18:03:18.817920] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-13T18:03:18.842507] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T18:03:19.617928] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-13T18:03:20.417904] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-13T18:03:20.608880] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:03:20.613715] [INFO ] [REMOTE ] CIVI: Full fetch complete (75375 records). [2025-10-13T18:03:20.613841] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-13T18:03:20.614611] [FATAL] [VALIDATOR ] CIVI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:03:20.614724] [FATAL] [MAIN ] CIVI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:03:20.614794] [WARN ] [MAIN ] CIVI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:03:20.614865] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-13T18:03:20.614959] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-10-13T18:03:20.615014] [INFO ] [LOCAL ] CIVI: Starting deletion of derivative data. [2025-10-13T18:03:20.615171] [DEBUG] [LOCAL ] CIVI: Deleted derivative data file. [2025-10-13T18:03:20.615261] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CIVI took 45.6s. Estimated remaining: 4h 22m 12s. Rate: 7.3 symbols/min [2025-10-13T18:03:20.789763] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:03:20.806510] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:20.864883] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-10-13T18:03:20.865183] [INFO ] [MAIN ] CLF: Loaded 54521 existing records. [2025-10-13T18:03:21.058559] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:03:21.058827] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-13T18:03:21.058873] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-13T18:03:21.059424] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-13T18:03:21.059480] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-13T18:03:21.221055] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-13T18:03:21.432434] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T18:03:21.454213] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:22.017905] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-13T18:03:22.405940] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T18:03:22.817944] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-13T18:03:23.495678] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-13T18:03:23.617899] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-13T18:03:24.150326] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-13T18:03:24.417929] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-13T18:03:24.892491] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:03:25.217934] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-13T18:03:25.768013] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T18:03:26.017892] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-13T18:03:26.480541] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T18:03:26.817901] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-13T18:03:26.849537] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T18:03:27.617915] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-13T18:03:28.072482] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T18:03:28.417914] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-13T18:03:28.645702] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T18:03:29.217916] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-13T18:03:29.878006] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T18:03:30.017886] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-13T18:03:30.564158] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T18:03:30.786178] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T18:03:30.817881] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-13T18:03:31.617906] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-13T18:03:31.646019] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:03:32.417897] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-13T18:03:32.648222] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T18:03:33.217932] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-13T18:03:33.868160] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T18:03:34.017917] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-13T18:03:34.818002] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-13T18:03:35.048742] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T18:03:35.293540] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T18:03:35.296736] [INFO ] [REMOTE ] CLB: Full fetch complete (46431 records). [2025-10-13T18:03:35.296850] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-13T18:03:35.297509] [FATAL] [VALIDATOR ] CLB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:03:35.297623] [FATAL] [MAIN ] CLB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:03:35.297719] [WARN ] [MAIN ] CLB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:03:35.297791] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-13T18:03:35.297855] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-10-13T18:03:35.297891] [INFO ] [LOCAL ] CLB: Starting deletion of derivative data. [2025-10-13T18:03:35.297930] [DEBUG] [LOCAL ] CLB: No derivative data file found to delete. [2025-10-13T18:03:35.298024] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLB took 35.9s. Estimated remaining: 4h 22m 31s. Rate: 7.3 symbols/min [2025-10-13T18:03:35.477981] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:35.478181] [DEBUG] [LOCAL ] CLH: No existing data file found in primary storage. [2025-10-13T18:03:35.478218] [WARN ] [MAIN ] CLH: No existing data found, performing full refresh instead. [2025-10-13T18:03:35.478327] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-13T18:03:35.478367] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-13T18:03:35.478408] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-10-13T18:03:35.478439] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-13T18:03:35.620794] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-13T18:03:35.699111] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T18:03:35.736155] [INFO ] [REMOTE ] CLCO: Full fetch complete (22694 records). [2025-10-13T18:03:35.765796] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-13T18:03:36.034327] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:36.260168] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-13T18:03:36.260247] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-13T18:03:36.260824] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-13T18:03:36.260886] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-13T18:03:36.261470] [DEBUG] [LOCAL ] CLCO: Trimmed 22694 records to 12940 (keeping 200 days of data) [2025-10-13T18:03:36.334035] [DEBUG] [LOCAL ] CLCO: Primary data saved (12940 records). [2025-10-13T18:03:36.334182] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-13T18:03:36.334326] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLCO took 31.5s. Estimated remaining: 4h 21m 53s. Rate: 7.3 symbols/min [2025-10-13T18:03:36.424395] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-13T18:03:36.509149] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:36.519996] [DEBUG] [LOCAL ] CLPR: Loaded 10667 existing records from primary storage. [2025-10-13T18:03:36.520196] [INFO ] [MAIN ] CLPR: Loaded 10667 existing records. [2025-10-13T18:03:36.696703] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:03:36.696940] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-13T18:03:36.696988] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-13T18:03:36.697212] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-13T18:03:36.697293] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-13T18:03:37.052012] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:37.217903] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-13T18:03:37.389913] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:03:37.728880] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-13T18:03:38.017922] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-13T18:03:38.259476] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T18:03:38.817904] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-13T18:03:39.015197] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T18:03:39.617928] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-13T18:03:39.836907] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T18:03:40.417909] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-13T18:03:40.827846] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T18:03:41.217927] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-13T18:03:42.017923] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-13T18:03:42.296252] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T18:03:42.459836] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-13T18:03:42.817974] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-13T18:03:43.321260] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:03:43.617929] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-13T18:03:44.418092] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-13T18:03:44.719009] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T18:03:44.905581] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-13T18:03:45.043872] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-13T18:03:45.217915] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-13T18:03:46.017982] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-13T18:03:46.605357] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T18:03:46.817937] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-13T18:03:47.326929] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T18:03:47.330484] [INFO ] [REMOTE ] CLDT: Full fetch complete (37235 records). [2025-10-13T18:03:47.330585] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-13T18:03:47.518762] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T18:03:47.623310] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-13T18:03:47.729011] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-13T18:03:47.729110] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-13T18:03:47.729748] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-13T18:03:47.729813] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-13T18:03:47.730864] [DEBUG] [LOCAL ] CLDT: Trimmed 37235 records to 25453 (keeping 200 days of data) [2025-10-13T18:03:47.878424] [DEBUG] [LOCAL ] CLDT: Primary data saved (25453 records). [2025-10-13T18:03:47.878559] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-13T18:03:47.878695] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLDT took 30.6s. Estimated remaining: 4h 21m 58s. Rate: 7.3 symbols/min [2025-10-13T18:03:48.070548] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:03:48.124978] [DEBUG] [LOCAL ] CLS: Loaded 54367 existing records from primary storage. [2025-10-13T18:03:48.125348] [INFO ] [MAIN ] CLS: Loaded 54367 existing records. [2025-10-13T18:03:48.311572] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:03:48.311854] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-13T18:03:48.311903] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-13T18:03:48.312350] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-13T18:03:48.312412] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-13T18:03:48.423166] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-13T18:03:48.726935] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:03:49.097072] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T18:03:49.218062] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-13T18:03:50.017943] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-13T18:03:50.752085] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-13T18:03:50.813217] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-13T18:03:50.817879] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-13T18:03:51.324429] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T18:03:51.617921] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-13T18:03:51.638006] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T18:03:52.417912] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-13T18:03:53.218038] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-13T18:03:53.584965] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-13T18:03:53.795197] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T18:03:54.017905] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-13T18:03:54.484351] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-13T18:03:54.758699] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-13T18:03:54.817906] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-13T18:03:55.529496] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T18:03:55.617932] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-13T18:03:56.417932] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-13T18:03:57.217999] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-13T18:03:57.896382] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-13T18:03:58.008913] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T18:03:58.017873] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-13T18:03:58.294672] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T18:03:58.697726] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-13T18:03:58.817993] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-13T18:03:59.617931] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-13T18:03:59.906935] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T18:04:00.356251] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T18:04:00.358112] [INFO ] [REMOTE ] CLPR: Full fetch complete (16236 records). [2025-10-13T18:04:00.358204] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-13T18:04:00.358822] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:04:00.358934] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:04:00.358995] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:04:00.359080] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-13T18:04:00.359164] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-13T18:04:00.359250] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-13T18:04:00.359477] [DEBUG] [LOCAL ] CLPR: Deleted derivative data file. [2025-10-13T18:04:00.359590] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLPR took 24.0s. Estimated remaining: 4h 22m 7s. Rate: 7.3 symbols/min [2025-10-13T18:04:00.424053] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-13T18:04:00.546105] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:00.602467] [DEBUG] [LOCAL ] CLVT: Loaded 52731 existing records from primary storage. [2025-10-13T18:04:00.602788] [INFO ] [MAIN ] CLVT: Loaded 52731 existing records. [2025-10-13T18:04:00.790690] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:00.790939] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-13T18:04:00.790987] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-13T18:04:00.791441] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-13T18:04:00.791496] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-13T18:04:01.136451] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:01.217885] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-13T18:04:02.018002] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-13T18:04:02.818000] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-13T18:04:03.063190] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T18:04:03.102330] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-13T18:04:03.146920] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T18:04:03.617990] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-13T18:04:04.417924] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-13T18:04:04.992519] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-13T18:04:05.217947] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-13T18:04:05.513732] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T18:04:06.023131] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-13T18:04:06.044278] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-13T18:04:06.817905] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-13T18:04:07.279404] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T18:04:07.308725] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T18:04:07.617929] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-13T18:04:08.271625] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T18:04:08.417947] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-13T18:04:09.217921] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-13T18:04:09.594797] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T18:04:09.645703] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T18:04:10.017979] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-13T18:04:10.352066] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T18:04:10.817920] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-13T18:04:11.145128] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T18:04:11.148444] [INFO ] [REMOTE ] CLH: Full fetch complete (41821 records). [2025-10-13T18:04:11.148594] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-13T18:04:11.537286] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-13T18:04:11.537372] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-13T18:04:11.538004] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-13T18:04:11.538067] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-13T18:04:11.539172] [DEBUG] [LOCAL ] CLH: Trimmed 41821 records to 27824 (keeping 200 days of data) [2025-10-13T18:04:11.631305] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-13T18:04:11.720449] [DEBUG] [LOCAL ] CLH: Primary data saved (27824 records). [2025-10-13T18:04:11.720597] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-13T18:04:11.720691] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLH took 36.4s. Estimated remaining: 4h 22m 12s. Rate: 7.3 symbols/min [2025-10-13T18:04:11.917477] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:11.937539] [DEBUG] [LOCAL ] CLW: Loaded 21986 existing records from primary storage. [2025-10-13T18:04:11.937823] [INFO ] [MAIN ] CLW: Loaded 21986 existing records. [2025-10-13T18:04:12.115263] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:12.115596] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-13T18:04:12.115675] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-13T18:04:12.115871] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-13T18:04:12.115910] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-13T18:04:12.422498] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-13T18:04:12.475660] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:12.530587] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T18:04:13.218021] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-13T18:04:13.485753] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T18:04:13.491369] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-10-13T18:04:13.491516] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-13T18:04:13.888146] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-13T18:04:13.888241] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-13T18:04:13.889225] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-13T18:04:13.889296] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-13T18:04:13.890948] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 53741 (keeping 200 days of data) [2025-10-13T18:04:14.061288] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-13T18:04:14.223444] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-13T18:04:14.223594] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-13T18:04:14.223718] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLF took 53.6s. Estimated remaining: 4h 21m 40s. Rate: 7.3 symbols/min [2025-10-13T18:04:14.395737] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:14.447998] [DEBUG] [LOCAL ] CLX: Loaded 52350 existing records from primary storage. [2025-10-13T18:04:14.448358] [INFO ] [MAIN ] CLX: Loaded 52350 existing records. [2025-10-13T18:04:14.628576] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:14.628858] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-13T18:04:14.628984] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-13T18:04:14.629538] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-13T18:04:14.629613] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-13T18:04:15.018572] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:15.019182] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-13T18:04:15.050419] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-13T18:04:15.092679] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T18:04:15.263167] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T18:04:15.617907] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-13T18:04:16.417912] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-13T18:04:16.532821] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T18:04:17.169513] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T18:04:17.217884] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-13T18:04:18.017908] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-13T18:04:18.745261] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-13T18:04:18.790343] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T18:04:18.817886] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-13T18:04:18.989597] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T18:04:19.618012] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-13T18:04:20.417925] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-13T18:04:20.562429] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:04:21.217978] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-13T18:04:21.441634] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T18:04:22.026589] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-13T18:04:22.032194] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-13T18:04:22.817892] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-13T18:04:22.987380] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T18:04:23.210793] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-13T18:04:23.617919] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-13T18:04:24.417920] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-13T18:04:25.217890] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-13T18:04:25.350584] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-13T18:04:25.391639] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T18:04:25.609592] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T18:04:26.018016] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-13T18:04:26.786904] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:04:26.814282] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T18:04:26.817901] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-13T18:04:27.617968] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-13T18:04:28.418002] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-13T18:04:28.634908] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T18:04:29.217899] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-13T18:04:29.313854] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:04:29.319466] [INFO ] [REMOTE ] CLVT: Full fetch complete (75196 records). [2025-10-13T18:04:29.319600] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-13T18:04:29.765214] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-13T18:04:29.765315] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-13T18:04:29.766315] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-13T18:04:29.766382] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-13T18:04:29.768160] [DEBUG] [LOCAL ] CLVT: Trimmed 75196 records to 51978 (keeping 200 days of data) [2025-10-13T18:04:30.043142] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-13T18:04:30.079560] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T18:04:30.107111] [DEBUG] [LOCAL ] CLVT: Primary data saved (51978 records). [2025-10-13T18:04:30.107231] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-13T18:04:30.108099] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLVT took 29.7s. Estimated remaining: 4h 22m 3s. Rate: 7.3 symbols/min [2025-10-13T18:04:30.272569] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:30.319341] [DEBUG] [LOCAL ] CM: Loaded 49467 existing records from primary storage. [2025-10-13T18:04:30.319678] [INFO ] [MAIN ] CM: Loaded 49467 existing records. [2025-10-13T18:04:30.497571] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:30.498088] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-13T18:04:30.498227] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-13T18:04:30.498583] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-13T18:04:30.498676] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-13T18:04:30.772816] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-13T18:04:30.804686] [INFO ] [REMOTE ] CLS: Full fetch complete (77483 records). [2025-10-13T18:04:30.815120] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-13T18:04:30.820298] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-13T18:04:30.918087] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:31.263538] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-13T18:04:31.263627] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-13T18:04:31.264532] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-13T18:04:31.264587] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-13T18:04:31.266187] [DEBUG] [LOCAL ] CLS: Trimmed 77483 records to 53587 (keeping 200 days of data) [2025-10-13T18:04:31.590854] [DEBUG] [LOCAL ] CLS: Primary data saved (53587 records). [2025-10-13T18:04:31.591006] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-13T18:04:31.591103] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLS took 43.7s. Estimated remaining: 4h 21m 27s. Rate: 7.3 symbols/min [2025-10-13T18:04:31.623256] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-13T18:04:31.760081] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:31.810174] [DEBUG] [LOCAL ] CMA: Loaded 50699 existing records from primary storage. [2025-10-13T18:04:31.810502] [INFO ] [MAIN ] CMA: Loaded 50699 existing records. [2025-10-13T18:04:32.016931] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:32.018414] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-13T18:04:32.018787] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-13T18:04:32.019856] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-13T18:04:32.020026] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-13T18:04:32.193290] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T18:04:32.419033] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-13T18:04:32.442924] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:32.474232] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-13T18:04:33.081896] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:04:33.197009] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-13T18:04:33.217933] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-13T18:04:34.017923] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-13T18:04:34.783123] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:04:34.817890] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-13T18:04:35.617948] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-13T18:04:35.721137] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T18:04:36.207693] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T18:04:36.417886] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-13T18:04:37.217918] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-13T18:04:37.273561] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T18:04:38.017891] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-13T18:04:38.217296] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T18:04:38.823029] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-13T18:04:38.850762] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T18:04:39.617977] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-13T18:04:39.684663] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T18:04:39.824832] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T18:04:40.417992] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-13T18:04:41.157055] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T18:04:41.217918] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-13T18:04:41.370441] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T18:04:41.374199] [INFO ] [REMOTE ] CLW: Full fetch complete (34079 records). [2025-10-13T18:04:41.374446] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-13T18:04:41.885841] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-13T18:04:41.886000] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-13T18:04:41.886796] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-13T18:04:41.886865] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-13T18:04:41.888394] [DEBUG] [LOCAL ] CLW: Trimmed 34079 records to 21621 (keeping 200 days of data) [2025-10-13T18:04:42.020705] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-13T18:04:42.085574] [DEBUG] [LOCAL ] CLW: Primary data saved (21621 records). [2025-10-13T18:04:42.085795] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-13T18:04:42.085916] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLW took 30.4s. Estimated remaining: 4h 21m 28s. Rate: 7.3 symbols/min [2025-10-13T18:04:42.345991] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:42.371300] [DEBUG] [LOCAL ] CMBT: Loaded 25517 existing records from primary storage. [2025-10-13T18:04:42.371628] [INFO ] [MAIN ] CMBT: Loaded 25517 existing records. [2025-10-13T18:04:42.558635] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:42.558929] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-13T18:04:42.558978] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-13T18:04:42.559257] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-13T18:04:42.559314] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-13T18:04:42.820914] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-13T18:04:42.945817] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:42.971573] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T18:04:43.617900] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-13T18:04:43.669748] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T18:04:44.417914] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-13T18:04:44.470482] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T18:04:44.567569] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T18:04:45.217894] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-13T18:04:46.017929] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-13T18:04:46.179615] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T18:04:46.366068] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T18:04:46.817993] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-13T18:04:47.238180] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T18:04:47.617996] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-13T18:04:47.749394] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T18:04:48.417946] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-13T18:04:49.208781] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:04:49.219340] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-13T18:04:50.017899] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-13T18:04:50.176450] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T18:04:50.393057] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T18:04:50.817926] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-13T18:04:51.617935] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-13T18:04:51.702434] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T18:04:51.707704] [INFO ] [REMOTE ] CLX: Full fetch complete (73295 records). [2025-10-13T18:04:51.707821] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-13T18:04:52.094237] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-13T18:04:52.094341] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-13T18:04:52.095212] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-13T18:04:52.095274] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-13T18:04:52.096620] [DEBUG] [LOCAL ] CLX: Trimmed 73295 records to 51636 (keeping 200 days of data) [2025-10-13T18:04:52.418291] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-13T18:04:52.419282] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T18:04:52.469013] [DEBUG] [LOCAL ] CLX: Primary data saved (51636 records). [2025-10-13T18:04:52.469165] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-13T18:04:52.469246] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CLX took 38.2s. Estimated remaining: 4h 21m 28s. Rate: 7.3 symbols/min [2025-10-13T18:04:52.637387] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:04:52.677339] [DEBUG] [LOCAL ] CMC: Loaded 46065 existing records from primary storage. [2025-10-13T18:04:52.677625] [INFO ] [MAIN ] CMC: Loaded 46065 existing records. [2025-10-13T18:04:52.851909] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:04:52.852140] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-13T18:04:52.852186] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-13T18:04:52.852374] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-13T18:04:52.852429] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-13T18:04:53.217134] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:04:53.217882] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-13T18:04:53.229516] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T18:04:53.458764] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:04:54.017999] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-13T18:04:54.763240] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T18:04:54.818296] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-13T18:04:54.821341] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T18:04:55.617924] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-13T18:04:56.417928] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-13T18:04:56.449293] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T18:04:56.676692] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T18:04:57.217903] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-13T18:04:57.867620] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T18:04:58.017913] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-13T18:04:58.389141] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T18:04:58.817919] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-13T18:04:59.432738] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:04:59.455747] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T18:04:59.617923] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-13T18:05:00.417926] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-13T18:05:01.218015] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-13T18:05:01.301546] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T18:05:01.642385] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T18:05:02.018004] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-13T18:05:02.817905] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-13T18:05:03.071227] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T18:05:03.318076] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T18:05:03.617935] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-13T18:05:04.398109] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T18:05:04.417920] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-13T18:05:05.218024] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-13T18:05:05.375583] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T18:05:06.018035] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-13T18:05:06.201678] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T18:05:06.492549] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T18:05:06.817940] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-13T18:05:07.419684] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T18:05:07.424594] [INFO ] [REMOTE ] CMBT: Full fetch complete (32055 records). [2025-10-13T18:05:07.424740] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-13T18:05:07.623598] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-13T18:05:07.804486] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-13T18:05:07.804559] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-13T18:05:07.805085] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-13T18:05:07.805147] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-13T18:05:07.805923] [DEBUG] [LOCAL ] CMBT: Trimmed 32055 records to 25580 (keeping 200 days of data) [2025-10-13T18:05:07.960738] [DEBUG] [LOCAL ] CMBT: Primary data saved (25580 records). [2025-10-13T18:05:07.960879] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-13T18:05:07.960971] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMBT took 25.9s. Estimated remaining: 4h 21m 49s. Rate: 7.3 symbols/min [2025-10-13T18:05:08.153068] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:08.158666] [DEBUG] [LOCAL ] CMCM: Loaded 4862 existing records from primary storage. [2025-10-13T18:05:08.158811] [INFO ] [MAIN ] CMCM: Loaded 4862 existing records. [2025-10-13T18:05:08.341804] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:08.342296] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-13T18:05:08.342379] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-13T18:05:08.342777] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-13T18:05:08.342843] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-13T18:05:08.418894] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-13T18:05:08.711826] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:08.744714] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T18:05:09.217898] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-13T18:05:09.451735] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T18:05:09.458439] [INFO ] [REMOTE ] CM: Full fetch complete (69539 records). [2025-10-13T18:05:09.458742] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-13T18:05:09.768513] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T18:05:09.859361] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-13T18:05:09.859528] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-13T18:05:09.860486] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-13T18:05:09.860562] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-13T18:05:09.862134] [DEBUG] [LOCAL ] CM: Trimmed 69539 records to 48771 (keeping 200 days of data) [2025-10-13T18:05:10.003037] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T18:05:10.022717] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-13T18:05:10.217810] [DEBUG] [LOCAL ] CM: Primary data saved (48771 records). [2025-10-13T18:05:10.217997] [INFO ] [MAIN ] CM: Full history saved. [2025-10-13T18:05:10.218740] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CM took 40.1s. Estimated remaining: 4h 21m 17s. Rate: 7.3 symbols/min [2025-10-13T18:05:10.396132] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:10.396312] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-13T18:05:10.396350] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-13T18:05:10.396469] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-13T18:05:10.396510] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-13T18:05:10.396549] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-13T18:05:10.396582] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-13T18:05:10.748258] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:10.817892] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-13T18:05:11.013517] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:05:11.014027] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-13T18:05:11.014130] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:05:11.014180] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-13T18:05:11.014219] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:05:11.014262] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-13T18:05:11.014327] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-13T18:05:11.014365] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-13T18:05:11.014405] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-13T18:05:11.014460] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMDB took 0.8s. Estimated remaining: 4h 20m 38s. Rate: 7.3 symbols/min [2025-10-13T18:05:11.197104] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:11.252091] [DEBUG] [LOCAL ] CMG: Loaded 54500 existing records from primary storage. [2025-10-13T18:05:11.252425] [INFO ] [MAIN ] CMG: Loaded 54500 existing records. [2025-10-13T18:05:11.427510] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:11.427789] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-13T18:05:11.427836] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-13T18:05:11.428356] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-13T18:05:11.428411] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-13T18:05:11.618373] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-13T18:05:11.809026] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:11.835479] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T18:05:12.204980] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T18:05:12.417910] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-13T18:05:13.064589] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-13T18:05:13.217912] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-13T18:05:14.017945] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-13T18:05:14.514018] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T18:05:14.606302] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T18:05:14.817936] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-13T18:05:15.617911] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-13T18:05:16.199674] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T18:05:16.204465] [INFO ] [REMOTE ] CMA: Full fetch complete (72744 records). [2025-10-13T18:05:16.204600] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-13T18:05:16.205242] [FATAL] [VALIDATOR ] CMA: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:05:16.205341] [FATAL] [MAIN ] CMA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:05:16.205416] [WARN ] [MAIN ] CMA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:05:16.205510] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-13T18:05:16.205588] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-13T18:05:16.205624] [INFO ] [LOCAL ] CMA: Starting deletion of derivative data. [2025-10-13T18:05:16.205822] [DEBUG] [LOCAL ] CMA: Deleted derivative data file. [2025-10-13T18:05:16.205911] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMA took 44.6s. Estimated remaining: 4h 20m 18s. Rate: 7.3 symbols/min [2025-10-13T18:05:16.374750] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:16.412872] [DEBUG] [LOCAL ] CMI: Loaded 42226 existing records from primary storage. [2025-10-13T18:05:16.413167] [INFO ] [MAIN ] CMI: Loaded 42226 existing records. [2025-10-13T18:05:16.424316] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-13T18:05:16.595884] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:16.596117] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-13T18:05:16.596165] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-13T18:05:16.596462] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-13T18:05:16.596518] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-13T18:05:16.955470] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:17.175450] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T18:05:17.217934] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-13T18:05:18.017981] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-13T18:05:18.389665] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T18:05:18.552933] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T18:05:18.817944] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-13T18:05:19.320722] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T18:05:19.617928] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-13T18:05:20.417930] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-13T18:05:20.998436] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-13T18:05:21.080900] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T18:05:21.085594] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T18:05:21.217928] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-13T18:05:21.694382] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-13T18:05:22.017982] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-13T18:05:22.817926] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-13T18:05:23.617927] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-13T18:05:23.818567] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T18:05:24.150673] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T18:05:24.417906] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-13T18:05:24.525544] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T18:05:24.935001] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T18:05:25.218004] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-13T18:05:26.017993] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-13T18:05:26.818017] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-13T18:05:27.316757] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T18:05:27.321570] [INFO ] [REMOTE ] CMC: Full fetch complete (66841 records). [2025-10-13T18:05:27.321705] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-13T18:05:27.444457] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T18:05:27.619550] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-13T18:05:27.699342] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-13T18:05:27.785038] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-13T18:05:27.785119] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-13T18:05:27.785895] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-13T18:05:27.785957] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-13T18:05:27.787205] [DEBUG] [LOCAL ] CMC: Trimmed 66841 records to 45377 (keeping 200 days of data) [2025-10-13T18:05:28.054134] [DEBUG] [LOCAL ] CMC: Primary data saved (45377 records). [2025-10-13T18:05:28.054285] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-13T18:05:28.054382] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMC took 35.6s. Estimated remaining: 4h 20m 24s. Rate: 7.3 symbols/min [2025-10-13T18:05:28.220662] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:28.260483] [DEBUG] [LOCAL ] CMP: Loaded 36590 existing records from primary storage. [2025-10-13T18:05:28.261027] [INFO ] [MAIN ] CMP: Loaded 36590 existing records. [2025-10-13T18:05:28.422342] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-13T18:05:28.451388] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:28.453037] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-13T18:05:28.453946] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:05:28.453539] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-13T18:05:28.457161] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-13T18:05:28.457228] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-13T18:05:28.824163] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:29.217928] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-13T18:05:30.019461] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-13T18:05:30.022928] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:05:30.817918] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-13T18:05:31.226046] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T18:05:31.282221] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T18:05:31.617921] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-13T18:05:32.280352] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:05:32.417935] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-13T18:05:32.496834] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T18:05:32.498016] [INFO ] [REMOTE ] CMCM: Full fetch complete (6932 records). [2025-10-13T18:05:32.498098] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-13T18:05:32.855408] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-13T18:05:32.855486] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-13T18:05:32.855704] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-13T18:05:32.855767] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-13T18:05:32.856204] [DEBUG] [LOCAL ] CMCM: Trimmed 6932 records to 4858 (keeping 200 days of data) [2025-10-13T18:05:32.885254] [DEBUG] [LOCAL ] CMCM: Primary data saved (4858 records). [2025-10-13T18:05:32.885406] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-13T18:05:32.885537] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMCM took 24.9s. Estimated remaining: 4h 20m 2s. Rate: 7.3 symbols/min [2025-10-13T18:05:33.217944] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-13T18:05:33.939505] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T18:05:34.017932] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-13T18:05:34.681779] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:05:34.818140] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-13T18:05:35.617991] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-13T18:05:36.201163] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-13T18:05:36.423095] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-13T18:05:36.452096] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T18:05:36.956603] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T18:05:37.217904] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-13T18:05:38.017944] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-13T18:05:38.172305] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T18:05:38.493806] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T18:05:38.817928] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-13T18:05:39.139516] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T18:05:39.617938] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-13T18:05:40.417913] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-13T18:05:40.539024] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T18:05:40.863895] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T18:05:41.217988] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-13T18:05:42.018031] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-13T18:05:42.484981] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T18:05:42.824086] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-13T18:05:42.847328] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T18:05:43.283310] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:05:43.617936] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-13T18:05:44.417942] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-13T18:05:45.054163] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-13T18:05:45.231541] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-13T18:05:45.234096] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T18:05:45.649904] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T18:05:46.017926] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-13T18:05:46.817932] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-13T18:05:47.485270] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-13T18:05:47.593991] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T18:05:47.598892] [INFO ] [REMOTE ] CMI: Full fetch complete (60298 records). [2025-10-13T18:05:47.599052] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-13T18:05:47.633354] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-13T18:05:48.016967] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-13T18:05:48.017048] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-13T18:05:48.017784] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-13T18:05:48.017850] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-13T18:05:48.019140] [DEBUG] [LOCAL ] CMI: Trimmed 60298 records to 41651 (keeping 200 days of data) [2025-10-13T18:05:48.306089] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T18:05:48.323024] [DEBUG] [LOCAL ] CMI: Primary data saved (41651 records). [2025-10-13T18:05:48.323810] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-13T18:05:48.324092] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMI took 32.1s. Estimated remaining: 4h 20m 23s. Rate: 7.3 symbols/min [2025-10-13T18:05:48.324517] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-13T18:05:48.324869] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-13T18:05:48.680749] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T18:05:48.728530] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-13T18:05:48.823376] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-13T18:05:48.823458] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-13T18:05:48.824406] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-13T18:05:48.824471] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-13T18:05:48.827146] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53720 (keeping 200 days of data) [2025-10-13T18:05:49.143445] [DEBUG] [LOCAL ] CMG: Primary data saved (53720 records). [2025-10-13T18:05:49.143582] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-13T18:05:49.144350] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMG took 38.1s. Estimated remaining: 4h 19m 45s. Rate: 7.3 symbols/min [2025-10-13T18:05:50.138729] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T18:05:50.146079] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-13T18:05:51.406390] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T18:05:51.414517] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-13T18:05:52.657750] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T18:05:52.661225] [INFO ] [REMOTE ] CMP: Full fetch complete (51717 records). [2025-10-13T18:05:52.661346] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-13T18:05:53.037461] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-13T18:05:53.037552] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-13T18:05:53.038243] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-13T18:05:53.038307] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-13T18:05:53.039477] [DEBUG] [LOCAL ] CMP: Trimmed 51717 records to 35860 (keeping 200 days of data) [2025-10-13T18:05:53.249040] [DEBUG] [LOCAL ] CMP: Primary data saved (35860 records). [2025-10-13T18:05:53.249192] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-13T18:05:53.249291] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMP took 25.2s. Estimated remaining: 4h 19m 20s. Rate: 7.3 symbols/min [2025-10-13T18:05:53.917352] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:53.919044] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:53.914066] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:54.011858] [DEBUG] [LOCAL ] CMSA: Loaded 3556 existing records from primary storage. [2025-10-13T18:05:54.011535] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:05:54.012279] [INFO ] [MAIN ] CMSA: Loaded 3556 existing records. [2025-10-13T18:05:54.146953] [DEBUG] [LOCAL ] CMPO: Loaded 39544 existing records from primary storage. [2025-10-13T18:05:54.181368] [INFO ] [MAIN ] CMPO: Loaded 39544 existing records. [2025-10-13T18:05:54.272024] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:54.338117] [DEBUG] [LOCAL ] CMRE: Loaded 36148 existing records from primary storage. [2025-10-13T18:05:54.327612] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-13T18:05:54.357632] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-13T18:05:54.379840] [DEBUG] [LOCAL ] CMS: Loaded 53373 existing records from primary storage. [2025-10-13T18:05:54.362955] [INFO ] [MAIN ] CMRE: Loaded 36148 existing records. [2025-10-13T18:05:54.406997] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-13T18:05:54.414228] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-13T18:05:54.455538] [INFO ] [MAIN ] CMS: Loaded 53373 existing records. [2025-10-13T18:05:54.785912] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:54.830145] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-13T18:05:54.861317] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-13T18:05:54.925583] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-13T18:05:55.003232] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-13T18:05:55.040084] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:55.181713] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-13T18:05:55.227315] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:05:55.237417] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-13T18:05:55.296789] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-13T18:05:55.307290] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-13T18:05:55.318607] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-13T18:05:55.319030] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-13T18:05:55.342466] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-13T18:05:55.337194] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-13T18:05:55.720182] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:55.756708] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-13T18:05:56.226455] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:56.238804] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-13T18:05:56.469965] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:56.505233] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-13T18:05:56.526623] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:05:56.526955] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-13T18:05:56.663044] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T18:05:56.665434] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-13T18:05:57.222020] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T18:05:57.223755] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-13T18:05:57.494826] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T18:05:57.500298] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-13T18:05:57.618891] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T18:05:57.627224] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-13T18:05:57.690368] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T18:05:57.691601] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-13T18:05:57.939734] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T18:05:58.018025] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-13T18:05:58.058048] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T18:05:58.395310] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T18:05:58.817906] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-13T18:05:58.977200] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T18:05:59.618013] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-13T18:05:59.671895] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T18:05:59.901355] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:06:00.417929] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-13T18:06:01.115062] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T18:06:01.217929] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-13T18:06:01.783706] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T18:06:01.827394] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T18:06:02.018056] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-13T18:06:02.655194] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-13T18:06:02.817923] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-13T18:06:03.425263] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T18:06:03.617927] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-13T18:06:04.178508] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T18:06:04.417916] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-13T18:06:05.217928] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-13T18:06:06.019296] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-13T18:06:06.022035] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:06:06.491394] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T18:06:06.561328] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T18:06:06.818158] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-13T18:06:07.617930] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-13T18:06:08.124118] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-13T18:06:08.403989] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T18:06:08.417893] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-13T18:06:09.059995] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T18:06:09.061251] [INFO ] [REMOTE ] CMSA: Full fetch complete (5132 records). [2025-10-13T18:06:09.061334] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-13T18:06:09.220841] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-13T18:06:09.434399] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-13T18:06:09.434475] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-13T18:06:09.434638] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-13T18:06:09.434717] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-13T18:06:09.435086] [DEBUG] [LOCAL ] CMSA: Trimmed 5132 records to 3581 (keeping 200 days of data) [2025-10-13T18:06:09.458230] [DEBUG] [LOCAL ] CMSA: Primary data saved (3581 records). [2025-10-13T18:06:09.458376] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-13T18:06:09.458463] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSA took 16.2s. Estimated remaining: 4h 19m 44s. Rate: 7.3 symbols/min [2025-10-13T18:06:09.629808] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:06:09.636058] [DEBUG] [LOCAL ] CMSC: Loaded 5028 existing records from primary storage. [2025-10-13T18:06:09.636325] [INFO ] [MAIN ] CMSC: Loaded 5028 existing records. [2025-10-13T18:06:09.816984] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:06:09.817273] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-13T18:06:09.817340] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-13T18:06:09.817516] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-13T18:06:09.817571] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-13T18:06:10.023094] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-13T18:06:10.166422] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:06:10.818029] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-13T18:06:10.976184] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T18:06:11.209988] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T18:06:11.617971] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-13T18:06:12.417916] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-13T18:06:12.555293] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T18:06:12.619333] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T18:06:13.030601] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T18:06:13.217905] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-13T18:06:14.017923] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-13T18:06:14.610021] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T18:06:14.817899] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-13T18:06:15.057453] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:06:15.617917] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-13T18:06:15.961391] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T18:06:16.418004] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-13T18:06:16.965141] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T18:06:17.217933] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-13T18:06:17.502735] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T18:06:18.017915] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-13T18:06:18.700725] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T18:06:18.725866] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T18:06:18.817910] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-13T18:06:19.617994] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-13T18:06:20.417911] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-13T18:06:21.217911] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-13T18:06:21.252518] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T18:06:21.720278] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T18:06:22.017901] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-13T18:06:22.806252] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T18:06:22.817878] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-13T18:06:23.224184] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (4.41 seconds). [2025-10-13T18:06:23.584401] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T18:06:23.617934] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-13T18:06:24.057751] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T18:06:24.157921] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T18:06:24.417943] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-13T18:06:24.864277] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T18:06:25.217944] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-13T18:06:26.018011] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-13T18:06:26.815382] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T18:06:26.819839] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-13T18:06:27.335050] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T18:06:27.479635] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T18:06:27.618031] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-13T18:06:28.097810] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T18:06:28.417922] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-13T18:06:28.873636] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T18:06:29.217924] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-13T18:06:29.844567] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T18:06:29.845524] [INFO ] [REMOTE ] CMSC: Full fetch complete (7131 records). [2025-10-13T18:06:29.845592] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-13T18:06:30.034904] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-13T18:06:30.226374] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-13T18:06:30.226483] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-13T18:06:30.226831] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-13T18:06:30.226897] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-13T18:06:30.227346] [DEBUG] [LOCAL ] CMSC: Trimmed 7131 records to 4921 (keeping 200 days of data) [2025-10-13T18:06:30.257627] [DEBUG] [LOCAL ] CMSC: Primary data saved (4921 records). [2025-10-13T18:06:30.257776] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-13T18:06:30.257870] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSC took 20.8s. Estimated remaining: 4h 20m 25s. Rate: 7.3 symbols/min [2025-10-13T18:06:30.430281] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:06:30.440196] [DEBUG] [LOCAL ] CMSD: Loaded 8081 existing records from primary storage. [2025-10-13T18:06:30.440419] [INFO ] [MAIN ] CMSD: Loaded 8081 existing records. [2025-10-13T18:06:30.617892] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:06:30.618219] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-13T18:06:30.618268] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-13T18:06:30.618499] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-13T18:06:30.618557] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-13T18:06:30.823250] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-13T18:06:31.012584] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:06:31.617904] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-13T18:06:31.698790] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T18:06:32.051007] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T18:06:32.054996] [INFO ] [REMOTE ] CMRE: Full fetch complete (50792 records). [2025-10-13T18:06:32.055143] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-13T18:06:32.425757] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-13T18:06:32.446469] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-13T18:06:32.446789] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-13T18:06:32.447517] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-13T18:06:32.447600] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-13T18:06:32.457742] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T18:06:32.461824] [DEBUG] [LOCAL ] CMRE: Trimmed 50792 records to 35869 (keeping 200 days of data) [2025-10-13T18:06:32.678549] [DEBUG] [LOCAL ] CMRE: Primary data saved (35869 records). [2025-10-13T18:06:32.678728] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-13T18:06:32.678856] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMRE took 39.4s. Estimated remaining: 4h 19m 53s. Rate: 7.3 symbols/min [2025-10-13T18:06:32.853679] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:06:32.887212] [DEBUG] [LOCAL ] CMTG: Loaded 36633 existing records from primary storage. [2025-10-13T18:06:32.887529] [INFO ] [MAIN ] CMTG: Loaded 36633 existing records. [2025-10-13T18:06:33.064805] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:06:33.065065] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-13T18:06:33.065125] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-13T18:06:33.065460] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-13T18:06:33.065528] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-13T18:06:33.224244] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-13T18:06:33.448772] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:06:33.973561] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T18:06:33.975235] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T18:06:33.984444] [INFO ] [REMOTE ] CMS: Full fetch complete (75994 records). [2025-10-13T18:06:33.984573] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-13T18:06:34.022986] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-13T18:06:34.423166] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-13T18:06:34.423261] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-13T18:06:34.424171] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-13T18:06:34.424236] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-13T18:06:34.425813] [DEBUG] [LOCAL ] CMS: Trimmed 75994 records to 52606 (keeping 200 days of data) [2025-10-13T18:06:34.736196] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-13T18:06:34.758058] [DEBUG] [LOCAL ] CMS: Primary data saved (52606 records). [2025-10-13T18:06:34.758155] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-13T18:06:34.758990] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMS took 41.5s. Estimated remaining: 4h 19m 21s. Rate: 7.3 symbols/min [2025-10-13T18:06:34.823134] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-13T18:06:34.931823] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:06:34.940944] [DEBUG] [LOCAL ] CMU: Loaded 6399 existing records from primary storage. [2025-10-13T18:06:34.941181] [INFO ] [MAIN ] CMU: Loaded 6399 existing records. [2025-10-13T18:06:35.131329] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:06:35.131818] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-13T18:06:35.131876] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-13T18:06:35.132034] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-13T18:06:35.132089] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-13T18:06:35.486737] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:06:35.617902] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-13T18:06:36.260747] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:06:36.302958] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-13T18:06:36.417879] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-13T18:06:36.935989] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T18:06:37.217936] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-13T18:06:37.669892] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T18:06:38.017947] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-13T18:06:38.818014] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-13T18:06:39.168512] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T18:06:39.486705] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T18:06:39.617936] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-13T18:06:40.394973] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T18:06:40.417886] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-13T18:06:40.875270] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-13T18:06:41.217919] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-13T18:06:42.018015] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-13T18:06:42.542179] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T18:06:42.817926] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-13T18:06:43.377493] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T18:06:43.381312] [INFO ] [REMOTE ] CMPO: Full fetch complete (58631 records). [2025-10-13T18:06:43.381404] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-13T18:06:43.623047] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-13T18:06:43.801809] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-13T18:06:43.801913] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-13T18:06:43.802855] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-13T18:06:43.802935] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-13T18:06:43.804420] [DEBUG] [LOCAL ] CMPO: Trimmed 58631 records to 38915 (keeping 200 days of data) [2025-10-13T18:06:44.031722] [DEBUG] [LOCAL ] CMPO: Primary data saved (38915 records). [2025-10-13T18:06:44.031876] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-13T18:06:44.031961] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMPO took 50.8s. Estimated remaining: 4h 19m 17s. Rate: 7.3 symbols/min [2025-10-13T18:06:44.203666] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:06:44.203966] [DEBUG] [LOCAL ] CNA: No existing data file found in primary storage. [2025-10-13T18:06:44.204695] [WARN ] [MAIN ] CNA: No existing data found, performing full refresh instead. [2025-10-13T18:06:44.204896] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-13T18:06:44.204968] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-13T18:06:44.218348] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-13T18:06:44.218429] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-13T18:06:44.302218] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T18:06:44.419697] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-13T18:06:44.530304] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-13T18:06:44.608579] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:06:45.217917] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-13T18:06:45.566583] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T18:06:45.990017] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T18:06:46.017918] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-13T18:06:46.662156] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-13T18:06:46.817993] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-13T18:06:47.312085] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-13T18:06:47.617981] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-13T18:06:48.402105] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T18:06:48.418006] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-13T18:06:48.983330] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T18:06:49.217912] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-13T18:06:50.017925] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-13T18:06:50.548424] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T18:06:50.548238] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T18:06:50.817940] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-13T18:06:51.617932] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-13T18:06:52.193624] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T18:06:52.418009] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-13T18:06:52.549989] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T18:06:53.217940] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-13T18:06:53.948567] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:06:54.017919] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-13T18:06:54.416058] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T18:06:54.817924] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-13T18:06:55.274083] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T18:06:55.617943] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-13T18:06:55.703919] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-13T18:06:56.373221] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T18:06:56.418012] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-13T18:06:57.217973] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-13T18:06:57.423252] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T18:06:57.818589] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T18:06:58.017992] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-13T18:06:58.817983] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-13T18:06:59.062309] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T18:06:59.617899] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-13T18:06:59.903724] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T18:07:00.142690] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T18:07:00.417911] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-13T18:07:01.217904] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-13T18:07:01.362953] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T18:07:01.363940] [INFO ] [REMOTE ] CMU: Full fetch complete (9578 records). [2025-10-13T18:07:01.364007] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-13T18:07:01.743427] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-13T18:07:01.743527] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-13T18:07:01.743832] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-13T18:07:01.743894] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-13T18:07:01.744315] [DEBUG] [LOCAL ] CMU: Trimmed 9578 records to 6355 (keeping 200 days of data) [2025-10-13T18:07:01.785412] [DEBUG] [LOCAL ] CMU: Primary data saved (6355 records). [2025-10-13T18:07:01.785566] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-13T18:07:01.785676] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMU took 27.0s. Estimated remaining: 4h 19m 45s. Rate: 7.3 symbols/min [2025-10-13T18:07:01.895560] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T18:07:01.907986] [INFO ] [REMOTE ] CMSD: Full fetch complete (11917 records). [2025-10-13T18:07:01.918437] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-13T18:07:01.944206] [FATAL] [VALIDATOR ] CMSD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:07:01.971040] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:01.971205] [FATAL] [MAIN ] CMSD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:07:01.971411] [WARN ] [MAIN ] CMSD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:07:01.971498] [DEBUG] [LOCAL ] CNC: No existing data file found in primary storage. [2025-10-13T18:07:01.971631] [WARN ] [MAIN ] CNC: No existing data found, performing full refresh instead. [2025-10-13T18:07:01.971884] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-13T18:07:01.971954] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-13T18:07:01.972044] [DEBUG] [LOCAL ] CNC: No primary data file found to delete. [2025-10-13T18:07:01.972117] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-13T18:07:01.971721] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-13T18:07:02.019064] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-13T18:07:02.031717] [DEBUG] [LOCAL ] CMSD: No primary data file found to delete. [2025-10-13T18:07:02.041371] [INFO ] [LOCAL ] CMSD: Starting deletion of derivative data. [2025-10-13T18:07:02.059353] [DEBUG] [LOCAL ] CMSD: Deleted derivative data file. [2025-10-13T18:07:02.059600] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMSD took 31.8s. Estimated remaining: 4h 19m 6s. Rate: 7.3 symbols/min [2025-10-13T18:07:02.435001] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:02.502783] [DEBUG] [LOCAL ] CNF: Loaded 10690 existing records from primary storage. [2025-10-13T18:07:02.517142] [INFO ] [MAIN ] CNF: Loaded 10690 existing records. [2025-10-13T18:07:02.522484] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:02.694801] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:07:02.695091] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-13T18:07:02.695137] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-13T18:07:02.695348] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-13T18:07:02.695404] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-13T18:07:02.830607] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-13T18:07:03.042544] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:03.379166] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T18:07:03.617913] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-13T18:07:04.417930] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-13T18:07:04.612135] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T18:07:04.879960] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-13T18:07:05.217935] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-13T18:07:05.780054] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T18:07:05.853597] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:07:06.017932] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-13T18:07:06.817934] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-13T18:07:07.450580] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:07:07.617932] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-13T18:07:07.975359] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-13T18:07:08.417935] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-13T18:07:09.054234] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:07:09.218086] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-13T18:07:09.273192] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T18:07:10.017920] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-13T18:07:10.279402] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T18:07:10.817999] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-13T18:07:11.314493] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T18:07:11.548514] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T18:07:11.617925] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-13T18:07:12.417926] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-13T18:07:13.217897] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-13T18:07:13.394566] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T18:07:13.426708] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T18:07:14.017928] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-13T18:07:14.204295] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T18:07:14.207712] [INFO ] [REMOTE ] CNA: Full fetch complete (45836 records). [2025-10-13T18:07:14.207814] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-13T18:07:14.579382] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-13T18:07:14.579497] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-13T18:07:14.580124] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-13T18:07:14.580208] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-13T18:07:14.589161] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:07:14.592936] [DEBUG] [LOCAL ] CNA: Trimmed 45836 records to 32939 (keeping 200 days of data) [2025-10-13T18:07:14.790295] [DEBUG] [LOCAL ] CNA: Primary data saved (32939 records). [2025-10-13T18:07:14.790443] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-13T18:07:14.790518] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNA took 30.8s. Estimated remaining: 4h 19m 15s. Rate: 7.3 symbols/min [2025-10-13T18:07:14.823045] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-13T18:07:14.961757] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:14.961922] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-10-13T18:07:14.961961] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-10-13T18:07:14.962068] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-13T18:07:14.962115] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-13T18:07:14.962196] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-13T18:07:14.962246] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-13T18:07:15.311048] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:15.617915] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-13T18:07:16.005020] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T18:07:16.008232] [INFO ] [REMOTE ] CMTG: Full fetch complete (53323 records). [2025-10-13T18:07:16.008316] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-13T18:07:16.394140] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-13T18:07:16.394230] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-13T18:07:16.395084] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-13T18:07:16.395165] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-13T18:07:16.396637] [DEBUG] [LOCAL ] CMTG: Trimmed 53323 records to 35912 (keeping 200 days of data) [2025-10-13T18:07:16.440636] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-13T18:07:16.593762] [DEBUG] [LOCAL ] CMTG: Primary data saved (35912 records). [2025-10-13T18:07:16.593899] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-13T18:07:16.593978] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CMTG took 43.9s. Estimated remaining: 4h 18m 42s. Rate: 7.3 symbols/min [2025-10-13T18:07:16.759247] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:16.810917] [DEBUG] [LOCAL ] CNI: Loaded 52437 existing records from primary storage. [2025-10-13T18:07:16.811275] [INFO ] [MAIN ] CNI: Loaded 52437 existing records. [2025-10-13T18:07:16.983375] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:07:16.983630] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-13T18:07:16.983709] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-13T18:07:16.983976] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-13T18:07:16.984032] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-13T18:07:17.221958] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-13T18:07:17.266174] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T18:07:17.349487] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:17.588930] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T18:07:18.017928] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-13T18:07:18.817904] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-13T18:07:19.106270] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T18:07:19.399862] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T18:07:19.617943] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-13T18:07:19.862983] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T18:07:20.418005] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-13T18:07:20.604911] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T18:07:21.217922] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-13T18:07:22.017892] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-13T18:07:22.055246] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:07:22.782779] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T18:07:22.817935] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-13T18:07:23.145601] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T18:07:23.617977] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-13T18:07:24.275622] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:07:24.276952] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-13T18:07:24.417917] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-13T18:07:25.218023] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-13T18:07:25.534264] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T18:07:26.017941] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-13T18:07:26.824292] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-13T18:07:26.830308] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T18:07:27.617920] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-13T18:07:27.700072] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T18:07:28.408502] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T18:07:28.410306] [INFO ] [REMOTE ] CNF: Full fetch complete (13191 records). [2025-10-13T18:07:28.410387] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-13T18:07:28.423001] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-13T18:07:28.559411] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T18:07:28.818911] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-13T18:07:28.819025] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-13T18:07:28.819559] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-13T18:07:28.819689] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-13T18:07:28.820405] [DEBUG] [LOCAL ] CNF: Trimmed 13191 records to 10620 (keeping 200 days of data) [2025-10-13T18:07:28.884768] [DEBUG] [LOCAL ] CNF: Primary data saved (10620 records). [2025-10-13T18:07:28.884921] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-13T18:07:28.885008] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNF took 26.8s. Estimated remaining: 4h 18m 49s. Rate: 7.3 symbols/min [2025-10-13T18:07:29.050815] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:29.051004] [DEBUG] [LOCAL ] CNK: No existing data file found in primary storage. [2025-10-13T18:07:29.051041] [WARN ] [MAIN ] CNK: No existing data found, performing full refresh instead. [2025-10-13T18:07:29.051148] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-13T18:07:29.051188] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-13T18:07:29.051228] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-13T18:07:29.051259] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-13T18:07:29.224290] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-13T18:07:29.405154] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:30.017942] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-13T18:07:30.230190] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T18:07:30.817920] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-13T18:07:31.543344] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-13T18:07:31.599721] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:07:31.617892] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-13T18:07:32.417988] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-13T18:07:32.659600] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:07:33.217917] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-13T18:07:33.798266] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-13T18:07:34.017903] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-13T18:07:34.096485] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T18:07:34.673186] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T18:07:34.817913] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-13T18:07:35.617916] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-13T18:07:35.723636] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T18:07:36.417932] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-13T18:07:36.538601] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:07:37.086376] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T18:07:37.217912] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-13T18:07:37.889766] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T18:07:38.017988] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-13T18:07:38.828352] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-13T18:07:38.836945] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T18:07:39.617982] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-13T18:07:40.151599] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T18:07:40.292149] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-13T18:07:40.417948] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-13T18:07:41.028071] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-13T18:07:41.034074] [INFO ] [REMOTE ] CNC: Full fetch complete (77676 records). [2025-10-13T18:07:41.034243] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-13T18:07:41.223811] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-13T18:07:41.491098] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-13T18:07:41.491202] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-13T18:07:41.492219] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-13T18:07:41.492333] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-13T18:07:41.494245] [DEBUG] [LOCAL ] CNC: Trimmed 77676 records to 53764 (keeping 200 days of data) [2025-10-13T18:07:41.526621] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T18:07:41.872460] [DEBUG] [LOCAL ] CNC: Primary data saved (53764 records). [2025-10-13T18:07:41.872600] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-13T18:07:41.872695] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNC took 40.1s. Estimated remaining: 4h 18m 59s. Rate: 7.3 symbols/min [2025-10-13T18:07:42.031185] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-13T18:07:42.064801] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:42.112390] [DEBUG] [LOCAL ] CNM: Loaded 51806 existing records from primary storage. [2025-10-13T18:07:42.112920] [INFO ] [MAIN ] CNM: Loaded 51806 existing records. [2025-10-13T18:07:42.285036] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:07:42.285278] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-13T18:07:42.285325] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-13T18:07:42.285588] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-13T18:07:42.285625] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-13T18:07:42.630346] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:42.817918] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-13T18:07:42.859362] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:07:43.617922] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-13T18:07:43.890777] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T18:07:44.382370] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T18:07:44.417892] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-13T18:07:45.217987] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-13T18:07:45.280536] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T18:07:45.944519] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T18:07:46.017988] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-13T18:07:46.829121] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-13T18:07:46.835066] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T18:07:47.612109] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T18:07:47.617182] [INFO ] [REMOTE ] CNI: Full fetch complete (74567 records). [2025-10-13T18:07:47.617290] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-13T18:07:47.628967] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-13T18:07:48.022603] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-13T18:07:48.022708] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-13T18:07:48.023516] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-13T18:07:48.023557] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-13T18:07:48.024978] [DEBUG] [LOCAL ] CNI: Trimmed 74567 records to 51689 (keeping 200 days of data) [2025-10-13T18:07:48.340947] [DEBUG] [LOCAL ] CNI: Primary data saved (51689 records). [2025-10-13T18:07:48.341071] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-13T18:07:48.341149] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNI took 31.7s. Estimated remaining: 4h 18m 44s. Rate: 7.3 symbols/min [2025-10-13T18:07:48.420190] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-13T18:07:48.511146] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:07:48.511481] [DEBUG] [LOCAL ] CNMD: No existing data file found in primary storage. [2025-10-13T18:07:48.511548] [WARN ] [MAIN ] CNMD: No existing data found, performing full refresh instead. [2025-10-13T18:07:48.511885] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-13T18:07:48.511977] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-13T18:07:48.512111] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-13T18:07:48.512166] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-13T18:07:48.643602] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T18:07:48.919222] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:07:49.217970] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-13T18:07:49.322887] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-13T18:07:50.017933] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-13T18:07:50.404232] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T18:07:50.467507] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T18:07:50.817938] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-13T18:07:51.617937] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-13T18:07:51.901867] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T18:07:52.023055] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T18:07:52.418072] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-13T18:07:53.162034] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T18:07:53.217923] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-13T18:07:53.341157] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-13T18:07:54.018019] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-13T18:07:54.546784] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T18:07:54.817924] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-13T18:07:55.620878] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-13T18:07:55.626297] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T18:07:56.417899] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-13T18:07:56.701413] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T18:07:57.028927] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T18:07:57.217933] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-13T18:07:58.017983] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-13T18:07:58.104994] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T18:07:58.814192] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T18:07:58.827365] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-13T18:07:59.274955] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T18:07:59.617933] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-13T18:08:00.417914] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-13T18:08:00.640454] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-13T18:08:00.646196] [INFO ] [REMOTE ] CNH: Full fetch complete (77540 records). [2025-10-13T18:08:00.646331] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-13T18:08:01.026380] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-13T18:08:01.026462] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-13T18:08:01.027339] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-13T18:08:01.027405] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-13T18:08:01.037103] [DEBUG] [LOCAL ] CNH: Trimmed 77540 records to 53551 (keeping 200 days of data) [2025-10-13T18:08:01.219410] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-13T18:08:01.362043] [DEBUG] [LOCAL ] CNH: Primary data saved (53551 records). [2025-10-13T18:08:01.362180] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-13T18:08:01.362293] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNH took 46.6s. Estimated remaining: 4h 18m 54s. Rate: 7.3 symbols/min [2025-10-13T18:08:01.534378] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:01.572424] [DEBUG] [LOCAL ] CNNE: Loaded 36726 existing records from primary storage. [2025-10-13T18:08:01.572720] [INFO ] [MAIN ] CNNE: Loaded 36726 existing records. [2025-10-13T18:08:01.751420] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:01.751929] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-13T18:08:01.752146] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-13T18:08:01.752884] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-13T18:08:01.753257] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-13T18:08:02.100266] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-13T18:08:02.112301] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T18:08:02.211701] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:02.212681] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-13T18:08:02.544284] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T18:08:02.817925] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-13T18:08:03.535058] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T18:08:03.617943] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-13T18:08:04.417938] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-13T18:08:04.530924] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T18:08:04.576492] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T18:08:05.217989] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-13T18:08:05.764623] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T18:08:06.018032] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-13T18:08:06.823083] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-13T18:08:06.842617] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T18:08:07.237835] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T18:08:07.617894] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-13T18:08:08.417915] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-13T18:08:08.598468] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T18:08:08.959949] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T18:08:09.218016] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-13T18:08:10.017976] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-13T18:08:10.082710] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:08:10.273988] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T18:08:10.817984] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-13T18:08:11.052552] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T18:08:11.617931] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-13T18:08:12.196293] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T18:08:12.199628] [INFO ] [REMOTE ] CNMD: Full fetch complete (47223 records). [2025-10-13T18:08:12.199744] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-13T18:08:12.423278] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-13T18:08:12.583187] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-13T18:08:12.583268] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-13T18:08:12.583883] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-13T18:08:12.583947] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-13T18:08:12.584903] [DEBUG] [LOCAL ] CNMD: Trimmed 47223 records to 32170 (keeping 200 days of data) [2025-10-13T18:08:12.785797] [DEBUG] [LOCAL ] CNMD: Primary data saved (32170 records). [2025-10-13T18:08:12.785935] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-13T18:08:12.786007] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNMD took 24.4s. Estimated remaining: 4h 18m 58s. Rate: 7.2 symbols/min [2025-10-13T18:08:12.956300] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:12.995218] [DEBUG] [LOCAL ] CNO: Loaded 41472 existing records from primary storage. [2025-10-13T18:08:12.995516] [INFO ] [MAIN ] CNO: Loaded 41472 existing records. [2025-10-13T18:08:13.179301] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:13.179549] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-13T18:08:13.179604] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-13T18:08:13.180189] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-13T18:08:13.180251] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-13T18:08:13.218071] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-13T18:08:13.604416] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:13.643687] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-13T18:08:14.018012] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-13T18:08:14.087817] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T18:08:14.726790] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T18:08:14.732217] [INFO ] [REMOTE ] CNK: Full fetch complete (75897 records). [2025-10-13T18:08:14.732339] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-13T18:08:14.825781] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-13T18:08:15.127591] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-13T18:08:15.127737] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-13T18:08:15.128638] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-13T18:08:15.128741] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-13T18:08:15.130232] [DEBUG] [LOCAL ] CNK: Trimmed 75897 records to 52898 (keeping 200 days of data) [2025-10-13T18:08:15.267999] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T18:08:15.485308] [DEBUG] [LOCAL ] CNK: Primary data saved (52898 records). [2025-10-13T18:08:15.485439] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-13T18:08:15.485510] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNK took 46.6s. Estimated remaining: 4h 18m 28s. Rate: 7.3 symbols/min [2025-10-13T18:08:15.626848] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-13T18:08:15.658393] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:15.706374] [DEBUG] [LOCAL ] CNP: Loaded 54250 existing records from primary storage. [2025-10-13T18:08:15.706706] [INFO ] [MAIN ] CNP: Loaded 54250 existing records. [2025-10-13T18:08:15.879531] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:15.879785] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-13T18:08:15.879833] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-13T18:08:15.880145] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-13T18:08:15.880200] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-13T18:08:16.231741] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:16.275499] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T18:08:16.417931] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-13T18:08:17.217922] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-13T18:08:17.461730] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T18:08:17.466936] [INFO ] [REMOTE ] CNM: Full fetch complete (73581 records). [2025-10-13T18:08:17.467060] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-13T18:08:17.865504] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-13T18:08:17.865623] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-13T18:08:17.866627] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-13T18:08:17.866740] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-13T18:08:17.868595] [DEBUG] [LOCAL ] CNM: Trimmed 73581 records to 51013 (keeping 200 days of data) [2025-10-13T18:08:18.007506] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T18:08:18.020205] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-13T18:08:18.243955] [DEBUG] [LOCAL ] CNM: Primary data saved (51013 records). [2025-10-13T18:08:18.244285] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-13T18:08:18.245427] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNM took 36.4s. Estimated remaining: 4h 17m 59s. Rate: 7.3 symbols/min [2025-10-13T18:08:18.433848] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:18.509597] [DEBUG] [LOCAL ] CNQ: Loaded 54357 existing records from primary storage. [2025-10-13T18:08:18.510083] [INFO ] [MAIN ] CNQ: Loaded 54357 existing records. [2025-10-13T18:08:18.575611] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T18:08:18.697740] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:18.697961] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-13T18:08:18.698023] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-13T18:08:18.698302] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-13T18:08:18.698358] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-13T18:08:18.823143] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-13T18:08:19.051256] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:19.268316] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T18:08:19.618017] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-13T18:08:20.417972] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-13T18:08:20.641342] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T18:08:21.055475] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T18:08:21.217973] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-13T18:08:21.771022] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T18:08:22.017946] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-13T18:08:22.817977] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-13T18:08:22.953228] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T18:08:23.578081] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T18:08:23.617912] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-13T18:08:24.218119] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T18:08:24.417982] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-13T18:08:25.217976] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-13T18:08:25.257736] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:08:26.017915] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-13T18:08:26.104676] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:08:26.646892] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T18:08:26.817927] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-13T18:08:27.617992] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-13T18:08:27.855482] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T18:08:28.310235] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T18:08:28.417886] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-13T18:08:29.151132] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:08:29.217913] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-13T18:08:29.654343] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T18:08:30.017923] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-13T18:08:30.817904] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-13T18:08:31.022307] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T18:08:31.307106] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T18:08:31.618198] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-13T18:08:32.105610] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T18:08:32.417938] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-13T18:08:33.218010] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-13T18:08:33.286842] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T18:08:34.018040] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-13T18:08:34.242528] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T18:08:34.487893] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T18:08:34.817906] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-13T18:08:35.231628] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T18:08:35.618016] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-13T18:08:36.417941] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-13T18:08:36.587881] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T18:08:36.976017] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:08:37.218015] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-13T18:08:37.647478] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T18:08:38.017921] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-13T18:08:38.515379] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T18:08:38.520120] [INFO ] [REMOTE ] CNO: Full fetch complete (60580 records). [2025-10-13T18:08:38.520302] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-13T18:08:38.823188] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-13T18:08:38.931353] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-13T18:08:38.931463] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-13T18:08:38.932528] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-13T18:08:38.932623] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-13T18:08:38.934362] [DEBUG] [LOCAL ] CNO: Trimmed 60580 records to 40746 (keeping 200 days of data) [2025-10-13T18:08:39.199473] [DEBUG] [LOCAL ] CNO: Primary data saved (40746 records). [2025-10-13T18:08:39.199723] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-13T18:08:39.199829] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNO took 26.4s. Estimated remaining: 4h 18m 39s. Rate: 7.2 symbols/min [2025-10-13T18:08:39.377748] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:39.377994] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-13T18:08:39.378050] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-13T18:08:39.378178] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-13T18:08:39.378221] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-13T18:08:39.378265] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-13T18:08:39.378300] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-13T18:08:39.626771] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-13T18:08:39.762323] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:39.963684] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T18:08:40.417944] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-13T18:08:40.623704] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T18:08:41.040231] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T18:08:41.043999] [INFO ] [REMOTE ] CNNE: Full fetch complete (50242 records). [2025-10-13T18:08:41.044081] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-13T18:08:41.222422] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-13T18:08:41.429329] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-13T18:08:41.429419] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-13T18:08:41.430078] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-13T18:08:41.430141] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-13T18:08:41.431255] [DEBUG] [LOCAL ] CNNE: Trimmed 50242 records to 35998 (keeping 200 days of data) [2025-10-13T18:08:41.539776] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:08:41.542416] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-13T18:08:41.543520] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:08:41.544109] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-13T18:08:41.544744] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:08:41.545430] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-13T18:08:41.545893] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-13T18:08:41.546434] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-13T18:08:41.547820] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-13T18:08:41.549232] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNR took 2.3s. Estimated remaining: 4h 18m 8s. Rate: 7.3 symbols/min [2025-10-13T18:08:41.839532] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:41.844482] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-13T18:08:41.844637] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-13T18:08:41.844857] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-13T18:08:41.845664] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-13T18:08:41.846448] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-13T18:08:41.846933] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-13T18:08:41.947153] [DEBUG] [LOCAL ] CNNE: Primary data saved (35998 records). [2025-10-13T18:08:41.960018] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-13T18:08:41.960323] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNNE took 40.6s. Estimated remaining: 4h 17m 30s. Rate: 7.3 symbols/min [2025-10-13T18:08:42.026081] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-13T18:08:42.306867] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:42.498569] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-13T18:08:42.492455] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:42.551811] [DEBUG] [LOCAL ] CNX: Loaded 52074 existing records from primary storage. [2025-10-13T18:08:42.552277] [INFO ] [MAIN ] CNX: Loaded 52074 existing records. [2025-10-13T18:08:42.735508] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:42.735883] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-13T18:08:42.735938] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-13T18:08:42.736443] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-13T18:08:42.736502] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-13T18:08:42.823209] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-13T18:08:43.117620] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:43.617990] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-13T18:08:43.887228] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T18:08:43.909166] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T18:08:44.417912] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-13T18:08:45.165522] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T18:08:45.217976] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-13T18:08:46.017886] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-13T18:08:46.210063] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T18:08:46.817918] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-13T18:08:46.854859] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T18:08:47.137577] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:08:47.617930] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-13T18:08:48.369068] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:08:48.417893] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-13T18:08:48.684950] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T18:08:49.217921] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-13T18:08:49.918043] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T18:08:50.017979] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-13T18:08:50.817911] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-13T18:08:50.915459] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T18:08:51.352044] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T18:08:51.617980] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-13T18:08:51.833146] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T18:08:52.417930] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-13T18:08:53.031968] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T18:08:53.038043] [INFO ] [REMOTE ] CNP: Full fetch complete (77365 records). [2025-10-13T18:08:53.038197] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-13T18:08:53.220059] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-13T18:08:53.433737] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-13T18:08:53.433826] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-13T18:08:53.434714] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-13T18:08:53.434778] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-13T18:08:53.436263] [DEBUG] [LOCAL ] CNP: Trimmed 77365 records to 53480 (keeping 200 days of data) [2025-10-13T18:08:53.811363] [DEBUG] [LOCAL ] CNP: Primary data saved (53480 records). [2025-10-13T18:08:53.811517] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-13T18:08:53.811665] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNP took 38.3s. Estimated remaining: 4h 17m 36s. Rate: 7.3 symbols/min [2025-10-13T18:08:54.014985] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:54.018078] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-13T18:08:54.054418] [DEBUG] [LOCAL ] CODI: Loaded 41380 existing records from primary storage. [2025-10-13T18:08:54.054782] [INFO ] [MAIN ] CODI: Loaded 41380 existing records. [2025-10-13T18:08:54.296631] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:54.297405] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-13T18:08:54.297474] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-13T18:08:54.300270] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-13T18:08:54.300186] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T18:08:54.300458] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-13T18:08:54.698990] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:54.817919] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-13T18:08:54.947971] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T18:08:54.953534] [INFO ] [REMOTE ] CNQ: Full fetch complete (77556 records). [2025-10-13T18:08:54.953732] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-13T18:08:55.153758] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T18:08:55.388581] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-13T18:08:55.388734] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-13T18:08:55.389897] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-13T18:08:55.389964] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-13T18:08:55.392154] [DEBUG] [LOCAL ] CNQ: Trimmed 77556 records to 53583 (keeping 200 days of data) [2025-10-13T18:08:55.618133] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-13T18:08:55.753171] [DEBUG] [LOCAL ] CNQ: Primary data saved (53583 records). [2025-10-13T18:08:55.753435] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-13T18:08:55.754736] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNQ took 37.5s. Estimated remaining: 4h 17m 4s. Rate: 7.3 symbols/min [2025-10-13T18:08:55.939775] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:08:56.007125] [DEBUG] [LOCAL ] COF: Loaded 54392 existing records from primary storage. [2025-10-13T18:08:56.007573] [INFO ] [MAIN ] COF: Loaded 54392 existing records. [2025-10-13T18:08:56.198108] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:08:56.198379] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-13T18:08:56.198433] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-13T18:08:56.199098] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-13T18:08:56.199158] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-13T18:08:56.420670] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-13T18:08:56.602605] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:08:56.611586] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:08:56.654138] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:08:57.217936] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-13T18:08:57.714570] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T18:08:58.017901] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-13T18:08:58.078709] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T18:08:58.817998] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-13T18:08:59.617897] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-13T18:08:59.675461] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T18:08:59.762912] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T18:09:00.417940] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-13T18:09:00.708671] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T18:09:01.217919] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-13T18:09:01.396841] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T18:09:02.017944] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-13T18:09:02.817987] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-13T18:09:02.972238] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T18:09:03.416419] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T18:09:03.617971] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-13T18:09:03.755909] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T18:09:04.418032] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-13T18:09:05.069080] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T18:09:05.217920] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-13T18:09:05.811248] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T18:09:06.017990] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-13T18:09:06.817903] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-13T18:09:06.992615] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T18:09:07.590509] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T18:09:07.617898] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-13T18:09:08.191722] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T18:09:08.417986] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-13T18:09:09.218028] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-13T18:09:09.433560] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T18:09:09.436716] [INFO ] [REMOTE ] CNS: Full fetch complete (30510 records). [2025-10-13T18:09:09.436801] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-13T18:09:09.660221] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T18:09:09.952528] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-13T18:09:09.952634] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-13T18:09:09.953471] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-13T18:09:09.953521] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-13T18:09:09.954587] [DEBUG] [LOCAL ] CNS: Trimmed 30510 records to 21008 (keeping 200 days of data) [2025-10-13T18:09:10.025846] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-13T18:09:10.111109] [DEBUG] [LOCAL ] CNS: Primary data saved (21008 records). [2025-10-13T18:09:10.111310] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-13T18:09:10.111413] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CNS took 28.6s. Estimated remaining: 4h 17m 18s. Rate: 7.3 symbols/min [2025-10-13T18:09:10.300769] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:10.360250] [DEBUG] [LOCAL ] COHR: Loaded 54151 existing records from primary storage. [2025-10-13T18:09:10.360772] [INFO ] [MAIN ] COHR: Loaded 54151 existing records. [2025-10-13T18:09:10.562346] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:09:10.562993] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-13T18:09:10.563177] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-13T18:09:10.563797] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-13T18:09:10.563859] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-13T18:09:10.698330] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T18:09:10.823147] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-13T18:09:10.964233] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:11.617932] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-13T18:09:11.772470] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T18:09:12.298482] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T18:09:12.417910] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-13T18:09:13.217943] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-13T18:09:13.565415] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T18:09:14.017984] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-13T18:09:14.120127] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T18:09:14.817932] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-13T18:09:14.847398] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:09:15.617906] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-13T18:09:15.655055] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:09:16.413215] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T18:09:16.421974] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-13T18:09:17.217921] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-13T18:09:17.539604] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-13T18:09:18.017931] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-13T18:09:18.071697] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T18:09:18.817982] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-13T18:09:19.338084] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-13T18:09:19.617915] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-13T18:09:19.952206] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-13T18:09:20.327534] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T18:09:20.332942] [INFO ] [REMOTE ] CNX: Full fetch complete (74727 records). [2025-10-13T18:09:20.333053] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-13T18:09:20.423853] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-13T18:09:20.725589] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-13T18:09:20.725730] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-13T18:09:20.726669] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-13T18:09:20.726732] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-13T18:09:20.728285] [DEBUG] [LOCAL ] CNX: Trimmed 74727 records to 51343 (keeping 200 days of data) [2025-10-13T18:09:21.025261] [DEBUG] [LOCAL ] CNX: Primary data saved (51343 records). [2025-10-13T18:09:21.025397] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-13T18:09:21.025479] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CNX took 39.1s. Estimated remaining: 4h 17m 20s. Rate: 7.3 symbols/min [2025-10-13T18:09:21.194302] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:21.194541] [DEBUG] [LOCAL ] COLD: No existing data file found in primary storage. [2025-10-13T18:09:21.194635] [WARN ] [MAIN ] COLD: No existing data found, performing full refresh instead. [2025-10-13T18:09:21.194835] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-13T18:09:21.194889] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-13T18:09:21.194933] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-13T18:09:21.194966] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-13T18:09:21.225041] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-13T18:09:21.570018] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:21.628963] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-13T18:09:21.898033] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T18:09:22.017924] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-13T18:09:22.817890] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-13T18:09:23.243115] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-13T18:09:23.543682] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T18:09:23.549802] [INFO ] [REMOTE ] CODI: Full fetch complete (52100 records). [2025-10-13T18:09:23.549952] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-13T18:09:23.623051] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-13T18:09:24.031905] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-13T18:09:24.032022] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-13T18:09:24.033038] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-13T18:09:24.033130] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-13T18:09:24.034832] [DEBUG] [LOCAL ] CODI: Trimmed 52100 records to 41051 (keeping 200 days of data) [2025-10-13T18:09:24.346557] [DEBUG] [LOCAL ] CODI: Primary data saved (41051 records). [2025-10-13T18:09:24.346766] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-13T18:09:24.346895] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. CODI took 30.5s. Estimated remaining: 4h 16m 53s. Rate: 7.3 symbols/min [2025-10-13T18:09:24.424562] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-13T18:09:24.583404] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:24.583872] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-10-13T18:09:24.583943] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-10-13T18:09:24.584309] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-13T18:09:24.584421] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-13T18:09:24.584746] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-13T18:09:24.584834] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-13T18:09:25.035564] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:25.082729] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-13T18:09:25.217980] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-13T18:09:25.375144] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T18:09:26.017907] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-13T18:09:26.513168] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-13T18:09:26.817999] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-13T18:09:26.960361] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T18:09:27.512444] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T18:09:27.617925] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-13T18:09:28.417905] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-13T18:09:28.555044] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T18:09:29.217896] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-13T18:09:29.593015] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T18:09:30.017970] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-13T18:09:30.160336] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T18:09:30.453248] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T18:09:30.818026] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-13T18:09:31.617926] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-13T18:09:31.717613] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T18:09:32.201890] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T18:09:32.417905] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-13T18:09:33.192931] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T18:09:33.198638] [INFO ] [REMOTE ] COF: Full fetch complete (77447 records). [2025-10-13T18:09:33.198906] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-13T18:09:33.231230] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-13T18:09:33.289540] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T18:09:33.689065] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-13T18:09:33.689151] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-13T18:09:33.690094] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-13T18:09:33.690160] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-13T18:09:33.691782] [DEBUG] [LOCAL ] COF: Trimmed 77447 records to 53614 (keeping 200 days of data) [2025-10-13T18:09:34.020054] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-13T18:09:34.067614] [DEBUG] [LOCAL ] COF: Primary data saved (53614 records). [2025-10-13T18:09:34.067784] [INFO ] [MAIN ] COF: Full history saved. [2025-10-13T18:09:34.068887] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COF took 38.3s. Estimated remaining: 4h 16m 51s. Rate: 7.3 symbols/min [2025-10-13T18:09:34.268265] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:34.316916] [DEBUG] [LOCAL ] CON: Loaded 39376 existing records from primary storage. [2025-10-13T18:09:34.317232] [INFO ] [MAIN ] CON: Loaded 39376 existing records. [2025-10-13T18:09:34.522132] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:09:34.522447] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-13T18:09:34.522523] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-13T18:09:34.523000] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-13T18:09:34.523058] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-13T18:09:34.829495] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-13T18:09:34.916163] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:35.165793] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T18:09:35.617932] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-13T18:09:35.863008] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T18:09:36.336058] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:09:36.417939] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-13T18:09:37.218055] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-13T18:09:38.020402] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-13T18:09:38.018940] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-13T18:09:38.045803] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:09:38.520254] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T18:09:38.817932] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-13T18:09:39.618002] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-13T18:09:39.771266] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T18:09:40.418000] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-13T18:09:40.917242] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-13T18:09:41.217923] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-13T18:09:41.480613] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T18:09:42.017998] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-13T18:09:42.117901] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:09:42.542531] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T18:09:42.818016] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-13T18:09:43.617945] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-13T18:09:43.925826] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T18:09:43.983264] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-13T18:09:43.988932] [INFO ] [REMOTE ] COHR: Full fetch complete (77210 records). [2025-10-13T18:09:43.989090] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-13T18:09:44.385314] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-13T18:09:44.385442] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-13T18:09:44.386378] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-13T18:09:44.386443] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-13T18:09:44.388038] [DEBUG] [LOCAL ] COHR: Trimmed 77210 records to 53380 (keeping 200 days of data) [2025-10-13T18:09:44.437743] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-13T18:09:44.709863] [DEBUG] [LOCAL ] COHR: Primary data saved (53380 records). [2025-10-13T18:09:44.709989] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-13T18:09:44.710230] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COHR took 34.6s. Estimated remaining: 4h 16m 51s. Rate: 7.3 symbols/min [2025-10-13T18:09:44.880400] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:44.904003] [DEBUG] [LOCAL ] COOK: Loaded 24888 existing records from primary storage. [2025-10-13T18:09:44.904243] [INFO ] [MAIN ] COOK: Loaded 24888 existing records. [2025-10-13T18:09:45.085717] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:09:45.086095] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-13T18:09:45.086390] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-13T18:09:45.087114] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-13T18:09:45.087279] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-13T18:09:45.220313] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-13T18:09:45.335694] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:09:45.488593] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:45.899787] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T18:09:46.017916] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-13T18:09:46.688490] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T18:09:46.817909] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-13T18:09:47.471885] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T18:09:47.617908] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-13T18:09:48.317467] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T18:09:48.417883] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-13T18:09:49.217974] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-13T18:09:49.329608] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T18:09:49.575454] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T18:09:50.018008] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-13T18:09:50.825782] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-13T18:09:50.845856] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T18:09:51.393090] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T18:09:51.617936] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-13T18:09:52.417900] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-13T18:09:52.453173] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T18:09:53.218097] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-13T18:09:53.223751] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T18:09:53.667924] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T18:09:54.018008] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-13T18:09:54.755337] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T18:09:54.760698] [INFO ] [REMOTE ] COLD: Full fetch complete (74509 records). [2025-10-13T18:09:54.760817] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-13T18:09:54.823019] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-13T18:09:55.151451] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-13T18:09:55.151555] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-13T18:09:55.152403] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-13T18:09:55.152467] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-13T18:09:55.153984] [DEBUG] [LOCAL ] COLD: Trimmed 74509 records to 52362 (keeping 200 days of data) [2025-10-13T18:09:55.290796] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T18:09:55.492589] [DEBUG] [LOCAL ] COLD: Primary data saved (52362 records). [2025-10-13T18:09:55.492745] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-13T18:09:55.492824] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COLD took 34.5s. Estimated remaining: 4h 16m 52s. Rate: 7.3 symbols/min [2025-10-13T18:09:55.623093] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-13T18:09:55.665831] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:55.715784] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-10-13T18:09:55.716094] [INFO ] [MAIN ] COP: Loaded 54507 existing records. [2025-10-13T18:09:55.891836] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:09:55.892080] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-13T18:09:55.892125] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-13T18:09:55.892520] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-13T18:09:55.892576] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-13T18:09:56.239754] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:09:56.417946] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-13T18:09:56.770486] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T18:09:57.031222] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T18:09:57.217912] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-13T18:09:58.017936] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-13T18:09:58.060264] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:09:58.706534] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T18:09:58.712814] [INFO ] [REMOTE ] COMP: Full fetch complete (77207 records). [2025-10-13T18:09:58.712989] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-13T18:09:58.823115] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-13T18:09:59.120595] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-13T18:09:59.120744] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-13T18:09:59.121897] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-13T18:09:59.121965] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-13T18:09:59.124029] [DEBUG] [LOCAL ] COMP: Trimmed 77207 records to 53405 (keeping 200 days of data) [2025-10-13T18:09:59.230130] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T18:09:59.483604] [DEBUG] [LOCAL ] COMP: Primary data saved (53405 records). [2025-10-13T18:09:59.483869] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-13T18:09:59.483967] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. COMP took 35.1s. Estimated remaining: 4h 16m 28s. Rate: 7.3 symbols/min [2025-10-13T18:09:59.631138] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-13T18:09:59.665183] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:09:59.717346] [DEBUG] [LOCAL ] COR: Loaded 47440 existing records from primary storage. [2025-10-13T18:09:59.717887] [INFO ] [MAIN ] COR: Loaded 47440 existing records. [2025-10-13T18:09:59.904142] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:09:59.904444] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-13T18:09:59.904496] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-13T18:09:59.904990] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-13T18:09:59.905049] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-13T18:10:00.284598] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:00.417926] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-13T18:10:01.067391] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-13T18:10:01.217911] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-13T18:10:01.320032] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T18:10:01.334283] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-13T18:10:02.017992] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-13T18:10:02.817998] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-13T18:10:02.986059] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T18:10:03.617944] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-13T18:10:03.669525] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T18:10:03.674407] [INFO ] [REMOTE ] CON: Full fetch complete (56662 records). [2025-10-13T18:10:03.674512] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-13T18:10:04.064880] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T18:10:04.090886] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-13T18:10:04.090992] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-13T18:10:04.091826] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-13T18:10:04.091895] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-13T18:10:04.093327] [DEBUG] [LOCAL ] CON: Trimmed 56662 records to 38882 (keeping 200 days of data) [2025-10-13T18:10:04.331600] [DEBUG] [LOCAL ] CON: Primary data saved (38882 records). [2025-10-13T18:10:04.331776] [INFO ] [MAIN ] CON: Full history saved. [2025-10-13T18:10:04.332521] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. CON took 30.3s. Estimated remaining: 4h 16m 7s. Rate: 7.3 symbols/min [2025-10-13T18:10:04.423047] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-13T18:10:04.517564] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:10:04.517771] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-10-13T18:10:04.517816] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-10-13T18:10:04.517925] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-13T18:10:04.518003] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-13T18:10:04.518061] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-13T18:10:04.518096] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-13T18:10:04.904225] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:05.179417] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T18:10:05.217887] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-13T18:10:06.017931] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-13T18:10:06.795323] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-13T18:10:06.817885] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-13T18:10:07.002790] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T18:10:07.131465] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T18:10:07.617918] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-13T18:10:08.417894] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-13T18:10:08.755315] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T18:10:08.868548] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T18:10:09.217932] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-13T18:10:10.017985] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-13T18:10:10.200670] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T18:10:10.818039] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-13T18:10:11.305589] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T18:10:11.350445] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-13T18:10:11.618009] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-13T18:10:12.126399] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T18:10:12.417919] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-13T18:10:12.991761] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T18:10:13.218051] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-13T18:10:14.017917] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-13T18:10:14.367945] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T18:10:14.400714] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T18:10:14.817912] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-13T18:10:15.617934] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-13T18:10:16.012014] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-13T18:10:16.418010] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-13T18:10:16.733082] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-13T18:10:17.218015] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-13T18:10:17.464385] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T18:10:18.017928] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-13T18:10:18.322782] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T18:10:18.740690] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T18:10:18.817901] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-13T18:10:19.484158] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T18:10:19.617921] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-13T18:10:20.417895] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-13T18:10:20.673582] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T18:10:21.218021] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-13T18:10:21.426501] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T18:10:22.018016] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-13T18:10:22.266240] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T18:10:22.357143] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-13T18:10:22.817936] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-13T18:10:23.617910] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-13T18:10:23.824858] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T18:10:23.855464] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-13T18:10:24.417916] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-13T18:10:25.141477] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T18:10:25.217934] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-13T18:10:26.017899] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-13T18:10:26.295958] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T18:10:26.818006] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-13T18:10:26.887451] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:10:27.618078] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-13T18:10:27.793608] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T18:10:27.930050] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T18:10:27.933153] [INFO ] [REMOTE ] COOK: Full fetch complete (32906 records). [2025-10-13T18:10:27.933229] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-13T18:10:28.295958] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-13T18:10:28.296058] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-13T18:10:28.296583] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-13T18:10:28.296623] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-13T18:10:28.297378] [DEBUG] [LOCAL ] COOK: Trimmed 32906 records to 24847 (keeping 200 days of data) [2025-10-13T18:10:28.420531] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-13T18:10:28.435070] [DEBUG] [LOCAL ] COOK: Primary data saved (24847 records). [2025-10-13T18:10:28.435195] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-13T18:10:28.435343] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COOK took 43.7s. Estimated remaining: 4h 16m 57s. Rate: 7.2 symbols/min [2025-10-13T18:10:28.600758] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:10:28.643704] [DEBUG] [LOCAL ] COUR: Loaded 49778 existing records from primary storage. [2025-10-13T18:10:28.644021] [INFO ] [MAIN ] COUR: Loaded 49778 existing records. [2025-10-13T18:10:28.821018] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:10:28.821230] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-13T18:10:28.821283] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-13T18:10:28.821686] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-13T18:10:28.821742] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-13T18:10:29.178936] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:29.192807] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T18:10:29.198508] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-10-13T18:10:29.222333] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-13T18:10:29.214292] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-13T18:10:29.228421] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T18:10:29.620038] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-13T18:10:29.620115] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-13T18:10:29.620975] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-13T18:10:29.621037] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-13T18:10:29.622420] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 53727 (keeping 200 days of data) [2025-10-13T18:10:29.945956] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-10-13T18:10:29.946088] [INFO ] [MAIN ] COP: Full history saved. [2025-10-13T18:10:29.946164] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COP took 34.5s. Estimated remaining: 4h 16m 24s. Rate: 7.3 symbols/min [2025-10-13T18:10:30.023071] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-13T18:10:30.113116] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:10:30.163186] [DEBUG] [LOCAL ] CP: Loaded 54043 existing records from primary storage. [2025-10-13T18:10:30.163485] [INFO ] [MAIN ] CP: Loaded 54043 existing records. [2025-10-13T18:10:30.335922] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:10:30.336098] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-13T18:10:30.336143] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-13T18:10:30.336404] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-13T18:10:30.336459] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-13T18:10:30.685022] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:30.817884] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-13T18:10:30.922024] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:10:31.617899] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-13T18:10:31.645061] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T18:10:32.417894] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-13T18:10:32.481852] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T18:10:33.217901] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-13T18:10:33.262405] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T18:10:33.966185] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:10:34.017915] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-13T18:10:34.817907] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-13T18:10:34.870583] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T18:10:35.496634] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T18:10:35.617929] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-13T18:10:36.417925] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-13T18:10:36.441627] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T18:10:36.447111] [INFO ] [REMOTE ] COTY: Full fetch complete (77117 records). [2025-10-13T18:10:36.447248] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-13T18:10:36.854968] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-13T18:10:36.855055] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-13T18:10:36.856007] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-13T18:10:36.856099] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-13T18:10:36.857775] [DEBUG] [LOCAL ] COTY: Trimmed 77117 records to 53263 (keeping 200 days of data) [2025-10-13T18:10:37.174112] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T18:10:37.187006] [DEBUG] [LOCAL ] COTY: Primary data saved (53263 records). [2025-10-13T18:10:37.187156] [INFO ] [REMOTE ] COR: Full fetch complete (68238 records). [2025-10-13T18:10:37.187380] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-13T18:10:37.187602] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COTY took 32.9s. Estimated remaining: 4h 16m 12s. Rate: 7.3 symbols/min [2025-10-13T18:10:37.187506] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-13T18:10:37.218927] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-13T18:10:37.230636] [FATAL] [VALIDATOR ] COR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:10:37.257693] [FATAL] [MAIN ] COR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:10:37.269714] [WARN ] [MAIN ] COR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:10:37.290821] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-13T18:10:37.293336] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-13T18:10:37.293394] [INFO ] [LOCAL ] COR: Starting deletion of derivative data. [2025-10-13T18:10:37.299173] [DEBUG] [LOCAL ] COR: Deleted derivative data file. [2025-10-13T18:10:37.299332] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. COR took 37.8s. Estimated remaining: 4h 15m 34s. Rate: 7.3 symbols/min [2025-10-13T18:10:37.478586] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:10:37.554881] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:10:37.555184] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-13T18:10:37.555242] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-13T18:10:37.555354] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-13T18:10:37.555396] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-13T18:10:37.555438] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-13T18:10:37.555472] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-13T18:10:37.751802] [DEBUG] [LOCAL ] CPA: Loaded 28742 existing records from primary storage. [2025-10-13T18:10:37.817471] [INFO ] [MAIN ] CPA: Loaded 28742 existing records. [2025-10-13T18:10:38.090258] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:38.131356] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-13T18:10:38.169820] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:10:38.170308] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-13T18:10:38.170420] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-13T18:10:38.170832] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-13T18:10:38.171304] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-13T18:10:38.490992] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-13T18:10:38.627310] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:10:38.690105] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T18:10:38.796926] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T18:10:38.817886] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-13T18:10:39.171619] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-13T18:10:39.617912] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-13T18:10:40.417931] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-13T18:10:41.127142] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:10:41.217891] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-13T18:10:41.866370] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T18:10:42.017916] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-13T18:10:42.361961] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-13T18:10:42.785575] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T18:10:42.817896] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-13T18:10:43.617929] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-13T18:10:43.877572] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-13T18:10:44.226295] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T18:10:44.417926] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-13T18:10:45.217980] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-13T18:10:45.717001] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-13T18:10:45.717533] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:10:46.017924] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-13T18:10:46.817928] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-13T18:10:47.431677] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:10:47.617933] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-13T18:10:47.979776] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-13T18:10:48.079573] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T18:10:48.417929] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-13T18:10:48.857328] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T18:10:49.217947] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-13T18:10:50.017984] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-13T18:10:50.817912] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-13T18:10:51.005316] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T18:10:51.343362] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T18:10:51.617973] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-13T18:10:52.230977] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T18:10:52.417906] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-13T18:10:52.939120] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T18:10:53.217929] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-13T18:10:53.563036] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T18:10:54.017892] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-13T18:10:54.645257] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:10:54.817930] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-13T18:10:55.617983] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-13T18:10:55.872976] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T18:10:55.995457] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T18:10:56.418004] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-13T18:10:57.070502] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:10:57.217901] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-13T18:10:57.587489] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T18:10:58.017987] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-13T18:10:58.817944] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-13T18:10:58.882142] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T18:10:59.285315] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T18:10:59.617923] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-13T18:10:59.816613] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:11:00.418044] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-13T18:11:00.841248] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-13T18:11:01.115215] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T18:11:01.217940] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-13T18:11:01.713191] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T18:11:02.017934] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-13T18:11:02.817989] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-13T18:11:03.617899] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-13T18:11:03.762110] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T18:11:04.094668] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T18:11:04.095488] [INFO ] [REMOTE ] CPAC: Full fetch complete (1865 records). [2025-10-13T18:11:04.095564] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-13T18:11:04.277507] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T18:11:04.277719] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:11:04.277790] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:11:04.277866] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-13T18:11:04.277931] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-13T18:11:04.278008] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-13T18:11:04.278066] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-13T18:11:04.278125] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CPAC took 27.0s. Estimated remaining: 4h 16m 34s. Rate: 7.2 symbols/min [2025-10-13T18:11:04.421992] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-13T18:11:04.453119] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:04.483048] [DEBUG] [LOCAL ] CPAY: Loaded 30808 existing records from primary storage. [2025-10-13T18:11:04.483303] [INFO ] [MAIN ] CPAY: Loaded 30808 existing records. [2025-10-13T18:11:04.675046] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:04.675433] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-13T18:11:04.675509] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-13T18:11:04.675834] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-13T18:11:04.675890] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-13T18:11:04.992941] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-13T18:11:05.086267] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:05.217946] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-13T18:11:06.017891] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-13T18:11:06.052212] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T18:11:06.622874] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T18:11:06.818013] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-13T18:11:07.425457] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T18:11:07.617937] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-13T18:11:08.417918] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-13T18:11:08.460895] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:11:08.466102] [INFO ] [REMOTE ] COUR: Full fetch complete (70853 records). [2025-10-13T18:11:08.466248] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-13T18:11:08.844125] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-13T18:11:08.844208] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-13T18:11:08.845019] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-13T18:11:08.845081] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-13T18:11:08.846413] [DEBUG] [LOCAL ] COUR: Trimmed 70853 records to 49182 (keeping 200 days of data) [2025-10-13T18:11:09.127671] [DEBUG] [LOCAL ] COUR: Primary data saved (49182 records). [2025-10-13T18:11:09.127835] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-13T18:11:09.127926] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. COUR took 40.7s. Estimated remaining: 4h 16m 13s. Rate: 7.2 symbols/min [2025-10-13T18:11:09.224108] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-13T18:11:09.312522] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:09.328379] [DEBUG] [LOCAL ] CPF: Loaded 15445 existing records from primary storage. [2025-10-13T18:11:09.328629] [INFO ] [MAIN ] CPF: Loaded 15445 existing records. [2025-10-13T18:11:09.521995] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-13T18:11:09.558974] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T18:11:09.552386] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:09.559362] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-13T18:11:09.566200] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-13T18:11:09.567037] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-13T18:11:09.567099] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-13T18:11:09.598959] [INFO ] [REMOTE ] CP: Full fetch complete (77117 records). [2025-10-13T18:11:09.622534] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-13T18:11:10.023456] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-13T18:11:10.223459] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:10.322156] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T18:11:10.349959] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-13T18:11:10.350216] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-13T18:11:10.351427] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-13T18:11:10.350139] [INFO ] [REMOTE ] CPA: Full fetch complete (41395 records). [2025-10-13T18:11:10.351729] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-13T18:11:10.351583] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-13T18:11:10.461799] [DEBUG] [LOCAL ] CP: Trimmed 77117 records to 53252 (keeping 200 days of data) [2025-10-13T18:11:10.856742] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-13T18:11:10.837719] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-13T18:11:10.862110] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-13T18:11:10.868810] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-13T18:11:10.922371] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-13T18:11:10.961786] [DEBUG] [LOCAL ] CPA: Trimmed 41395 records to 28392 (keeping 200 days of data) [2025-10-13T18:11:11.194311] [DEBUG] [LOCAL ] CP: Primary data saved (53252 records). [2025-10-13T18:11:11.200193] [INFO ] [MAIN ] CP: Full history saved. [2025-10-13T18:11:11.200709] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CP took 41.3s. Estimated remaining: 4h 15m 42s. Rate: 7.3 symbols/min [2025-10-13T18:11:11.352505] [DEBUG] [LOCAL ] CPA: Primary data saved (28392 records). [2025-10-13T18:11:11.367159] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-13T18:11:11.367803] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPA took 34.2s. Estimated remaining: 4h 15m 5s. Rate: 7.3 symbols/min [2025-10-13T18:11:11.439225] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:11.458175] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T18:11:11.476856] [DEBUG] [LOCAL ] CPK: Loaded 13880 existing records from primary storage. [2025-10-13T18:11:11.477122] [INFO ] [MAIN ] CPK: Loaded 13880 existing records. [2025-10-13T18:11:11.626769] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-13T18:11:11.658077] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:11.658396] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-13T18:11:11.658484] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-13T18:11:11.658754] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-13T18:11:11.658826] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-13T18:11:12.012262] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:12.185571] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T18:11:12.417905] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-13T18:11:13.156769] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:11:13.225613] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-13T18:11:13.227602] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T18:11:14.017925] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-13T18:11:14.223158] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:11:14.779272] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T18:11:14.817888] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-13T18:11:15.617918] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-13T18:11:15.663027] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T18:11:16.417920] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-13T18:11:17.184543] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T18:11:17.217914] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-13T18:11:17.357565] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T18:11:18.017922] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-13T18:11:18.121461] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T18:11:18.817986] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-13T18:11:18.895774] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T18:11:19.617943] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-13T18:11:20.174693] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T18:11:20.417895] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-13T18:11:20.478449] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T18:11:21.221154] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-13T18:11:22.011989] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T18:11:22.018454] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-13T18:11:22.110278] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-13T18:11:22.817894] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-13T18:11:23.004364] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:11:23.617975] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-13T18:11:23.707896] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T18:11:24.417893] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-13T18:11:24.568531] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T18:11:25.029913] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T18:11:25.217923] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-13T18:11:26.018008] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-13T18:11:26.174094] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T18:11:26.785576] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T18:11:26.818059] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-13T18:11:27.425369] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T18:11:27.617902] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-13T18:11:28.417926] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-13T18:11:29.044461] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:11:29.217885] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-13T18:11:29.246743] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T18:11:30.017906] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-13T18:11:30.497022] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T18:11:30.643006] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T18:11:30.817942] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-13T18:11:31.617922] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-13T18:11:32.160986] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T18:11:32.417988] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-13T18:11:32.467579] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T18:11:33.217891] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-13T18:11:33.352538] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T18:11:33.355408] [INFO ] [REMOTE ] CPAY: Full fetch complete (44666 records). [2025-10-13T18:11:33.355482] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-13T18:11:33.738827] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-13T18:11:33.738947] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-13T18:11:33.739717] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-13T18:11:33.739784] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-13T18:11:33.740898] [DEBUG] [LOCAL ] CPAY: Trimmed 44666 records to 30418 (keeping 200 days of data) [2025-10-13T18:11:33.921113] [DEBUG] [LOCAL ] CPAY: Primary data saved (30418 records). [2025-10-13T18:11:33.921243] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-13T18:11:33.921320] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPAY took 29.6s. Estimated remaining: 4h 15m 48s. Rate: 7.2 symbols/min [2025-10-13T18:11:34.017986] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-13T18:11:34.074355] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T18:11:34.076402] [INFO ] [REMOTE ] CPF: Full fetch complete (23599 records). [2025-10-13T18:11:34.076469] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-13T18:11:34.434711] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-13T18:11:34.434817] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-13T18:11:34.435260] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-13T18:11:34.435359] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-13T18:11:34.435988] [DEBUG] [LOCAL ] CPF: Trimmed 23599 records to 15233 (keeping 200 days of data) [2025-10-13T18:11:34.525043] [DEBUG] [LOCAL ] CPF: Primary data saved (15233 records). [2025-10-13T18:11:34.525178] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-13T18:11:34.525257] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPF took 25.4s. Estimated remaining: 4h 15m 12s. Rate: 7.3 symbols/min [2025-10-13T18:11:35.055704] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T18:11:35.057981] [INFO ] [REMOTE ] CPK: Full fetch complete (18206 records). [2025-10-13T18:11:35.058058] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-13T18:11:35.477345] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-13T18:11:35.477434] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-13T18:11:35.477901] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-13T18:11:35.477994] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-13T18:11:35.478566] [DEBUG] [LOCAL ] CPK: Trimmed 18206 records to 13769 (keeping 200 days of data) [2025-10-13T18:11:35.573376] [DEBUG] [LOCAL ] CPK: Primary data saved (13769 records). [2025-10-13T18:11:35.573554] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-13T18:11:35.573712] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPK took 24.4s. Estimated remaining: 4h 14m 38s. Rate: 7.3 symbols/min [2025-10-13T18:11:36.268442] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:36.230571] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:36.292253] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:36.297382] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:11:36.298254] [DEBUG] [LOCAL ] CPS: No existing data file found in primary storage. [2025-10-13T18:11:36.299151] [WARN ] [MAIN ] CPS: No existing data found, performing full refresh instead. [2025-10-13T18:11:36.299284] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-13T18:11:36.299367] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-13T18:11:36.299472] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-13T18:11:36.299531] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-13T18:11:36.670885] [DEBUG] [LOCAL ] CPT: Loaded 45033 existing records from primary storage. [2025-10-13T18:11:36.726162] [INFO ] [MAIN ] CPT: Loaded 45033 existing records. [2025-10-13T18:11:36.780473] [DEBUG] [LOCAL ] CPRI: Loaded 53277 existing records from primary storage. [2025-10-13T18:11:36.775125] [DEBUG] [LOCAL ] CPNG: Loaded 54450 existing records from primary storage. [2025-10-13T18:11:36.796461] [INFO ] [MAIN ] CPRI: Loaded 53277 existing records. [2025-10-13T18:11:36.816533] [INFO ] [MAIN ] CPNG: Loaded 54450 existing records. [2025-10-13T18:11:37.124411] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:37.171912] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-13T18:11:37.361261] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:37.416208] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:37.437912] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-13T18:11:37.443236] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-13T18:11:37.437578] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-13T18:11:37.458538] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-13T18:11:37.460057] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-13T18:11:37.462022] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-13T18:11:37.483855] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-13T18:11:37.492737] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:11:37.512131] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-13T18:11:37.512629] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-13T18:11:37.556033] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-13T18:11:37.595286] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-13T18:11:37.657296] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-13T18:11:38.511240] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:38.560446] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-13T18:11:38.680323] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:38.715069] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-13T18:11:38.715711] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T18:11:38.731541] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-13T18:11:38.763960] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:11:38.765738] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-13T18:11:39.672547] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T18:11:39.677242] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-13T18:11:40.111127] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T18:11:40.122664] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-13T18:11:40.356526] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:11:40.417988] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-13T18:11:40.641290] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T18:11:41.135828] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-13T18:11:41.217894] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-13T18:11:41.647346] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T18:11:41.703569] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T18:11:42.017976] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-13T18:11:42.817930] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-13T18:11:43.102514] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T18:11:43.266381] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T18:11:43.617899] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-13T18:11:44.078081] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T18:11:44.417999] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-13T18:11:45.101029] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T18:11:45.217881] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-13T18:11:45.502545] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T18:11:46.018077] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-13T18:11:46.585370] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T18:11:46.817915] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-13T18:11:47.362679] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T18:11:47.618027] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-13T18:11:48.086619] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:11:48.417920] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-13T18:11:49.217924] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-13T18:11:49.356372] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T18:11:49.890955] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T18:11:50.017982] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-13T18:11:50.818061] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-13T18:11:51.096051] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-13T18:11:51.617901] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-13T18:11:51.685420] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T18:11:51.815695] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:11:52.418046] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-13T18:11:53.217941] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-13T18:11:53.627861] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T18:11:54.018001] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-13T18:11:54.267744] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T18:11:54.802308] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T18:11:54.817886] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-13T18:11:55.617931] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-13T18:11:56.164798] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T18:11:56.210288] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-13T18:11:56.417987] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-13T18:11:57.217918] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-13T18:11:57.376793] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T18:11:57.411944] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T18:11:58.017937] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-13T18:11:58.817989] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-13T18:11:59.517803] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-13T18:11:59.554110] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T18:11:59.617881] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-13T18:11:59.716120] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T18:12:00.417930] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-13T18:12:01.217920] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-13T18:12:01.765062] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-13T18:12:02.017906] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-13T18:12:02.206923] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:12:02.211418] [INFO ] [REMOTE ] CPT: Full fetch complete (63991 records). [2025-10-13T18:12:02.211571] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-13T18:12:02.595481] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T18:12:02.640534] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-13T18:12:02.640629] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-13T18:12:02.641828] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-13T18:12:02.641892] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-13T18:12:02.643149] [DEBUG] [LOCAL ] CPT: Trimmed 63991 records to 44474 (keeping 200 days of data) [2025-10-13T18:12:02.823623] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-13T18:12:02.924933] [DEBUG] [LOCAL ] CPT: Primary data saved (44474 records). [2025-10-13T18:12:02.925063] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-13T18:12:02.925209] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CPT took 27.3s. Estimated remaining: 4h 15m 38s. Rate: 7.2 symbols/min [2025-10-13T18:12:03.119917] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:03.145058] [DEBUG] [LOCAL ] CQP: Loaded 19096 existing records from primary storage. [2025-10-13T18:12:03.145364] [INFO ] [MAIN ] CQP: Loaded 19096 existing records. [2025-10-13T18:12:03.321114] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:03.321348] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-13T18:12:03.321394] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-13T18:12:03.321773] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-13T18:12:03.321840] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-13T18:12:03.622962] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-13T18:12:03.677612] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:03.895982] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T18:12:03.898396] [INFO ] [REMOTE ] CPS: Full fetch complete (36277 records). [2025-10-13T18:12:03.898482] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-13T18:12:04.280427] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-13T18:12:04.280518] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-13T18:12:04.281070] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-13T18:12:04.281131] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-13T18:12:04.281941] [DEBUG] [LOCAL ] CPS: Trimmed 36277 records to 25382 (keeping 200 days of data) [2025-10-13T18:12:04.418794] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-13T18:12:04.436330] [DEBUG] [LOCAL ] CPS: Primary data saved (25382 records). [2025-10-13T18:12:04.436471] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-13T18:12:04.450263] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 28.9s. Estimated remaining: 4h 15m 5s. Rate: 7.2 symbols/min [2025-10-13T18:12:04.551963] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-13T18:12:04.670089] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:04.694693] [DEBUG] [LOCAL ] CR: Loaded 24473 existing records from primary storage. [2025-10-13T18:12:04.694948] [INFO ] [MAIN ] CR: Loaded 24473 existing records. [2025-10-13T18:12:04.872063] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:04.872302] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-13T18:12:04.872351] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-13T18:12:04.872559] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-13T18:12:04.872600] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-13T18:12:05.228800] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-13T18:12:05.234963] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:05.303215] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T18:12:05.596000] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T18:12:06.017939] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-13T18:12:06.817970] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-13T18:12:07.031732] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T18:12:07.391861] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-13T18:12:07.618055] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-13T18:12:08.331040] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T18:12:08.417975] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-13T18:12:09.217941] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-13T18:12:09.543294] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T18:12:09.966404] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:12:10.017933] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-13T18:12:10.060687] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T18:12:10.818015] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-13T18:12:11.490127] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T18:12:11.618024] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-13T18:12:12.418050] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-13T18:12:12.677695] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T18:12:12.857683] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-13T18:12:12.864389] [INFO ] [REMOTE ] CPNG: Full fetch complete (77678 records). [2025-10-13T18:12:12.864744] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-13T18:12:13.225145] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-13T18:12:13.274268] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-13T18:12:13.274358] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-13T18:12:13.275311] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-13T18:12:13.275388] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-13T18:12:13.276968] [DEBUG] [LOCAL ] CPNG: Trimmed 77678 records to 53679 (keeping 200 days of data) [2025-10-13T18:12:13.601247] [DEBUG] [LOCAL ] CPNG: Primary data saved (53679 records). [2025-10-13T18:12:13.601386] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-13T18:12:13.601478] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPNG took 38.0s. Estimated remaining: 4h 15m 0s. Rate: 7.2 symbols/min [2025-10-13T18:12:13.766379] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:13.776503] [DEBUG] [LOCAL ] CRBD: Loaded 9109 existing records from primary storage. [2025-10-13T18:12:13.776715] [INFO ] [MAIN ] CRBD: Loaded 9109 existing records. [2025-10-13T18:12:13.949776] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:13.950021] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-13T18:12:13.950066] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-13T18:12:13.950291] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-13T18:12:13.950347] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-13T18:12:14.024680] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-13T18:12:14.327369] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:14.341707] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T18:12:14.359722] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-13T18:12:14.365629] [INFO ] [REMOTE ] CPRI: Full fetch complete (76088 records). [2025-10-13T18:12:14.365800] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-13T18:12:14.754968] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-13T18:12:14.755061] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-13T18:12:14.755952] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-13T18:12:14.756017] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-13T18:12:14.757488] [DEBUG] [LOCAL ] CPRI: Trimmed 76088 records to 52498 (keeping 200 days of data) [2025-10-13T18:12:14.818559] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-13T18:12:15.066320] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T18:12:15.114535] [DEBUG] [LOCAL ] CPRI: Primary data saved (52498 records). [2025-10-13T18:12:15.114695] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-13T18:12:15.114797] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPRI took 39.5s. Estimated remaining: 4h 14m 28s. Rate: 7.3 symbols/min [2025-10-13T18:12:15.321344] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:15.370057] [DEBUG] [LOCAL ] CRBG: Loaded 53226 existing records from primary storage. [2025-10-13T18:12:15.370402] [INFO ] [MAIN ] CRBG: Loaded 53226 existing records. [2025-10-13T18:12:15.542678] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:15.542902] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-13T18:12:15.542948] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-13T18:12:15.543336] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-13T18:12:15.543391] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-13T18:12:15.623006] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-13T18:12:15.908002] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:15.995540] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T18:12:16.417931] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-13T18:12:16.831974] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T18:12:17.217938] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-13T18:12:17.833543] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-13T18:12:17.984479] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T18:12:18.017886] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-13T18:12:18.673499] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T18:12:18.817901] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-13T18:12:19.618025] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-13T18:12:19.848557] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T18:12:20.342209] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T18:12:20.417933] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-13T18:12:21.045229] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-13T18:12:21.217941] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-13T18:12:22.000766] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T18:12:22.017933] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-13T18:12:22.630752] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T18:12:22.817915] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-13T18:12:23.617904] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-13T18:12:23.923506] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:12:24.417925] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-13T18:12:25.217936] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-13T18:12:25.254125] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T18:12:25.360028] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T18:12:26.017917] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-13T18:12:26.696525] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T18:12:26.817912] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-13T18:12:27.424096] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T18:12:27.617885] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-13T18:12:27.775476] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T18:12:28.417926] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-13T18:12:29.206425] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T18:12:29.217876] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-13T18:12:29.351994] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T18:12:29.845138] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T18:12:30.017894] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-13T18:12:30.817889] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-13T18:12:30.925078] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T18:12:31.617915] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-13T18:12:32.417925] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-13T18:12:32.586628] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T18:12:32.603674] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-13T18:12:32.605825] [INFO ] [REMOTE ] CRBD: Full fetch complete (13546 records). [2025-10-13T18:12:32.605916] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-13T18:12:32.988194] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-13T18:12:32.988289] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-13T18:12:32.988623] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-13T18:12:32.988704] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-13T18:12:32.989166] [DEBUG] [LOCAL ] CRBD: Trimmed 13546 records to 8964 (keeping 200 days of data) [2025-10-13T18:12:33.043241] [DEBUG] [LOCAL ] CRBD: Primary data saved (8964 records). [2025-10-13T18:12:33.043379] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-13T18:12:33.043460] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CRBD took 19.4s. Estimated remaining: 4h 14m 54s. Rate: 7.2 symbols/min [2025-10-13T18:12:33.209532] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:33.218037] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-13T18:12:33.251770] [DEBUG] [LOCAL ] CRC: Loaded 44489 existing records from primary storage. [2025-10-13T18:12:33.252089] [INFO ] [MAIN ] CRC: Loaded 44489 existing records. [2025-10-13T18:12:33.362064] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T18:12:33.441767] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:33.441991] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-13T18:12:33.442037] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-13T18:12:33.442343] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-13T18:12:33.442399] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-13T18:12:33.787550] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:34.018048] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-13T18:12:34.736824] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T18:12:34.820048] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-13T18:12:34.828103] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:12:35.617908] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-13T18:12:35.785579] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T18:12:35.787298] [INFO ] [REMOTE ] CQP: Full fetch complete (30136 records). [2025-10-13T18:12:35.787367] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-13T18:12:36.163212] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-13T18:12:36.163303] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-13T18:12:36.163964] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-13T18:12:36.164032] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-13T18:12:36.164796] [DEBUG] [LOCAL ] CQP: Trimmed 30136 records to 18920 (keeping 200 days of data) [2025-10-13T18:12:36.281309] [DEBUG] [LOCAL ] CQP: Primary data saved (18920 records). [2025-10-13T18:12:36.281445] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-13T18:12:36.281548] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CQP took 33.4s. Estimated remaining: 4h 14m 28s. Rate: 7.3 symbols/min [2025-10-13T18:12:36.422220] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-13T18:12:36.453562] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:36.454058] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-13T18:12:36.454112] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-13T18:12:36.454229] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-13T18:12:36.454272] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-13T18:12:36.454313] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-13T18:12:36.454345] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-13T18:12:36.816261] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:36.886496] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T18:12:37.217990] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-13T18:12:37.777829] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T18:12:38.018025] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-13T18:12:38.727121] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T18:12:38.817924] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-13T18:12:39.398110] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T18:12:39.617973] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-13T18:12:40.417913] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-13T18:12:40.669038] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T18:12:40.986493] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T18:12:41.217926] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-13T18:12:41.296681] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T18:12:42.017934] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-13T18:12:42.246773] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:12:42.247211] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-13T18:12:42.247311] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:12:42.247364] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-13T18:12:42.247404] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:12:42.247512] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-13T18:12:42.247594] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-13T18:12:42.247638] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-13T18:12:42.247734] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-13T18:12:42.247794] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRCL took 6.0s. Estimated remaining: 4h 14m 12s. Rate: 7.3 symbols/min [2025-10-13T18:12:42.436421] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:42.495876] [DEBUG] [LOCAL ] CRGY: Loaded 53242 existing records from primary storage. [2025-10-13T18:12:42.496300] [INFO ] [MAIN ] CRGY: Loaded 53242 existing records. [2025-10-13T18:12:42.673249] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:42.673522] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-13T18:12:42.673574] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-13T18:12:42.673956] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-13T18:12:42.674019] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-13T18:12:42.820742] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-13T18:12:43.060272] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:43.094548] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T18:12:43.617938] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-13T18:12:44.118460] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T18:12:44.417938] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-13T18:12:45.217979] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-13T18:12:45.276018] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T18:12:45.954169] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T18:12:46.014975] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T18:12:46.020128] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-13T18:12:46.817932] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-13T18:12:47.617940] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-13T18:12:47.649444] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T18:12:47.657619] [INFO ] [REMOTE ] CRBG: Full fetch complete (75773 records). [2025-10-13T18:12:47.657818] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-13T18:12:48.075542] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-13T18:12:48.075687] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-13T18:12:48.076804] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-13T18:12:48.076889] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-13T18:12:48.094611] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T18:12:48.100871] [DEBUG] [LOCAL ] CRBG: Trimmed 75773 records to 52546 (keeping 200 days of data) [2025-10-13T18:12:48.417366] [DEBUG] [LOCAL ] CRBG: Primary data saved (52546 records). [2025-10-13T18:12:48.417498] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-13T18:12:48.417573] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRBG took 33.3s. Estimated remaining: 4h 13m 56s. Rate: 7.3 symbols/min [2025-10-13T18:12:48.429066] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-13T18:12:48.591093] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:48.639374] [DEBUG] [LOCAL ] CRH: Loaded 54229 existing records from primary storage. [2025-10-13T18:12:48.639734] [INFO ] [MAIN ] CRH: Loaded 54229 existing records. [2025-10-13T18:12:48.822090] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:48.822290] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-13T18:12:48.822337] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-13T18:12:48.822623] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-13T18:12:48.822716] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-13T18:12:49.202231] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:49.217890] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-13T18:12:49.253505] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:12:50.017980] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-13T18:12:50.101707] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T18:12:50.817929] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-13T18:12:51.137407] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T18:12:51.564180] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T18:12:51.586871] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T18:12:51.617884] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-13T18:12:52.417910] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-13T18:12:52.646275] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T18:12:52.649095] [INFO ] [REMOTE ] CR: Full fetch complete (34636 records). [2025-10-13T18:12:52.649186] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-13T18:12:53.019639] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-13T18:12:53.019802] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-13T18:12:53.020754] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-13T18:12:53.020821] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-13T18:12:53.022285] [DEBUG] [LOCAL ] CR: Trimmed 34636 records to 24133 (keeping 200 days of data) [2025-10-13T18:12:53.184578] [DEBUG] [LOCAL ] CR: Primary data saved (24133 records). [2025-10-13T18:12:53.184804] [INFO ] [MAIN ] CR: Full history saved. [2025-10-13T18:12:53.184914] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CR took 48.7s. Estimated remaining: 4h 13m 35s. Rate: 7.3 symbols/min [2025-10-13T18:12:53.223165] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-13T18:12:53.372289] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:12:53.424419] [DEBUG] [LOCAL ] CRI: Loaded 50425 existing records from primary storage. [2025-10-13T18:12:53.424924] [INFO ] [MAIN ] CRI: Loaded 50425 existing records. [2025-10-13T18:12:53.622844] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:12:53.623127] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-13T18:12:53.623179] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-13T18:12:53.623691] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-13T18:12:53.623751] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-13T18:12:53.998138] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:12:54.022513] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-13T18:12:54.029212] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:12:54.723029] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T18:12:54.817898] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-13T18:12:55.617987] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-13T18:12:55.764690] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T18:12:56.417947] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-13T18:12:56.514866] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T18:12:57.067474] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:12:57.217947] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-13T18:12:58.018007] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-13T18:12:58.403193] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-13T18:12:58.817906] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-13T18:12:59.049018] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T18:12:59.464023] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T18:12:59.617909] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-13T18:13:00.227149] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:13:00.418004] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-13T18:13:01.152759] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:13:01.217943] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-13T18:13:02.017922] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-13T18:13:02.817981] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-13T18:13:02.906421] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T18:13:03.529164] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-10-13T18:13:03.617918] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-13T18:13:03.718152] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:13:04.428308] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-13T18:13:04.434159] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T18:13:05.217976] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-13T18:13:05.653240] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-13T18:13:06.018006] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-13T18:13:06.182194] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T18:13:06.186835] [INFO ] [REMOTE ] CRC: Full fetch complete (62674 records). [2025-10-13T18:13:06.186954] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-13T18:13:06.576088] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-13T18:13:06.576182] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-13T18:13:06.576954] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-13T18:13:06.577018] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-13T18:13:06.578534] [DEBUG] [LOCAL ] CRC: Trimmed 62674 records to 44022 (keeping 200 days of data) [2025-10-13T18:13:06.818584] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-13T18:13:06.842968] [DEBUG] [LOCAL ] CRC: Primary data saved (44022 records). [2025-10-13T18:13:06.843115] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-13T18:13:06.844014] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRC took 33.8s. Estimated remaining: 4h 13m 46s. Rate: 7.3 symbols/min [2025-10-13T18:13:07.012880] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:07.067109] [DEBUG] [LOCAL ] CRK: Loaded 52981 existing records from primary storage. [2025-10-13T18:13:07.067447] [INFO ] [MAIN ] CRK: Loaded 52981 existing records. [2025-10-13T18:13:07.253389] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:07.253730] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-13T18:13:07.253798] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-13T18:13:07.269144] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-13T18:13:07.281451] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-13T18:13:07.361989] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-13T18:13:07.628419] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-13T18:13:07.660582] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:07.751432] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:13:08.417985] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-13T18:13:08.471755] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T18:13:09.217932] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-13T18:13:09.393517] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T18:13:10.017902] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-13T18:13:10.300938] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T18:13:10.812256] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T18:13:10.822060] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-13T18:13:11.513893] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T18:13:11.617926] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-13T18:13:12.322788] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T18:13:12.418011] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-13T18:13:13.217913] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-13T18:13:13.325979] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T18:13:14.017975] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-13T18:13:14.224132] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T18:13:14.823169] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-13T18:13:14.839009] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T18:13:15.617919] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-13T18:13:15.867600] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T18:13:16.031465] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T18:13:16.417925] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-13T18:13:17.217934] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-13T18:13:17.582716] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-13T18:13:17.588172] [INFO ] [REMOTE ] CRGY: Full fetch complete (75934 records). [2025-10-13T18:13:17.588306] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-13T18:13:18.002836] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-13T18:13:18.003039] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-13T18:13:18.004203] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-13T18:13:18.004333] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-13T18:13:18.006600] [DEBUG] [LOCAL ] CRGY: Trimmed 75934 records to 52490 (keeping 200 days of data) [2025-10-13T18:13:18.062087] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-13T18:13:18.276943] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T18:13:18.401591] [DEBUG] [LOCAL ] CRGY: Primary data saved (52490 records). [2025-10-13T18:13:18.401902] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-13T18:13:18.402046] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRGY took 36.2s. Estimated remaining: 4h 13m 49s. Rate: 7.2 symbols/min [2025-10-13T18:13:18.587084] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:18.640608] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T18:13:18.666235] [DEBUG] [LOCAL ] CRL: Loaded 43459 existing records from primary storage. [2025-10-13T18:13:18.666700] [INFO ] [MAIN ] CRL: Loaded 43459 existing records. [2025-10-13T18:13:18.823085] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-13T18:13:18.864189] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:18.864852] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-13T18:13:18.864919] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-13T18:13:18.865411] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-13T18:13:18.865468] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-13T18:13:19.246061] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:19.588987] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:13:19.617884] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-13T18:13:20.417928] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-13T18:13:20.454488] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T18:13:21.210105] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T18:13:21.218394] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-13T18:13:21.945419] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T18:13:22.017891] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-13T18:13:22.750960] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:13:22.817905] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-13T18:13:23.628237] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-13T18:13:23.634699] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T18:13:24.417985] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-13T18:13:24.518010] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:13:25.218003] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-13T18:13:25.489102] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-13T18:13:25.494507] [INFO ] [REMOTE ] CRH: Full fetch complete (77297 records). [2025-10-13T18:13:25.494627] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-13T18:13:25.882569] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-13T18:13:25.882734] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-13T18:13:25.883712] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-13T18:13:25.883791] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-13T18:13:25.885404] [DEBUG] [LOCAL ] CRH: Trimmed 77297 records to 53445 (keeping 200 days of data) [2025-10-13T18:13:26.001734] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:13:26.034952] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-13T18:13:26.247474] [DEBUG] [LOCAL ] CRH: Primary data saved (53445 records). [2025-10-13T18:13:26.247609] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-13T18:13:26.247748] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRH took 37.8s. Estimated remaining: 4h 13m 39s. Rate: 7.2 symbols/min [2025-10-13T18:13:26.417836] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:26.468786] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-10-13T18:13:26.469100] [INFO ] [MAIN ] CRM: Loaded 54550 existing records. [2025-10-13T18:13:26.645214] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:26.645484] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-13T18:13:26.645546] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-13T18:13:26.646124] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-13T18:13:26.646181] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-13T18:13:26.818342] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-13T18:13:26.998244] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:27.157044] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T18:13:27.617896] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-13T18:13:27.884869] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T18:13:28.417883] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-13T18:13:28.870564] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T18:13:29.217938] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-13T18:13:29.437168] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T18:13:30.024358] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-13T18:13:30.042771] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T18:13:30.674557] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T18:13:30.817886] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-13T18:13:31.617997] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-13T18:13:32.349389] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T18:13:32.417889] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-13T18:13:32.458586] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-13T18:13:33.041023] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T18:13:33.217903] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-13T18:13:33.965042] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T18:13:34.017972] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-13T18:13:34.818001] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-13T18:13:35.555024] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-13T18:13:35.630241] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-13T18:13:35.637148] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T18:13:36.275437] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T18:13:36.417929] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-13T18:13:37.037044] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T18:13:37.217926] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-13T18:13:37.876802] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T18:13:37.886597] [INFO ] [REMOTE ] CRK: Full fetch complete (75244 records). [2025-10-13T18:13:37.887081] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-13T18:13:37.888123] [FATAL] [VALIDATOR ] CRK: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:13:37.888257] [FATAL] [MAIN ] CRK: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:13:37.888301] [WARN ] [MAIN ] CRK: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:13:37.888341] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-13T18:13:37.888399] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-10-13T18:13:37.888434] [INFO ] [LOCAL ] CRK: Starting deletion of derivative data. [2025-10-13T18:13:37.888861] [DEBUG] [LOCAL ] CRK: Deleted derivative data file. [2025-10-13T18:13:37.889742] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRK took 31.0s. Estimated remaining: 4h 13m 43s. Rate: 7.2 symbols/min [2025-10-13T18:13:38.023070] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-13T18:13:38.091223] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:38.137246] [DEBUG] [LOCAL ] CRS: Loaded 43725 existing records from primary storage. [2025-10-13T18:13:38.137629] [INFO ] [MAIN ] CRS: Loaded 43725 existing records. [2025-10-13T18:13:38.337834] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:38.338078] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-13T18:13:38.338132] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-13T18:13:38.338447] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-13T18:13:38.338510] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-13T18:13:38.717163] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:38.763364] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:13:38.817883] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-13T18:13:39.617894] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-13T18:13:39.919180] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-13T18:13:39.924006] [INFO ] [REMOTE ] CRI: Full fetch complete (70777 records). [2025-10-13T18:13:39.924137] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-13T18:13:40.326038] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-13T18:13:40.326138] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-13T18:13:40.327145] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-13T18:13:40.327217] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-13T18:13:40.328836] [DEBUG] [LOCAL ] CRI: Trimmed 70777 records to 49698 (keeping 200 days of data) [2025-10-13T18:13:40.422963] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-13T18:13:40.597546] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T18:13:40.678202] [DEBUG] [LOCAL ] CRI: Primary data saved (49698 records). [2025-10-13T18:13:40.678394] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-13T18:13:40.678563] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRI took 47.5s. Estimated remaining: 4h 13m 15s. Rate: 7.3 symbols/min [2025-10-13T18:13:40.846960] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:40.853571] [DEBUG] [LOCAL ] CRT: Loaded 5025 existing records from primary storage. [2025-10-13T18:13:40.853797] [INFO ] [MAIN ] CRT: Loaded 5025 existing records. [2025-10-13T18:13:41.029604] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:41.029871] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-13T18:13:41.029985] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-13T18:13:41.030196] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-13T18:13:41.030262] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-13T18:13:41.223160] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-13T18:13:41.394704] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:41.861269] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-13T18:13:41.948750] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T18:13:42.017904] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-13T18:13:42.749795] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T18:13:42.760078] [INFO ] [REMOTE ] CRL: Full fetch complete (63274 records). [2025-10-13T18:13:42.760194] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-13T18:13:42.825246] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-13T18:13:43.152751] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-13T18:13:43.152886] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-13T18:13:43.153731] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-13T18:13:43.153811] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-13T18:13:43.155407] [DEBUG] [LOCAL ] CRL: Trimmed 63274 records to 42928 (keeping 200 days of data) [2025-10-13T18:13:43.309189] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T18:13:43.459256] [DEBUG] [LOCAL ] CRL: Primary data saved (42928 records). [2025-10-13T18:13:43.459392] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-13T18:13:43.459470] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRL took 25.1s. Estimated remaining: 4h 12m 48s. Rate: 7.3 symbols/min [2025-10-13T18:13:43.629608] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-13T18:13:43.634147] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:13:43.675752] [DEBUG] [LOCAL ] CSAN: Loaded 42688 existing records from primary storage. [2025-10-13T18:13:43.676059] [INFO ] [MAIN ] CSAN: Loaded 42688 existing records. [2025-10-13T18:13:43.798163] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T18:13:43.869620] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:13:43.869878] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-13T18:13:43.869970] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-13T18:13:43.870499] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-13T18:13:43.870558] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-13T18:13:44.232611] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:13:44.418012] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-13T18:13:45.217993] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-13T18:13:45.763380] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T18:13:45.977584] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-13T18:13:46.017895] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-13T18:13:46.248705] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T18:13:46.818001] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-13T18:13:47.364429] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T18:13:47.617988] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-13T18:13:48.152379] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-13T18:13:48.417980] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-13T18:13:49.109676] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T18:13:49.217914] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-13T18:13:50.018028] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-13T18:13:50.546162] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-13T18:13:50.819075] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-13T18:13:50.825797] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-13T18:13:50.923906] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T18:13:51.402372] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T18:13:51.617946] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-13T18:13:52.418008] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-13T18:13:53.100104] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T18:13:53.217882] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-13T18:13:54.017932] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-13T18:13:54.105780] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:13:54.817907] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-13T18:13:54.916273] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T18:13:55.617607] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T18:13:55.619764] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-13T18:13:56.280685] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T18:13:56.417941] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-13T18:13:56.606932] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-10-13T18:13:57.217940] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-13T18:13:57.753126] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T18:13:57.913410] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T18:13:58.018026] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-13T18:13:58.817989] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-13T18:13:59.431289] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T18:13:59.617913] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-13T18:13:59.680405] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T18:14:00.418033] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-13T18:14:01.218016] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-13T18:14:01.348126] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:14:01.941133] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T18:14:02.017907] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-13T18:14:02.062090] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T18:14:02.817915] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-13T18:14:03.405968] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T18:14:03.407419] [INFO ] [REMOTE ] CRT: Full fetch complete (7441 records). [2025-10-13T18:14:03.407487] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-13T18:14:03.629920] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-13T18:14:03.670189] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T18:14:03.885167] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-13T18:14:03.885272] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-13T18:14:03.885715] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-13T18:14:03.885783] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-13T18:14:03.886236] [DEBUG] [LOCAL ] CRT: Trimmed 7441 records to 4929 (keeping 200 days of data) [2025-10-13T18:14:03.919918] [DEBUG] [LOCAL ] CRT: Primary data saved (4929 records). [2025-10-13T18:14:03.920109] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-13T18:14:03.920217] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRT took 23.2s. Estimated remaining: 4h 13m 22s. Rate: 7.2 symbols/min [2025-10-13T18:14:04.105134] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:04.146004] [DEBUG] [LOCAL ] CSL: Loaded 31969 existing records from primary storage. [2025-10-13T18:14:04.146397] [INFO ] [MAIN ] CSL: Loaded 31969 existing records. [2025-10-13T18:14:04.383825] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:14:04.384182] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-13T18:14:04.384241] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-13T18:14:04.384788] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-13T18:14:04.384853] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-13T18:14:04.423212] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-13T18:14:04.926541] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:05.218052] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-13T18:14:05.456342] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T18:14:06.018004] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-13T18:14:06.057380] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T18:14:06.266508] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T18:14:06.817919] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-13T18:14:07.564727] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T18:14:07.617893] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-13T18:14:07.905876] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:14:08.417919] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-13T18:14:08.768824] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T18:14:09.217945] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-13T18:14:09.728349] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:14:10.017937] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-13T18:14:10.573033] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:14:10.817929] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-13T18:14:11.618000] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-13T18:14:12.402245] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T18:14:12.406251] [INFO ] [REMOTE ] CSAN: Full fetch complete (60238 records). [2025-10-13T18:14:12.406340] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-13T18:14:12.427193] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-13T18:14:12.737604] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-13T18:14:12.842230] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-13T18:14:12.842327] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-13T18:14:12.843122] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-13T18:14:12.843204] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-13T18:14:12.849858] [DEBUG] [LOCAL ] CSAN: Trimmed 60238 records to 42131 (keeping 200 days of data) [2025-10-13T18:14:12.859964] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T18:14:13.105671] [DEBUG] [LOCAL ] CSAN: Primary data saved (42131 records). [2025-10-13T18:14:13.105811] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-13T18:14:13.105887] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CSAN took 29.6s. Estimated remaining: 4h 13m 17s. Rate: 7.2 symbols/min [2025-10-13T18:14:13.223026] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-13T18:14:13.273967] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:13.274113] [DEBUG] [LOCAL ] CSR: No existing data file found in primary storage. [2025-10-13T18:14:13.274149] [WARN ] [MAIN ] CSR: No existing data found, performing full refresh instead. [2025-10-13T18:14:13.274275] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-13T18:14:13.274317] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-13T18:14:13.274358] [DEBUG] [LOCAL ] CSR: No primary data file found to delete. [2025-10-13T18:14:13.274390] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-13T18:14:13.634960] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:14.017896] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-13T18:14:14.190549] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T18:14:14.195104] [INFO ] [REMOTE ] CRS: Full fetch complete (62499 records). [2025-10-13T18:14:14.195212] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-13T18:14:14.594623] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-13T18:14:14.594811] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-13T18:14:14.595781] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-13T18:14:14.595908] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-13T18:14:14.615321] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T18:14:14.615434] [DEBUG] [LOCAL ] CRS: Trimmed 62499 records to 43179 (keeping 200 days of data) [2025-10-13T18:14:14.819072] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-13T18:14:14.901057] [DEBUG] [LOCAL ] CRS: Primary data saved (43179 records). [2025-10-13T18:14:14.901200] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-13T18:14:14.902159] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CRS took 37.0s. Estimated remaining: 4h 12m 46s. Rate: 7.3 symbols/min [2025-10-13T18:14:15.071927] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:15.072091] [DEBUG] [LOCAL ] CSTM: No existing data file found in primary storage. [2025-10-13T18:14:15.072128] [WARN ] [MAIN ] CSTM: No existing data found, performing full refresh instead. [2025-10-13T18:14:15.072240] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-13T18:14:15.072283] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-13T18:14:15.072324] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-13T18:14:15.072356] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-13T18:14:15.432825] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:15.617903] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-13T18:14:15.674746] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T18:14:16.423059] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-13T18:14:16.436206] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-13T18:14:17.217904] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-13T18:14:17.276051] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T18:14:17.474458] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T18:14:18.017944] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-13T18:14:18.676807] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:14:18.817907] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-13T18:14:19.617929] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-13T18:14:20.064164] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-13T18:14:20.180193] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-13T18:14:20.421809] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-13T18:14:20.422666] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T18:14:21.217924] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-13T18:14:21.929245] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T18:14:21.976791] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T18:14:22.017895] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-13T18:14:22.817926] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-13T18:14:23.367575] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T18:14:23.391702] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T18:14:23.398044] [INFO ] [REMOTE ] CRM: Full fetch complete (77845 records). [2025-10-13T18:14:23.398245] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-13T18:14:23.621565] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-13T18:14:23.860949] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-13T18:14:23.861123] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-13T18:14:23.862274] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-13T18:14:23.862341] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-13T18:14:23.864406] [DEBUG] [LOCAL ] CRM: Trimmed 77845 records to 53770 (keeping 200 days of data) [2025-10-13T18:14:24.242626] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-13T18:14:24.242829] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-13T18:14:24.242919] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CRM took 58.0s. Estimated remaining: 4h 12m 42s. Rate: 7.2 symbols/min [2025-10-13T18:14:24.415801] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:24.417930] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-13T18:14:24.429386] [DEBUG] [LOCAL ] CSV: Loaded 12872 existing records from primary storage. [2025-10-13T18:14:24.429625] [INFO ] [MAIN ] CSV: Loaded 12872 existing records. [2025-10-13T18:14:24.617092] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:14:24.617409] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-13T18:14:24.617464] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-13T18:14:24.617927] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-13T18:14:24.618009] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-13T18:14:24.894423] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T18:14:24.995288] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:25.217926] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-13T18:14:25.483154] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T18:14:26.017917] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-13T18:14:26.354593] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T18:14:26.817917] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-13T18:14:27.528331] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T18:14:27.617892] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-13T18:14:27.658293] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T18:14:28.418007] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-13T18:14:29.217993] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-13T18:14:29.288984] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T18:14:29.448801] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T18:14:29.962203] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-13T18:14:30.017887] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-13T18:14:30.817900] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-13T18:14:30.846825] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T18:14:31.617906] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-13T18:14:32.281592] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T18:14:32.417897] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-13T18:14:32.485264] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T18:14:33.218016] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-13T18:14:33.849467] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:14:34.018006] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-13T18:14:34.187407] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:14:34.817904] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-13T18:14:35.381811] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T18:14:35.617894] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-13T18:14:35.768760] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T18:14:36.417889] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-13T18:14:36.557559] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T18:14:36.559602] [INFO ] [REMOTE ] CSR: Full fetch complete (17790 records). [2025-10-13T18:14:36.559703] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-13T18:14:36.911225] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-13T18:14:36.911306] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-13T18:14:36.911691] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-13T18:14:36.911750] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-13T18:14:36.912255] [DEBUG] [LOCAL ] CSR: Trimmed 17790 records to 13229 (keeping 200 days of data) [2025-10-13T18:14:36.993772] [DEBUG] [LOCAL ] CSR: Primary data saved (13229 records). [2025-10-13T18:14:36.993905] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-13T18:14:36.993973] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSR took 23.9s. Estimated remaining: 4h 12m 49s. Rate: 7.2 symbols/min [2025-10-13T18:14:37.158040] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:37.158206] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-13T18:14:37.158242] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-13T18:14:37.158345] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-13T18:14:37.158384] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-13T18:14:37.158423] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-13T18:14:37.158453] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-13T18:14:37.223207] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-13T18:14:37.510864] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:37.822323] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T18:14:38.017910] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-13T18:14:38.361837] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T18:14:38.817933] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-13T18:14:39.017269] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:14:39.017574] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-13T18:14:39.017697] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:14:39.017761] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-13T18:14:39.017840] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:14:39.017922] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-13T18:14:39.018035] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-13T18:14:39.018094] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-13T18:14:39.018198] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-13T18:14:39.018263] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSW took 2.0s. Estimated remaining: 4h 12m 19s. Rate: 7.3 symbols/min [2025-10-13T18:14:39.187045] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:39.212301] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T18:14:39.224180] [DEBUG] [LOCAL ] CTBB: Loaded 7130 existing records from primary storage. [2025-10-13T18:14:39.224384] [INFO ] [MAIN ] CTBB: Loaded 7130 existing records. [2025-10-13T18:14:39.395196] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:14:39.395432] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-13T18:14:39.395478] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-13T18:14:39.395693] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-13T18:14:39.395749] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-13T18:14:39.618090] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-13T18:14:39.747531] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:40.417938] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-13T18:14:41.217915] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-13T18:14:41.373499] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-13T18:14:41.449015] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T18:14:42.017916] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-13T18:14:42.229904] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T18:14:42.818026] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-13T18:14:43.220981] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T18:14:43.617947] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-13T18:14:44.118832] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T18:14:44.417939] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-13T18:14:44.637256] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T18:14:45.217924] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-13T18:14:45.939524] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T18:14:45.991726] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T18:14:46.017890] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-13T18:14:46.817991] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-13T18:14:47.411604] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T18:14:47.416404] [INFO ] [REMOTE ] CSTM: Full fetch complete (69310 records). [2025-10-13T18:14:47.416500] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-13T18:14:47.626432] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-13T18:14:47.765917] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T18:14:47.814636] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-13T18:14:47.814744] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-13T18:14:47.815565] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-13T18:14:47.815606] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-13T18:14:47.816903] [DEBUG] [LOCAL ] CSTM: Trimmed 69310 records to 47634 (keeping 200 days of data) [2025-10-13T18:14:48.088128] [DEBUG] [LOCAL ] CSTM: Primary data saved (47634 records). [2025-10-13T18:14:48.088307] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-13T18:14:48.088384] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSTM took 33.2s. Estimated remaining: 4h 12m 13s. Rate: 7.3 symbols/min [2025-10-13T18:14:48.259732] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:48.266172] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T18:14:48.274260] [DEBUG] [LOCAL ] CTDD: Loaded 5856 existing records from primary storage. [2025-10-13T18:14:48.274444] [INFO ] [MAIN ] CTDD: Loaded 5856 existing records. [2025-10-13T18:14:48.425302] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-13T18:14:48.449769] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:14:48.450252] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-13T18:14:48.450309] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-13T18:14:48.450449] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-13T18:14:48.450487] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-13T18:14:48.800433] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:49.218023] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-13T18:14:49.461995] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T18:14:49.851436] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T18:14:50.017902] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-13T18:14:50.757730] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T18:14:50.817885] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-13T18:14:51.617891] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-13T18:14:51.693809] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T18:14:52.417918] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-13T18:14:52.866699] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T18:14:53.013077] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T18:14:53.016486] [INFO ] [REMOTE ] CSL: Full fetch complete (45319 records). [2025-10-13T18:14:53.016562] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-13T18:14:53.226336] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-13T18:14:53.410597] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-13T18:14:53.410703] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-13T18:14:53.411387] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-13T18:14:53.411449] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-13T18:14:53.412433] [DEBUG] [LOCAL ] CSL: Trimmed 45319 records to 31512 (keeping 200 days of data) [2025-10-13T18:14:53.608267] [DEBUG] [LOCAL ] CSL: Primary data saved (31512 records). [2025-10-13T18:14:53.608415] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-13T18:14:53.608495] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CSL took 49.7s. Estimated remaining: 4h 11m 56s. Rate: 7.3 symbols/min [2025-10-13T18:14:53.775267] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:53.775454] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-13T18:14:53.775491] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-13T18:14:53.775624] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-13T18:14:53.775697] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-13T18:14:53.775753] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-13T18:14:53.775786] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-13T18:14:54.022092] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-13T18:14:54.090528] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T18:14:54.173591] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:54.818057] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-13T18:14:54.988638] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T18:14:55.366730] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T18:14:55.617940] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-13T18:14:56.265447] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T18:14:56.417936] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-13T18:14:56.995812] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T18:14:57.217915] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-13T18:14:57.636763] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T18:14:58.017992] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-13T18:14:58.351065] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:14:58.351541] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-13T18:14:58.351668] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:14:58.351734] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-13T18:14:58.351777] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:14:58.351845] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-13T18:14:58.351917] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-13T18:14:58.351955] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-13T18:14:58.351995] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-13T18:14:58.352045] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTEST took 4.7s. Estimated remaining: 4h 11m 36s. Rate: 7.3 symbols/min [2025-10-13T18:14:58.533897] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:14:58.534381] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-13T18:14:58.534441] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-13T18:14:58.534565] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-13T18:14:58.534608] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-13T18:14:58.534687] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-13T18:14:58.534745] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-13T18:14:58.818273] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-13T18:14:58.900769] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:14:59.618014] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-13T18:14:59.849855] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:14:59.850591] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-13T18:14:59.850750] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:14:59.850826] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-13T18:14:59.850896] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:14:59.850970] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-13T18:14:59.851048] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-13T18:14:59.851138] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-13T18:14:59.851191] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-13T18:14:59.851252] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CTEV took 1.5s. Estimated remaining: 4h 11m 5s. Rate: 7.3 symbols/min [2025-10-13T18:15:00.031383] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:00.031779] [DEBUG] [LOCAL ] CTO: No existing data file found in primary storage. [2025-10-13T18:15:00.031871] [WARN ] [MAIN ] CTO: No existing data found, performing full refresh instead. [2025-10-13T18:15:00.032038] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-13T18:15:00.032208] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-13T18:15:00.032340] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-10-13T18:15:00.041271] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-13T18:15:00.042382] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T18:15:00.423072] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-13T18:15:00.428106] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:01.218005] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-13T18:15:01.497419] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T18:15:01.499201] [INFO ] [REMOTE ] CSV: Full fetch complete (19254 records). [2025-10-13T18:15:01.499280] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-13T18:15:01.881290] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-13T18:15:01.881370] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-13T18:15:01.881874] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-13T18:15:01.881935] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-13T18:15:01.882520] [DEBUG] [LOCAL ] CSV: Trimmed 19254 records to 12750 (keeping 200 days of data) [2025-10-13T18:15:01.964815] [DEBUG] [LOCAL ] CSV: Primary data saved (12750 records). [2025-10-13T18:15:01.964973] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-13T18:15:01.965064] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CSV took 37.7s. Estimated remaining: 4h 10m 36s. Rate: 7.3 symbols/min [2025-10-13T18:15:02.023065] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-13T18:15:02.184984] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:02.185204] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-10-13T18:15:02.185247] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-10-13T18:15:02.185360] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-13T18:15:02.185401] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-13T18:15:02.185441] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-13T18:15:02.185494] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-13T18:15:02.527857] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:02.817938] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-13T18:15:02.828115] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T18:15:03.303888] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T18:15:03.617927] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-13T18:15:04.058137] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T18:15:04.417904] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-13T18:15:04.532572] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-13T18:15:04.996905] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T18:15:04.998203] [INFO ] [REMOTE ] CTBB: Full fetch complete (10455 records). [2025-10-13T18:15:04.998273] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-13T18:15:05.223271] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-13T18:15:05.361549] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-13T18:15:05.361633] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-13T18:15:05.361942] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-13T18:15:05.361988] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-13T18:15:05.362518] [DEBUG] [LOCAL ] CTBB: Trimmed 10455 records to 6924 (keeping 200 days of data) [2025-10-13T18:15:05.405431] [DEBUG] [LOCAL ] CTBB: Primary data saved (6924 records). [2025-10-13T18:15:05.405572] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-13T18:15:05.405691] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTBB took 26.4s. Estimated remaining: 4h 10m 12s. Rate: 7.3 symbols/min [2025-10-13T18:15:05.587261] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:05.587434] [DEBUG] [LOCAL ] CTRA: No existing data file found in primary storage. [2025-10-13T18:15:05.587471] [WARN ] [MAIN ] CTRA: No existing data found, performing full refresh instead. [2025-10-13T18:15:05.587582] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-13T18:15:05.587626] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-13T18:15:05.587705] [DEBUG] [LOCAL ] CTRA: No primary data file found to delete. [2025-10-13T18:15:05.587750] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-13T18:15:05.990194] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:06.007901] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T18:15:06.017873] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-13T18:15:06.625016] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T18:15:06.817926] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-13T18:15:07.451357] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-13T18:15:07.618051] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-13T18:15:08.417922] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-13T18:15:09.217891] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-13T18:15:09.630255] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T18:15:09.701733] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T18:15:10.017940] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-13T18:15:10.491412] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T18:15:10.818015] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-13T18:15:11.368096] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T18:15:11.617939] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-13T18:15:11.974121] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T18:15:12.332349] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T18:15:12.417888] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-13T18:15:13.082433] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-13T18:15:13.217940] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-13T18:15:14.018034] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-13T18:15:14.817911] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-13T18:15:15.140028] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-13T18:15:15.248022] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T18:15:15.618014] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-13T18:15:16.057756] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T18:15:16.417902] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-13T18:15:16.461101] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T18:15:17.217922] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-13T18:15:17.405078] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:15:17.728178] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-13T18:15:17.729143] [INFO ] [REMOTE ] CTDD: Full fetch complete (8190 records). [2025-10-13T18:15:17.729210] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-13T18:15:18.023076] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-13T18:15:18.084167] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-13T18:15:18.084249] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-13T18:15:18.084483] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-13T18:15:18.084522] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-13T18:15:18.084943] [DEBUG] [LOCAL ] CTDD: Trimmed 8190 records to 5638 (keeping 200 days of data) [2025-10-13T18:15:18.120020] [DEBUG] [LOCAL ] CTDD: Primary data saved (5638 records). [2025-10-13T18:15:18.120114] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-13T18:15:18.120192] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTDD took 30.0s. Estimated remaining: 4h 10m 19s. Rate: 7.3 symbols/min [2025-10-13T18:15:18.283459] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:18.326556] [DEBUG] [LOCAL ] CTRE: Loaded 50027 existing records from primary storage. [2025-10-13T18:15:18.326893] [INFO ] [MAIN ] CTRE: Loaded 50027 existing records. [2025-10-13T18:15:18.497500] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:15:18.497712] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-13T18:15:18.497784] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-13T18:15:18.499272] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-13T18:15:18.499334] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-13T18:15:18.849085] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:18.825238] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-13T18:15:19.370162] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T18:15:19.618006] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-13T18:15:20.417934] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-13T18:15:21.138238] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-13T18:15:21.230224] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-13T18:15:21.253900] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:15:21.788037] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T18:15:22.017920] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-13T18:15:22.817910] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-13T18:15:23.154434] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T18:15:23.610576] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T18:15:23.621929] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-13T18:15:23.706554] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T18:15:24.417913] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-13T18:15:25.217901] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-13T18:15:25.272227] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T18:15:26.017916] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-13T18:15:26.224964] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T18:15:26.317884] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T18:15:26.817931] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-13T18:15:27.404901] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T18:15:27.617909] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-13T18:15:28.166559] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T18:15:28.418005] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-13T18:15:28.986245] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T18:15:29.217914] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-13T18:15:29.796322] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T18:15:29.799945] [INFO ] [REMOTE ] CTO: Full fetch complete (41556 records). [2025-10-13T18:15:29.800035] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-13T18:15:30.023162] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-13T18:15:30.178359] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-13T18:15:30.178434] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-13T18:15:30.179018] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-13T18:15:30.179079] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-13T18:15:30.179967] [DEBUG] [LOCAL ] CTO: Trimmed 41556 records to 27753 (keeping 200 days of data) [2025-10-13T18:15:30.343202] [DEBUG] [LOCAL ] CTO: Primary data saved (27753 records). [2025-10-13T18:15:30.343330] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-13T18:15:30.343401] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTO took 30.5s. Estimated remaining: 4h 10m 24s. Rate: 7.3 symbols/min [2025-10-13T18:15:30.517268] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:30.517597] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-10-13T18:15:30.517707] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-10-13T18:15:30.517832] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-13T18:15:30.517900] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-13T18:15:30.518006] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-13T18:15:30.518056] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-13T18:15:30.819840] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-13T18:15:30.889404] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:30.916824] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T18:15:31.475154] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:15:31.617923] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-13T18:15:32.417900] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-13T18:15:32.780975] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-13T18:15:32.868415] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T18:15:33.217943] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-13T18:15:34.009384] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T18:15:34.019049] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-13T18:15:34.817892] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-13T18:15:35.091130] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-13T18:15:35.148201] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T18:15:35.617916] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-13T18:15:35.965803] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T18:15:36.417969] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-13T18:15:36.987597] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T18:15:37.217901] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-13T18:15:37.464846] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T18:15:38.017941] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-13T18:15:38.775486] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T18:15:38.817913] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-13T18:15:39.617919] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-13T18:15:39.923733] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-13T18:15:40.417978] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-13T18:15:40.513222] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T18:15:40.644514] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T18:15:41.217970] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-13T18:15:42.017923] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-13T18:15:42.243129] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T18:15:42.469924] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T18:15:42.817983] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-13T18:15:43.592223] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T18:15:43.617893] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-13T18:15:44.417911] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-13T18:15:44.688595] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T18:15:45.042231] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T18:15:45.217922] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-13T18:15:45.573961] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T18:15:46.017937] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-13T18:15:46.518908] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T18:15:46.523125] [INFO ] [REMOTE ] CTOS: Full fetch complete (53657 records). [2025-10-13T18:15:46.523220] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-13T18:15:46.823031] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-13T18:15:46.903818] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-13T18:15:46.903895] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-13T18:15:46.904553] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-13T18:15:46.904591] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-13T18:15:46.905712] [DEBUG] [LOCAL ] CTOS: Trimmed 53657 records to 37028 (keeping 200 days of data) [2025-10-13T18:15:47.110865] [DEBUG] [LOCAL ] CTOS: Primary data saved (37028 records). [2025-10-13T18:15:47.111002] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-13T18:15:47.111074] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTOS took 45.1s. Estimated remaining: 4h 10m 44s. Rate: 7.3 symbols/min [2025-10-13T18:15:47.291269] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:47.311327] [DEBUG] [LOCAL ] CTS: Loaded 19662 existing records from primary storage. [2025-10-13T18:15:47.311608] [INFO ] [MAIN ] CTS: Loaded 19662 existing records. [2025-10-13T18:15:47.455979] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:15:47.522225] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:15:47.522435] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-13T18:15:47.522496] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-13T18:15:47.522816] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-13T18:15:47.522882] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-13T18:15:47.624042] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-13T18:15:47.874890] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:48.417890] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-13T18:15:48.744415] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-13T18:15:48.750767] [INFO ] [REMOTE ] CTRA: Full fetch complete (77661 records). [2025-10-13T18:15:48.750922] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-13T18:15:49.145542] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-13T18:15:49.145716] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-13T18:15:49.146685] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-13T18:15:49.146771] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-13T18:15:49.152833] [DEBUG] [LOCAL ] CTRA: Trimmed 77661 records to 53646 (keeping 200 days of data) [2025-10-13T18:15:49.240772] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-13T18:15:49.281785] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T18:15:49.516243] [DEBUG] [LOCAL ] CTRA: Primary data saved (53646 records). [2025-10-13T18:15:49.516382] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-13T18:15:49.516499] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRA took 44.1s. Estimated remaining: 4h 10m 16s. Rate: 7.3 symbols/min [2025-10-13T18:15:49.687098] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:49.687320] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-10-13T18:15:49.687442] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-10-13T18:15:49.687553] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-13T18:15:49.687595] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-13T18:15:49.687635] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-13T18:15:49.687710] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-13T18:15:50.018346] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-13T18:15:50.078727] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:50.051364] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T18:15:50.256923] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T18:15:50.817927] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-13T18:15:51.617900] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-13T18:15:51.697623] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T18:15:51.702577] [INFO ] [REMOTE ] CTRE: Full fetch complete (70782 records). [2025-10-13T18:15:51.702750] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-13T18:15:51.703514] [FATAL] [VALIDATOR ] CTRE: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:15:51.703621] [FATAL] [MAIN ] CTRE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:15:51.703718] [WARN ] [MAIN ] CTRE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:15:51.703805] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-13T18:15:51.703898] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-13T18:15:51.703954] [INFO ] [LOCAL ] CTRE: Starting deletion of derivative data. [2025-10-13T18:15:51.704371] [DEBUG] [LOCAL ] CTRE: Deleted derivative data file. [2025-10-13T18:15:51.705478] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRE took 33.6s. Estimated remaining: 4h 9m 48s. Rate: 7.3 symbols/min [2025-10-13T18:15:51.878135] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:51.878428] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-13T18:15:51.878480] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-13T18:15:51.878591] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-13T18:15:51.878632] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-13T18:15:51.878727] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-13T18:15:51.878777] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-13T18:15:52.275278] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T18:15:52.296562] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:15:52.417910] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-13T18:15:52.953222] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T18:15:53.217930] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-13T18:15:53.657061] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T18:15:54.017916] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-13T18:15:54.147541] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T18:15:54.351821] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-13T18:15:54.817920] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-13T18:15:55.617930] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-13T18:15:56.417919] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-13T18:15:56.471910] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T18:15:56.588524] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T18:15:56.649524] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-13T18:15:57.217935] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-13T18:15:58.017917] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-13T18:15:58.654569] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T18:15:58.660569] [INFO ] [REMOTE ] CTRI: Full fetch complete (52991 records). [2025-10-13T18:15:58.660824] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-13T18:15:58.823137] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-13T18:15:59.074837] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-13T18:15:59.074948] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-13T18:15:59.076085] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-13T18:15:59.076154] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-13T18:15:59.077713] [DEBUG] [LOCAL ] CTRI: Trimmed 52991 records to 39822 (keeping 200 days of data) [2025-10-13T18:15:59.327332] [DEBUG] [LOCAL ] CTRI: Primary data saved (39822 records). [2025-10-13T18:15:59.327553] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-13T18:15:59.327760] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTRI took 29.0s. Estimated remaining: 4h 9m 37s. Rate: 7.3 symbols/min [2025-10-13T18:15:59.523018] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:15:59.582216] [DEBUG] [LOCAL ] CUBE: Loaded 51520 existing records from primary storage. [2025-10-13T18:15:59.582637] [INFO ] [MAIN ] CUBE: Loaded 51520 existing records. [2025-10-13T18:15:59.622595] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-13T18:15:59.790320] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:15:59.791104] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-13T18:15:59.791230] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-13T18:15:59.792073] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-13T18:15:59.792134] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-13T18:15:59.935114] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-13T18:16:00.046079] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T18:16:00.078240] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-13T18:16:00.263775] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:00.417974] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-13T18:16:01.217919] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-13T18:16:02.023035] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-13T18:16:02.039290] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T18:16:02.690282] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T18:16:02.817967] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-13T18:16:03.380836] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T18:16:03.617941] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-13T18:16:04.417989] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-13T18:16:04.542332] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T18:16:04.723330] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:16:04.836506] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T18:16:05.217945] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-13T18:16:05.551832] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-13T18:16:06.018006] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-13T18:16:06.818041] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-13T18:16:07.011393] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T18:16:07.099589] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-13T18:16:07.617999] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-13T18:16:07.849252] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-13T18:16:08.417944] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-13T18:16:09.217987] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-13T18:16:09.519590] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T18:16:10.017995] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-13T18:16:10.817913] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-13T18:16:11.062883] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:16:11.528903] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T18:16:11.617934] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-13T18:16:11.854676] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T18:16:11.956718] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-13T18:16:12.417979] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-13T18:16:12.686901] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-13T18:16:13.217937] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-13T18:16:14.017975] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-13T18:16:14.329595] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-13T18:16:14.817905] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-13T18:16:14.963593] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T18:16:15.313419] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T18:16:15.314187] [INFO ] [REMOTE ] CUBB: Full fetch complete (911 records). [2025-10-13T18:16:15.314256] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-13T18:16:15.510730] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-13T18:16:15.510953] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:16:15.511024] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:16:15.511102] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-13T18:16:15.511164] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-13T18:16:15.511200] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-13T18:16:15.511241] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-13T18:16:15.511296] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CUBB took 23.8s. Estimated remaining: 4h 9m 55s. Rate: 7.3 symbols/min [2025-10-13T18:16:15.623126] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-13T18:16:15.681695] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:15.715385] [DEBUG] [LOCAL ] CUBI: Loaded 27426 existing records from primary storage. [2025-10-13T18:16:15.715686] [INFO ] [MAIN ] CUBI: Loaded 27426 existing records. [2025-10-13T18:16:15.899623] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:15.899905] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-13T18:16:15.899953] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-13T18:16:15.900176] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-13T18:16:15.900233] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-13T18:16:16.280697] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:16.418004] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-13T18:16:17.217895] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-13T18:16:17.365182] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T18:16:17.450467] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T18:16:18.018001] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-13T18:16:18.710133] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T18:16:18.817886] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-13T18:16:19.091522] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T18:16:19.617925] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-13T18:16:20.417892] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-13T18:16:20.541947] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T18:16:20.623701] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T18:16:21.217892] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-13T18:16:21.414693] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T18:16:22.017914] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-13T18:16:22.817921] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-13T18:16:22.914600] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:16:23.184719] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T18:16:23.617912] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-13T18:16:23.682479] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T18:16:23.684779] [INFO ] [REMOTE ] CTS: Full fetch complete (26770 records). [2025-10-13T18:16:23.684897] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-13T18:16:24.065251] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-13T18:16:24.065334] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-13T18:16:24.065808] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-13T18:16:24.065869] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-13T18:16:24.066588] [DEBUG] [LOCAL ] CTS: Trimmed 26770 records to 19511 (keeping 200 days of data) [2025-10-13T18:16:24.187128] [DEBUG] [LOCAL ] CTS: Primary data saved (19511 records). [2025-10-13T18:16:24.187273] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-13T18:16:24.187352] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CTS took 37.1s. Estimated remaining: 4h 9m 48s. Rate: 7.3 symbols/min [2025-10-13T18:16:24.378492] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:24.427274] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-13T18:16:24.430790] [DEBUG] [LOCAL ] CUK: Loaded 51722 existing records from primary storage. [2025-10-13T18:16:24.431211] [INFO ] [MAIN ] CUK: Loaded 51722 existing records. [2025-10-13T18:16:24.610958] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:24.611176] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-13T18:16:24.611222] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-13T18:16:24.611599] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-13T18:16:24.611689] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-13T18:16:24.979577] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:25.130502] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T18:16:25.217907] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-13T18:16:26.017993] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-13T18:16:26.255562] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T18:16:26.299846] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-13T18:16:26.817903] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-13T18:16:27.617900] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-13T18:16:27.948235] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T18:16:28.417904] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-13T18:16:28.617303] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:16:29.217938] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-13T18:16:29.610709] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-13T18:16:29.891632] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T18:16:30.017933] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-13T18:16:30.655539] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:16:30.817910] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-13T18:16:31.617927] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-13T18:16:31.855877] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T18:16:31.963887] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T18:16:32.417944] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-13T18:16:33.193466] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T18:16:33.217886] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-13T18:16:34.013427] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:16:34.022562] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-13T18:16:34.794939] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T18:16:34.817888] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-13T18:16:35.352498] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T18:16:35.617920] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-13T18:16:36.417903] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-13T18:16:36.497684] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T18:16:36.562681] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T18:16:37.217941] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-13T18:16:38.017922] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-13T18:16:38.182815] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T18:16:38.817912] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-13T18:16:39.208940] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T18:16:39.210291] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T18:16:39.617904] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-13T18:16:40.262982] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T18:16:40.268194] [INFO ] [REMOTE ] CUBE: Full fetch complete (73052 records). [2025-10-13T18:16:40.268308] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-13T18:16:40.424669] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-13T18:16:40.659612] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-13T18:16:40.659743] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-13T18:16:40.660579] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-13T18:16:40.660662] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-13T18:16:40.662098] [DEBUG] [LOCAL ] CUBE: Trimmed 73052 records to 50841 (keeping 200 days of data) [2025-10-13T18:16:40.888396] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T18:16:40.894256] [INFO ] [REMOTE ] CUBI: Full fetch complete (38883 records). [2025-10-13T18:16:40.896186] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-13T18:16:40.901227] [FATAL] [VALIDATOR ] CUBI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:16:40.905222] [FATAL] [MAIN ] CUBI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:16:40.907154] [WARN ] [MAIN ] CUBI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:16:40.908076] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-13T18:16:40.909260] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-10-13T18:16:40.910676] [INFO ] [LOCAL ] CUBI: Starting deletion of derivative data. [2025-10-13T18:16:40.912675] [DEBUG] [LOCAL ] CUBI: Deleted derivative data file. [2025-10-13T18:16:40.913279] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBI took 25.4s. Estimated remaining: 4h 10m 8s. Rate: 7.3 symbols/min [2025-10-13T18:16:41.137900] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:41.166429] [DEBUG] [LOCAL ] CULP: Loaded 2919 existing records from primary storage. [2025-10-13T18:16:41.173441] [INFO ] [MAIN ] CULP: Loaded 2919 existing records. [2025-10-13T18:16:41.232408] [DEBUG] [LOCAL ] CUBE: Primary data saved (50841 records). [2025-10-13T18:16:41.240873] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-13T18:16:41.241064] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBE took 41.9s. Estimated remaining: 4h 9m 34s. Rate: 7.3 symbols/min [2025-10-13T18:16:41.225540] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-13T18:16:41.381911] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:41.382258] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-13T18:16:41.382320] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-13T18:16:41.382576] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-13T18:16:41.382635] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-13T18:16:41.779280] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:42.018028] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-13T18:16:42.376008] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T18:16:42.381686] [INFO ] [REMOTE ] CTVA: Full fetch complete (77007 records). [2025-10-13T18:16:42.381835] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-13T18:16:42.702893] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T18:16:42.807852] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-13T18:16:42.807973] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-13T18:16:42.808978] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-13T18:16:42.809044] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-13T18:16:42.810728] [DEBUG] [LOCAL ] CTVA: Trimmed 77007 records to 53277 (keeping 200 days of data) [2025-10-13T18:16:42.867075] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-13T18:16:43.175493] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T18:16:43.207430] [DEBUG] [LOCAL ] CTVA: Primary data saved (53277 records). [2025-10-13T18:16:43.207599] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-13T18:16:43.207705] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CTVA took 53.7s. Estimated remaining: 4h 9m 5s. Rate: 7.3 symbols/min [2025-10-13T18:16:43.501563] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-13T18:16:43.617943] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-13T18:16:44.168053] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T18:16:44.417923] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-13T18:16:44.880291] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-13T18:16:45.217942] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-13T18:16:46.017997] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-13T18:16:46.516664] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-13T18:16:46.817923] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-13T18:16:46.982541] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T18:16:47.139368] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-13T18:16:47.617919] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-13T18:16:48.418018] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-13T18:16:48.954608] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T18:16:49.217923] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-13T18:16:49.323412] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:16:49.768854] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T18:16:50.017939] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-13T18:16:50.524293] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-13T18:16:50.817986] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-13T18:16:51.618054] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-13T18:16:52.118037] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T18:16:52.304867] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T18:16:52.417926] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-13T18:16:53.217993] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-13T18:16:53.922226] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T18:16:53.923107] [INFO ] [REMOTE ] CULP: Full fetch complete (4588 records). [2025-10-13T18:16:53.923177] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-13T18:16:54.316259] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-13T18:16:54.316380] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-13T18:16:54.316580] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-13T18:16:54.316890] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-13T18:16:54.317607] [DEBUG] [LOCAL ] CULP: Trimmed 4588 records to 2895 (keeping 200 days of data) [2025-10-13T18:16:54.336481] [DEBUG] [LOCAL ] CULP: Primary data saved (2895 records). [2025-10-13T18:16:54.336625] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-13T18:16:54.336863] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CULP took 13.4s. Estimated remaining: 4h 9m 6s. Rate: 7.3 symbols/min [2025-10-13T18:16:54.366195] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T18:16:54.377474] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-13T18:16:56.194251] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T18:16:56.200161] [INFO ] [REMOTE ] CUK: Full fetch complete (74053 records). [2025-10-13T18:16:56.200291] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-13T18:16:56.644631] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-13T18:16:56.644737] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-13T18:16:56.645808] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-13T18:16:56.645873] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-13T18:16:56.647362] [DEBUG] [LOCAL ] CUK: Trimmed 74053 records to 51023 (keeping 200 days of data) [2025-10-13T18:16:56.947388] [DEBUG] [LOCAL ] CUK: Primary data saved (51023 records). [2025-10-13T18:16:56.947498] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-13T18:16:56.947576] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CUK took 32.8s. Estimated remaining: 4h 8m 40s. Rate: 7.3 symbols/min [2025-10-13T18:16:57.561687] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:57.564840] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:57.631827] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-10-13T18:16:57.687797] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-10-13T18:16:57.687732] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:57.692490] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-13T18:16:57.692766] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-13T18:16:57.713417] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:16:57.713808] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-13T18:16:57.713900] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-13T18:16:57.943875] [DEBUG] [LOCAL ] CURV: Loaded 27271 existing records from primary storage. [2025-10-13T18:16:57.954823] [INFO ] [MAIN ] CURV: Loaded 27271 existing records. [2025-10-13T18:16:58.092959] [DEBUG] [LOCAL ] CUZ: Loaded 50127 existing records from primary storage. [2025-10-13T18:16:58.203756] [INFO ] [MAIN ] CUZ: Loaded 50127 existing records. [2025-10-13T18:16:58.297187] [DEBUG] [LOCAL ] CVE: Loaded 54339 existing records from primary storage. [2025-10-13T18:16:58.377740] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:58.400774] [INFO ] [MAIN ] CVE: Loaded 54339 existing records. [2025-10-13T18:16:58.413727] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-13T18:16:58.482956] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:58.573247] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-13T18:16:58.587121] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-13T18:16:58.653135] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-13T18:16:58.666702] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-13T18:16:58.810674] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:58.952213] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-13T18:16:58.959418] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:16:58.971110] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-13T18:16:58.976630] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-13T18:16:59.009297] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-13T18:16:59.016271] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-13T18:16:59.009532] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-13T18:16:59.102507] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-13T18:16:59.170436] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-13T18:16:59.907776] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:16:59.959987] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-13T18:17:00.170529] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:00.171207] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-13T18:17:00.230970] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T18:17:00.276420] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-13T18:17:00.348546] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:00.349161] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-13T18:17:01.405916] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T18:17:01.414381] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-13T18:17:01.632157] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T18:17:01.639166] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-13T18:17:01.856266] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T18:17:01.869001] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-13T18:17:01.915420] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T18:17:01.927978] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-13T18:17:02.544415] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T18:17:02.550294] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-13T18:17:02.917587] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:17:02.924080] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-13T18:17:03.314933] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T18:17:03.433754] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T18:17:03.497988] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:17:03.617887] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-13T18:17:04.310401] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T18:17:04.417913] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-13T18:17:05.223272] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-13T18:17:05.242201] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T18:17:05.710093] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T18:17:06.017900] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-13T18:17:06.819676] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-13T18:17:06.824411] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:17:07.617911] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-13T18:17:07.917747] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T18:17:07.969816] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T18:17:08.417985] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-13T18:17:08.964744] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T18:17:09.217893] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-13T18:17:09.679292] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T18:17:10.017927] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-13T18:17:10.716873] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T18:17:10.817882] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-13T18:17:11.434887] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T18:17:11.617919] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-13T18:17:12.417902] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-13T18:17:12.543350] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:17:12.757520] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T18:17:13.217983] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-13T18:17:13.844601] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T18:17:14.017968] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-13T18:17:14.817896] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-13T18:17:15.206881] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T18:17:15.230429] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T18:17:15.617929] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-13T18:17:15.908365] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T18:17:16.417905] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-13T18:17:16.616528] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-13T18:17:17.217920] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-13T18:17:17.518900] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T18:17:17.522400] [INFO ] [REMOTE ] CURB: Full fetch complete (46831 records). [2025-10-13T18:17:17.522485] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-13T18:17:17.523175] [FATAL] [VALIDATOR ] CURB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:17:17.523259] [FATAL] [MAIN ] CURB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:17:17.523301] [WARN ] [MAIN ] CURB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:17:17.523339] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-13T18:17:17.523419] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-13T18:17:17.523474] [INFO ] [LOCAL ] CURB: Starting deletion of derivative data. [2025-10-13T18:17:17.523517] [DEBUG] [LOCAL ] CURB: No derivative data file found to delete. [2025-10-13T18:17:17.523572] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CURB took 20.6s. Estimated remaining: 4h 9m 11s. Rate: 7.3 symbols/min [2025-10-13T18:17:17.691678] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:17:17.706616] [DEBUG] [LOCAL ] CVEO: Loaded 15540 existing records from primary storage. [2025-10-13T18:17:17.706877] [INFO ] [MAIN ] CVEO: Loaded 15540 existing records. [2025-10-13T18:17:17.884854] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:17:17.885042] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-13T18:17:17.885087] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-13T18:17:17.885341] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-13T18:17:17.885379] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-13T18:17:18.031960] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-13T18:17:18.255394] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:18.774077] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T18:17:18.817884] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-13T18:17:19.311133] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T18:17:19.617918] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-13T18:17:20.414637] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T18:17:20.424272] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-13T18:17:21.206504] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T18:17:21.217878] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-13T18:17:21.398424] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T18:17:22.017924] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-13T18:17:22.817894] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-13T18:17:22.850328] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T18:17:22.868345] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-13T18:17:23.617929] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-13T18:17:24.352569] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:17:24.417940] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-13T18:17:25.217935] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-13T18:17:25.221666] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T18:17:26.017911] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-13T18:17:26.055938] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T18:17:26.724731] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T18:17:26.817891] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-13T18:17:27.519850] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T18:17:27.617884] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-13T18:17:28.187142] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T18:17:28.190776] [INFO ] [REMOTE ] CURV: Full fetch complete (38897 records). [2025-10-13T18:17:28.190871] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-13T18:17:28.426862] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-13T18:17:28.560284] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-13T18:17:28.560355] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-13T18:17:28.560917] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-13T18:17:28.560977] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-13T18:17:28.561814] [DEBUG] [LOCAL ] CURV: Trimmed 38897 records to 26844 (keeping 200 days of data) [2025-10-13T18:17:28.706694] [DEBUG] [LOCAL ] CURV: Primary data saved (26844 records). [2025-10-13T18:17:28.706824] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-13T18:17:28.706902] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CURV took 31.8s. Estimated remaining: 4h 9m 12s. Rate: 7.3 symbols/min [2025-10-13T18:17:28.874915] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:17:28.916411] [DEBUG] [LOCAL ] CVI: Loaded 47237 existing records from primary storage. [2025-10-13T18:17:28.916744] [INFO ] [MAIN ] CVI: Loaded 47237 existing records. [2025-10-13T18:17:29.101250] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:17:29.101595] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-13T18:17:29.101694] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-13T18:17:29.102081] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-13T18:17:29.102136] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-13T18:17:29.223147] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-13T18:17:29.463707] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:29.493544] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T18:17:29.735301] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T18:17:30.017937] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-13T18:17:30.066345] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T18:17:30.817904] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-13T18:17:30.884563] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T18:17:31.617925] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-13T18:17:32.417976] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-13T18:17:32.624403] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T18:17:33.217892] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-13T18:17:33.260004] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:17:33.265382] [INFO ] [REMOTE ] CVE: Full fetch complete (77563 records). [2025-10-13T18:17:33.265482] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-13T18:17:33.591839] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T18:17:33.693858] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-13T18:17:33.693953] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-13T18:17:33.694840] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-13T18:17:33.694901] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-13T18:17:33.696344] [DEBUG] [LOCAL ] CVE: Trimmed 77563 records to 53561 (keeping 200 days of data) [2025-10-13T18:17:34.014974] [DEBUG] [LOCAL ] CVE: Primary data saved (53561 records). [2025-10-13T18:17:34.015107] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-13T18:17:34.015182] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CVE took 37.1s. Estimated remaining: 4h 8m 55s. Rate: 7.3 symbols/min [2025-10-13T18:17:34.026399] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-13T18:17:34.185336] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:17:34.185484] [DEBUG] [LOCAL ] CVLG: No existing data file found in primary storage. [2025-10-13T18:17:34.185521] [WARN ] [MAIN ] CVLG: No existing data found, performing full refresh instead. [2025-10-13T18:17:34.185630] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-13T18:17:34.185704] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-13T18:17:34.185755] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-13T18:17:34.185788] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-13T18:17:34.526996] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:34.817892] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-13T18:17:34.920862] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:17:34.925768] [INFO ] [REMOTE ] CUZ: Full fetch complete (70703 records). [2025-10-13T18:17:34.925869] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-13T18:17:35.207136] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T18:17:35.322509] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-13T18:17:35.322583] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-13T18:17:35.323384] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-13T18:17:35.323445] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-13T18:17:35.324772] [DEBUG] [LOCAL ] CUZ: Trimmed 70703 records to 49541 (keeping 200 days of data) [2025-10-13T18:17:35.614216] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T18:17:35.617917] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-13T18:17:35.633172] [DEBUG] [LOCAL ] CUZ: Primary data saved (49541 records). [2025-10-13T18:17:35.633533] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-13T18:17:35.633618] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CUZ took 38.7s. Estimated remaining: 4h 8m 25s. Rate: 7.3 symbols/min [2025-10-13T18:17:35.798188] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:17:35.846899] [DEBUG] [LOCAL ] CVNA: Loaded 53666 existing records from primary storage. [2025-10-13T18:17:35.847203] [INFO ] [MAIN ] CVNA: Loaded 53666 existing records. [2025-10-13T18:17:36.020158] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:17:36.020395] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-13T18:17:36.020441] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-13T18:17:36.021043] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-13T18:17:36.021102] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-13T18:17:36.365639] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:36.417898] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-13T18:17:36.784377] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:17:37.218004] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-13T18:17:38.017978] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-13T18:17:38.223150] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T18:17:38.488947] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-13T18:17:38.565771] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T18:17:38.817935] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-13T18:17:39.617939] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-13T18:17:40.175228] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T18:17:40.417928] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-13T18:17:41.008792] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T18:17:41.217987] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-13T18:17:41.783266] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-13T18:17:42.017899] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-13T18:17:42.177697] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T18:17:42.817975] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-13T18:17:43.617934] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-13T18:17:43.668943] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T18:17:43.793109] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T18:17:44.417933] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-13T18:17:45.217905] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-13T18:17:45.260451] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-13T18:17:45.694251] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-13T18:17:46.018007] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-13T18:17:46.191801] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T18:17:46.646802] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T18:17:46.817923] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-13T18:17:47.584737] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T18:17:47.586747] [INFO ] [REMOTE ] CVEO: Full fetch complete (20593 records). [2025-10-13T18:17:47.586892] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-13T18:17:47.587383] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:17:47.587468] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:17:47.587512] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:17:47.587558] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-13T18:17:47.587613] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-13T18:17:47.587676] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-10-13T18:17:47.587859] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-10-13T18:17:47.587979] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVEO took 30.1s. Estimated remaining: 4h 8m 29s. Rate: 7.3 symbols/min [2025-10-13T18:17:47.619307] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-13T18:17:47.755835] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:17:47.807667] [DEBUG] [LOCAL ] CVS: Loaded 54474 existing records from primary storage. [2025-10-13T18:17:47.808029] [INFO ] [MAIN ] CVS: Loaded 54474 existing records. [2025-10-13T18:17:47.981027] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:17:47.981260] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-13T18:17:47.981307] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-13T18:17:47.981852] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-13T18:17:47.981910] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-13T18:17:48.327281] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:17:48.417922] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-13T18:17:49.218016] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-13T18:17:49.390465] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T18:17:50.017933] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-13T18:17:50.431407] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-13T18:17:50.828008] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-13T18:17:50.835161] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-13T18:17:51.548458] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:17:51.617925] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-13T18:17:52.418014] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-13T18:17:53.046090] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:17:53.104563] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-13T18:17:53.217935] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-13T18:17:53.525245] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T18:17:54.017998] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-13T18:17:54.817979] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-13T18:17:55.083874] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T18:17:55.617924] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-13T18:17:55.773462] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-13T18:17:56.184582] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-13T18:17:56.418005] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-13T18:17:57.181960] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T18:17:57.217900] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-13T18:17:58.017980] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-13T18:17:58.444240] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-13T18:17:58.664141] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T18:17:58.764095] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T18:17:58.817935] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-13T18:17:59.621729] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-13T18:17:59.625290] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T18:18:00.417987] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-13T18:18:01.217997] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-13T18:18:01.530776] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T18:18:01.884322] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:18:01.886289] [INFO ] [REMOTE ] CVLG: Full fetch complete (21149 records). [2025-10-13T18:18:01.886369] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-13T18:18:01.887000] [FATAL] [VALIDATOR ] CVLG: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:18:01.887091] [FATAL] [MAIN ] CVLG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:18:01.887140] [WARN ] [MAIN ] CVLG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:18:01.887189] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-13T18:18:01.887261] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-13T18:18:01.887301] [INFO ] [LOCAL ] CVLG: Starting deletion of derivative data. [2025-10-13T18:18:01.887342] [DEBUG] [LOCAL ] CVLG: No derivative data file found to delete. [2025-10-13T18:18:01.887439] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVLG took 27.9s. Estimated remaining: 4h 8m 40s. Rate: 7.3 symbols/min [2025-10-13T18:18:02.033905] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-13T18:18:02.072903] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:02.133393] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-10-13T18:18:02.133862] [INFO ] [MAIN ] CVX: Loaded 54540 existing records. [2025-10-13T18:18:02.327144] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:02.327436] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-13T18:18:02.327486] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-13T18:18:02.328198] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-13T18:18:02.328257] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-13T18:18:02.710514] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:02.817975] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-13T18:18:03.595162] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T18:18:03.617919] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-13T18:18:03.673010] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-13T18:18:04.417984] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-13T18:18:04.969921] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T18:18:05.161078] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T18:18:05.166319] [INFO ] [REMOTE ] CVI: Full fetch complete (66893 records). [2025-10-13T18:18:05.166509] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-13T18:18:05.167532] [FATAL] [VALIDATOR ] CVI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:18:05.167626] [FATAL] [MAIN ] CVI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:18:05.167709] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:18:05.167767] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-13T18:18:05.167831] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-13T18:18:05.167867] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-13T18:18:05.168059] [DEBUG] [LOCAL ] CVI: Deleted derivative data file. [2025-10-13T18:18:05.168163] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVI took 36.5s. Estimated remaining: 4h 8m 16s. Rate: 7.3 symbols/min [2025-10-13T18:18:05.223097] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-13T18:18:05.347007] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:05.369101] [DEBUG] [LOCAL ] CW: Loaded 22494 existing records from primary storage. [2025-10-13T18:18:05.369374] [INFO ] [MAIN ] CW: Loaded 22494 existing records. [2025-10-13T18:18:05.545425] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:05.545693] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-13T18:18:05.545761] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-13T18:18:05.546214] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-13T18:18:05.546251] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-13T18:18:05.906818] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:06.017968] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-13T18:18:06.250429] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T18:18:06.817987] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-13T18:18:07.164590] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T18:18:07.395361] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-13T18:18:07.618000] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-13T18:18:08.417978] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-13T18:18:08.684341] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T18:18:09.155676] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-13T18:18:09.217983] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-13T18:18:10.017996] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-13T18:18:10.439049] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T18:18:10.534230] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T18:18:10.817975] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-13T18:18:11.618163] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-13T18:18:12.022397] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-13T18:18:12.417975] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-13T18:18:12.698394] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T18:18:13.217999] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-13T18:18:13.598439] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T18:18:14.017994] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-13T18:18:14.625904] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-13T18:18:14.817989] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-13T18:18:15.087287] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T18:18:15.452873] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-13T18:18:15.617979] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-13T18:18:16.417982] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-13T18:18:16.739883] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T18:18:16.945020] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-13T18:18:17.217967] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-13T18:18:18.017975] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-13T18:18:18.392099] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T18:18:18.796122] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T18:18:18.817903] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-13T18:18:19.617908] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-13T18:18:19.815833] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:18:19.930746] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T18:18:20.418048] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-13T18:18:21.217916] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-13T18:18:21.592616] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T18:18:22.016280] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-13T18:18:22.027466] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-13T18:18:22.817977] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-13T18:18:23.076023] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T18:18:23.617984] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-13T18:18:24.011017] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T18:18:24.417983] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-13T18:18:24.975485] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T18:18:24.982266] [INFO ] [REMOTE ] CVS: Full fetch complete (77811 records). [2025-10-13T18:18:24.982502] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-13T18:18:25.238541] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-13T18:18:25.510496] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-13T18:18:25.510673] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-13T18:18:25.512407] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-13T18:18:25.512750] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-13T18:18:25.515269] [DEBUG] [LOCAL ] CVS: Trimmed 77811 records to 53694 (keeping 200 days of data) [2025-10-13T18:18:25.556091] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-13T18:18:25.718046] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-13T18:18:25.731537] [INFO ] [REMOTE ] CVNA: Full fetch complete (76647 records). [2025-10-13T18:18:25.732346] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-13T18:18:26.036692] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-13T18:18:26.290902] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-13T18:18:26.291016] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-13T18:18:26.293111] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-13T18:18:26.293195] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-13T18:18:26.316023] [DEBUG] [LOCAL ] CVNA: Trimmed 76647 records to 52878 (keeping 200 days of data) [2025-10-13T18:18:26.526155] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T18:18:26.535241] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-13T18:18:26.536415] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-13T18:18:26.536768] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVS took 38.9s. Estimated remaining: 4h 8m 49s. Rate: 7.2 symbols/min [2025-10-13T18:18:26.743129] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:26.820875] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-13T18:18:26.999205] [DEBUG] [LOCAL ] CWAN: Loaded 53226 existing records from primary storage. [2025-10-13T18:18:27.001219] [INFO ] [MAIN ] CWAN: Loaded 53226 existing records. [2025-10-13T18:18:27.220269] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:27.224462] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-13T18:18:27.227570] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-13T18:18:27.227627] [DEBUG] [LOCAL ] CVNA: Primary data saved (52878 records). [2025-10-13T18:18:27.227834] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-13T18:18:27.228902] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-13T18:18:27.228859] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CVNA took 51.6s. Estimated remaining: 4h 8m 17s. Rate: 7.3 symbols/min [2025-10-13T18:18:27.229032] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-13T18:18:27.592789] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:27.839071] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:27.839569] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-13T18:18:27.859765] [DEBUG] [LOCAL ] CWEN: Loaded 45951 existing records from primary storage. [2025-10-13T18:18:27.860135] [INFO ] [MAIN ] CWEN: Loaded 45951 existing records. [2025-10-13T18:18:27.992463] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T18:18:28.076980] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:28.077260] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-13T18:18:28.077312] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-13T18:18:28.077760] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-13T18:18:28.077817] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-13T18:18:28.418904] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-13T18:18:28.512910] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:28.554154] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-13T18:18:29.217988] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-13T18:18:29.585474] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T18:18:29.588481] [INFO ] [REMOTE ] CW: Full fetch complete (33026 records). [2025-10-13T18:18:29.588581] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-13T18:18:29.926666] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T18:18:30.021604] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-13T18:18:30.022162] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-13T18:18:30.023386] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-13T18:18:30.024518] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-13T18:18:30.024716] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-13T18:18:30.026635] [DEBUG] [LOCAL ] CW: Trimmed 33026 records to 22235 (keeping 200 days of data) [2025-10-13T18:18:30.178702] [DEBUG] [LOCAL ] CW: Primary data saved (22235 records). [2025-10-13T18:18:30.178882] [INFO ] [MAIN ] CW: Full history saved. [2025-10-13T18:18:30.178981] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CW took 25.0s. Estimated remaining: 4h 7m 52s. Rate: 7.3 symbols/min [2025-10-13T18:18:30.353063] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:30.353274] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-10-13T18:18:30.353311] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-10-13T18:18:30.353463] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-13T18:18:30.353507] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-13T18:18:30.353548] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-13T18:18:30.353581] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-13T18:18:30.719989] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:30.748713] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T18:18:30.817933] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-13T18:18:31.617977] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-13T18:18:32.404348] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T18:18:32.417881] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-13T18:18:32.505591] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-13T18:18:33.187455] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T18:18:33.217888] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-13T18:18:33.613756] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T18:18:34.018020] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-13T18:18:34.819495] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-13T18:18:34.821987] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T18:18:35.367888] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T18:18:35.617925] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-13T18:18:36.417915] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-13T18:18:36.649354] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T18:18:37.186030] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T18:18:37.217976] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-13T18:18:37.875724] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:18:38.017985] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-13T18:18:38.564333] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T18:18:38.817992] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-13T18:18:39.618016] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-13T18:18:40.395339] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-13T18:18:40.417889] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-13T18:18:40.599450] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T18:18:40.937234] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T18:18:41.146927] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T18:18:41.153199] [INFO ] [REMOTE ] CVX: Full fetch complete (77455 records). [2025-10-13T18:18:41.153419] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-13T18:18:41.154329] [FATAL] [VALIDATOR ] CVX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:18:41.154433] [FATAL] [MAIN ] CVX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:18:41.154477] [WARN ] [MAIN ] CVX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:18:41.154519] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-13T18:18:41.154584] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-13T18:18:41.154622] [INFO ] [LOCAL ] CVX: Starting deletion of derivative data. [2025-10-13T18:18:41.155093] [DEBUG] [LOCAL ] CVX: Deleted derivative data file. [2025-10-13T18:18:41.155391] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CVX took 39.3s. Estimated remaining: 4h 7m 52s. Rate: 7.3 symbols/min [2025-10-13T18:18:41.223167] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-13T18:18:41.334086] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:41.381563] [DEBUG] [LOCAL ] CWK: Loaded 50175 existing records from primary storage. [2025-10-13T18:18:41.381930] [INFO ] [MAIN ] CWK: Loaded 50175 existing records. [2025-10-13T18:18:41.569524] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:41.569763] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-13T18:18:41.569813] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-13T18:18:41.570065] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-13T18:18:41.570121] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-13T18:18:41.926006] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:42.017965] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-13T18:18:42.801276] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T18:18:42.817884] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-13T18:18:43.617991] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-13T18:18:43.720522] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:18:44.423042] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-13T18:18:44.444080] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T18:18:45.156844] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T18:18:45.217911] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-13T18:18:45.949789] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-13T18:18:46.017922] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-13T18:18:46.817892] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-13T18:18:47.017442] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T18:18:47.463033] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T18:18:47.617888] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-13T18:18:48.417906] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-13T18:18:48.457874] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:18:49.217986] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-13T18:18:49.380113] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T18:18:49.767548] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T18:18:50.017987] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-13T18:18:50.669338] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T18:18:50.818036] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-13T18:18:51.617910] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-13T18:18:51.733016] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T18:18:52.417993] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-13T18:18:52.579512] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T18:18:52.943781] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T18:18:53.217974] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-13T18:18:54.017988] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-13T18:18:54.086416] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T18:18:54.697296] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T18:18:54.817923] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-13T18:18:55.617925] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-13T18:18:55.812353] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T18:18:56.280529] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T18:18:56.285547] [INFO ] [REMOTE ] CWEN: Full fetch complete (65086 records). [2025-10-13T18:18:56.285671] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-13T18:18:56.423043] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-13T18:18:56.666599] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-13T18:18:56.666702] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-13T18:18:56.667459] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-13T18:18:56.667499] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-13T18:18:56.668766] [DEBUG] [LOCAL ] CWEN: Trimmed 65086 records to 45292 (keeping 200 days of data) [2025-10-13T18:18:56.948668] [DEBUG] [LOCAL ] CWEN: Primary data saved (45292 records). [2025-10-13T18:18:56.948807] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-13T18:18:56.948889] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWEN took 29.7s. Estimated remaining: 4h 8m 7s. Rate: 7.3 symbols/min [2025-10-13T18:18:57.124181] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:18:57.153718] [DEBUG] [LOCAL ] CWT: Loaded 28469 existing records from primary storage. [2025-10-13T18:18:57.154065] [INFO ] [MAIN ] CWT: Loaded 28469 existing records. [2025-10-13T18:18:57.223336] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-13T18:18:57.343345] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:18:57.343799] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-13T18:18:57.343976] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-13T18:18:57.344413] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-13T18:18:57.344501] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-13T18:18:57.533076] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T18:18:57.766674] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:18:58.017901] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-13T18:18:58.321168] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T18:18:58.818031] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-13T18:18:58.968820] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T18:18:59.004936] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T18:18:59.617975] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-13T18:19:00.414810] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T18:19:00.418808] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-13T18:19:01.046717] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T18:19:01.217914] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-13T18:19:02.018028] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-13T18:19:02.131728] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:19:02.818077] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-13T18:19:02.926011] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:19:03.024402] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T18:19:03.617967] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-13T18:19:04.417903] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-13T18:19:04.607705] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:19:05.099085] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:19:05.104153] [INFO ] [REMOTE ] CWH: Full fetch complete (73048 records). [2025-10-13T18:19:05.104273] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-13T18:19:05.223090] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-13T18:19:05.504275] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-13T18:19:05.504384] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-13T18:19:05.505261] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-13T18:19:05.505336] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-13T18:19:05.507705] [DEBUG] [LOCAL ] CWH: Trimmed 73048 records to 51335 (keeping 200 days of data) [2025-10-13T18:19:05.616373] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T18:19:05.853309] [DEBUG] [LOCAL ] CWH: Primary data saved (51335 records). [2025-10-13T18:19:05.853482] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-13T18:19:05.853575] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWH took 35.7s. Estimated remaining: 4h 8m 1s. Rate: 7.2 symbols/min [2025-10-13T18:19:06.024853] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:06.023026] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-13T18:19:06.072721] [DEBUG] [LOCAL ] CX: Loaded 53583 existing records from primary storage. [2025-10-13T18:19:06.073032] [INFO ] [MAIN ] CX: Loaded 53583 existing records. [2025-10-13T18:19:06.247697] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:06.247901] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-13T18:19:06.247983] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-13T18:19:06.248351] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-13T18:19:06.248409] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-13T18:19:06.622208] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:06.817962] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-13T18:19:07.066879] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T18:19:07.620191] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-13T18:19:07.625986] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T18:19:07.679434] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T18:19:08.417976] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-13T18:19:09.217918] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-13T18:19:09.253200] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:19:09.673040] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T18:19:10.017976] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-13T18:19:10.817962] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-13T18:19:10.931763] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T18:19:10.936906] [INFO ] [REMOTE ] CWAN: Full fetch complete (74839 records). [2025-10-13T18:19:10.937107] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-13T18:19:10.938155] [FATAL] [VALIDATOR ] CWAN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:19:10.938262] [FATAL] [MAIN ] CWAN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:19:10.938304] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:19:10.938370] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-13T18:19:10.938435] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-13T18:19:10.938470] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-10-13T18:19:10.938635] [DEBUG] [LOCAL ] CWAN: Deleted derivative data file. [2025-10-13T18:19:10.938754] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWAN took 44.4s. Estimated remaining: 4h 7m 43s. Rate: 7.3 symbols/min [2025-10-13T18:19:11.107093] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:11.114339] [DEBUG] [LOCAL ] CXE: Loaded 6249 existing records from primary storage. [2025-10-13T18:19:11.114526] [INFO ] [MAIN ] CXE: Loaded 6249 existing records. [2025-10-13T18:19:11.291601] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:11.291859] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-13T18:19:11.291953] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-13T18:19:11.292102] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-13T18:19:11.292177] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-13T18:19:11.618297] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-13T18:19:11.652531] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:11.864473] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-13T18:19:12.251490] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T18:19:12.417995] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-13T18:19:12.767731] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T18:19:13.217928] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-13T18:19:13.931067] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T18:19:14.017932] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-13T18:19:14.387850] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T18:19:14.817922] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-13T18:19:15.499121] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:19:15.504213] [INFO ] [REMOTE ] CWK: Full fetch complete (71015 records). [2025-10-13T18:19:15.504330] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-13T18:19:15.623128] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-13T18:19:15.896495] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-13T18:19:15.896596] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-13T18:19:15.897472] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-13T18:19:15.897543] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-13T18:19:15.899844] [DEBUG] [LOCAL ] CWK: Trimmed 71015 records to 49523 (keeping 200 days of data) [2025-10-13T18:19:16.182664] [DEBUG] [LOCAL ] CWK: Primary data saved (49523 records). [2025-10-13T18:19:16.182804] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-13T18:19:16.182882] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWK took 35.0s. Estimated remaining: 4h 7m 25s. Rate: 7.3 symbols/min [2025-10-13T18:19:16.352104] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:16.357932] [DEBUG] [LOCAL ] CXH: Loaded 4448 existing records from primary storage. [2025-10-13T18:19:16.358110] [INFO ] [MAIN ] CXH: Loaded 4448 existing records. [2025-10-13T18:19:16.427928] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-13T18:19:16.540547] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:16.540995] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-13T18:19:16.541081] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-13T18:19:16.541390] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-13T18:19:16.541478] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-13T18:19:16.900548] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T18:19:16.941820] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:16.964366] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T18:19:17.022474] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T18:19:17.217922] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-13T18:19:18.017983] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-13T18:19:18.081200] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T18:19:18.817921] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-13T18:19:19.303161] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T18:19:19.523777] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-13T18:19:19.617980] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-13T18:19:20.265550] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T18:19:20.417974] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-13T18:19:21.190517] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T18:19:21.217965] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-13T18:19:21.757353] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T18:19:22.018070] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-13T18:19:22.450191] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T18:19:22.817933] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-13T18:19:23.268881] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T18:19:23.617927] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-13T18:19:24.050231] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T18:19:24.417924] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-13T18:19:25.217954] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-13T18:19:25.717121] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-13T18:19:26.017937] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-13T18:19:26.286043] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T18:19:26.818619] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-13T18:19:26.820195] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T18:19:27.617927] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-13T18:19:27.955219] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T18:19:27.993112] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-13T18:19:28.417915] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-13T18:19:29.008822] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T18:19:29.217924] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-13T18:19:29.817917] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T18:19:30.018023] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-13T18:19:30.817961] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-13T18:19:31.221309] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T18:19:31.224780] [INFO ] [REMOTE ] CWT: Full fetch complete (40851 records). [2025-10-13T18:19:31.224865] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-13T18:19:31.416887] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T18:19:31.641049] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-13T18:19:31.657219] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-13T18:19:31.657283] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-13T18:19:31.657878] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-13T18:19:31.658048] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-13T18:19:31.659068] [DEBUG] [LOCAL ] CWT: Trimmed 40851 records to 28118 (keeping 200 days of data) [2025-10-13T18:19:31.833782] [DEBUG] [LOCAL ] CWT: Primary data saved (28118 records). [2025-10-13T18:19:31.833917] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-13T18:19:31.834744] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CWT took 34.9s. Estimated remaining: 4h 7m 40s. Rate: 7.2 symbols/min [2025-10-13T18:19:32.014874] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:32.061160] [DEBUG] [LOCAL ] CXM: Loaded 48285 existing records from primary storage. [2025-10-13T18:19:32.061492] [INFO ] [MAIN ] CXM: Loaded 48285 existing records. [2025-10-13T18:19:32.234087] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:32.234287] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-13T18:19:32.234333] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-13T18:19:32.234783] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-13T18:19:32.234838] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-13T18:19:32.423241] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-13T18:19:32.594517] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:33.217902] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-13T18:19:33.403033] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T18:19:33.479885] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T18:19:34.017997] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-13T18:19:34.785704] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T18:19:34.818953] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-13T18:19:34.825813] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T18:19:35.617987] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-13T18:19:36.418000] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-13T18:19:36.670451] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T18:19:36.998539] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-13T18:19:37.217930] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-13T18:19:37.329797] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T18:19:37.861314] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T18:19:38.017989] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-13T18:19:38.817958] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-13T18:19:39.188295] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T18:19:39.617982] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-13T18:19:40.417911] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-13T18:19:40.613675] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:19:40.942879] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T18:19:41.096246] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T18:19:41.217982] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-13T18:19:42.018015] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-13T18:19:42.467330] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T18:19:42.468500] [INFO ] [REMOTE ] CXH: Full fetch complete (5375 records). [2025-10-13T18:19:42.468587] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-13T18:19:42.827557] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-13T18:19:42.867923] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-13T18:19:42.868118] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-13T18:19:42.868387] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-13T18:19:42.868466] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-13T18:19:42.869561] [DEBUG] [LOCAL ] CXH: Trimmed 5375 records to 4435 (keeping 200 days of data) [2025-10-13T18:19:42.900163] [DEBUG] [LOCAL ] CXH: Primary data saved (4435 records). [2025-10-13T18:19:42.900639] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-13T18:19:42.900797] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXH took 26.7s. Estimated remaining: 4h 7m 40s. Rate: 7.2 symbols/min [2025-10-13T18:19:43.004060] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T18:19:43.133089] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:43.171958] [DEBUG] [LOCAL ] CXT: Loaded 31466 existing records from primary storage. [2025-10-13T18:19:43.172325] [INFO ] [MAIN ] CXT: Loaded 31466 existing records. [2025-10-13T18:19:43.362569] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:43.362921] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-13T18:19:43.362982] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-13T18:19:43.363297] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-13T18:19:43.363356] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-13T18:19:43.624941] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-13T18:19:43.761369] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:44.281021] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T18:19:44.282920] [INFO ] [REMOTE ] CXE: Full fetch complete (11537 records). [2025-10-13T18:19:44.283032] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-13T18:19:44.423079] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-13T18:19:44.710524] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-13T18:19:44.710701] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-13T18:19:44.711275] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-13T18:19:44.711358] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-13T18:19:44.744528] [DEBUG] [LOCAL ] CXE: Trimmed 11537 records to 6159 (keeping 200 days of data) [2025-10-13T18:19:44.747434] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-13T18:19:44.798391] [DEBUG] [LOCAL ] CXE: Primary data saved (6159 records). [2025-10-13T18:19:44.798571] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-13T18:19:44.798689] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXE took 33.9s. Estimated remaining: 4h 7m 12s. Rate: 7.3 symbols/min [2025-10-13T18:19:44.975677] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:45.017301] [DEBUG] [LOCAL ] CXW: Loaded 44569 existing records from primary storage. [2025-10-13T18:19:45.017606] [INFO ] [MAIN ] CXW: Loaded 44569 existing records. [2025-10-13T18:19:45.189809] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:45.190067] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-13T18:19:45.190135] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-13T18:19:45.190403] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-13T18:19:45.190459] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-13T18:19:45.223160] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-13T18:19:45.598455] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:45.638605] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T18:19:46.018024] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-13T18:19:46.817981] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-13T18:19:47.002354] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T18:19:47.370072] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T18:19:47.617987] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-13T18:19:48.361412] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T18:19:48.417892] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-13T18:19:49.099823] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:19:49.105699] [INFO ] [REMOTE ] CX: Full fetch complete (76384 records). [2025-10-13T18:19:49.105891] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-13T18:19:49.223060] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-13T18:19:49.531979] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-13T18:19:49.532165] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-13T18:19:49.533548] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-13T18:19:49.533638] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-13T18:19:49.535839] [DEBUG] [LOCAL ] CX: Trimmed 76384 records to 52816 (keeping 200 days of data) [2025-10-13T18:19:49.680103] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T18:19:49.929507] [DEBUG] [LOCAL ] CX: Primary data saved (52816 records). [2025-10-13T18:19:49.929735] [INFO ] [MAIN ] CX: Full history saved. [2025-10-13T18:19:49.929890] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CX took 44.1s. Estimated remaining: 4h 6m 54s. Rate: 7.3 symbols/min [2025-10-13T18:19:50.026528] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-13T18:19:50.112598] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:19:50.140049] [DEBUG] [LOCAL ] CYD: Loaded 26901 existing records from primary storage. [2025-10-13T18:19:50.140393] [INFO ] [MAIN ] CYD: Loaded 26901 existing records. [2025-10-13T18:19:50.332545] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:19:50.332856] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-13T18:19:50.332911] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-13T18:19:50.333221] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-13T18:19:50.333281] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-13T18:19:50.754400] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:19:50.756934] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T18:19:50.817910] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-13T18:19:51.617935] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-13T18:19:51.677710] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:19:51.850232] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T18:19:52.395164] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T18:19:52.417917] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-13T18:19:53.217989] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-13T18:19:53.823431] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:19:53.824147] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T18:19:54.017996] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-13T18:19:54.817999] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-13T18:19:54.972634] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T18:19:55.618063] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-13T18:19:56.423189] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-13T18:19:56.443502] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T18:19:57.190893] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T18:19:57.217918] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-13T18:19:57.645039] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T18:19:58.017974] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-13T18:19:58.591430] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-13T18:19:58.818008] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-13T18:19:59.617987] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-13T18:19:59.677354] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T18:20:00.094835] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T18:20:00.417976] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-13T18:20:01.217899] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-13T18:20:01.419539] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:20:02.017987] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-13T18:20:02.447144] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-13T18:20:02.817937] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-13T18:20:03.425015] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-13T18:20:03.520836] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:20:03.617984] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-13T18:20:04.414898] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T18:20:04.424383] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-13T18:20:05.030570] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:20:05.217975] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-13T18:20:05.727114] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T18:20:06.018036] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-13T18:20:06.335618] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-13T18:20:06.817996] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-13T18:20:07.234590] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T18:20:07.617968] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-13T18:20:08.275476] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T18:20:08.417988] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-13T18:20:09.217931] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-13T18:20:09.389533] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T18:20:09.394727] [INFO ] [REMOTE ] CXM: Full fetch complete (68570 records). [2025-10-13T18:20:09.394881] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-13T18:20:09.784798] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-13T18:20:09.785027] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-13T18:20:09.786119] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-13T18:20:09.786218] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-13T18:20:09.787868] [DEBUG] [LOCAL ] CXM: Trimmed 68570 records to 47604 (keeping 200 days of data) [2025-10-13T18:20:09.919045] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T18:20:10.019721] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-13T18:20:10.088923] [DEBUG] [LOCAL ] CXM: Primary data saved (47604 records). [2025-10-13T18:20:10.089090] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-13T18:20:10.089896] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXM took 38.3s. Estimated remaining: 4h 7m 22s. Rate: 7.2 symbols/min [2025-10-13T18:20:10.258556] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:10.303981] [DEBUG] [LOCAL ] CYH: Loaded 48319 existing records from primary storage. [2025-10-13T18:20:10.304269] [INFO ] [MAIN ] CYH: Loaded 48319 existing records. [2025-10-13T18:20:10.477247] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:10.477449] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-13T18:20:10.477496] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-13T18:20:10.477782] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-13T18:20:10.477838] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-13T18:20:10.829059] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-13T18:20:10.835041] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:10.929879] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T18:20:11.327057] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T18:20:11.332986] [INFO ] [REMOTE ] CXT: Full fetch complete (45438 records). [2025-10-13T18:20:11.333144] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-13T18:20:11.623273] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-13T18:20:11.756416] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-13T18:20:11.756520] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-13T18:20:11.757275] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-13T18:20:11.757360] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-13T18:20:11.758485] [DEBUG] [LOCAL ] CXT: Trimmed 45438 records to 30997 (keeping 200 days of data) [2025-10-13T18:20:11.930153] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T18:20:11.991358] [DEBUG] [LOCAL ] CXT: Primary data saved (30997 records). [2025-10-13T18:20:11.991521] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-13T18:20:11.991620] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CXT took 29.1s. Estimated remaining: 4h 6m 55s. Rate: 7.2 symbols/min [2025-10-13T18:20:12.159335] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:12.210607] [DEBUG] [LOCAL ] D: Loaded 54427 existing records from primary storage. [2025-10-13T18:20:12.210982] [INFO ] [MAIN ] D: Loaded 54427 existing records. [2025-10-13T18:20:12.390268] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:12.390489] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-13T18:20:12.390537] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-13T18:20:12.390888] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-13T18:20:12.390945] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-13T18:20:12.423109] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-13T18:20:12.757028] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:13.217933] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-13T18:20:13.865566] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-13T18:20:13.878406] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T18:20:14.017973] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-13T18:20:14.823178] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-13T18:20:14.851803] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:20:15.383416] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T18:20:15.617926] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-13T18:20:16.423361] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-13T18:20:16.435395] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T18:20:17.217925] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-13T18:20:17.514823] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T18:20:18.018004] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-13T18:20:18.588534] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-13T18:20:18.592953] [INFO ] [REMOTE ] CYD: Full fetch complete (34408 records). [2025-10-13T18:20:18.593047] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-13T18:20:18.593767] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:20:18.593866] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:20:18.593918] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:20:18.593995] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-13T18:20:18.594074] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-13T18:20:18.594129] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-10-13T18:20:18.594325] [DEBUG] [LOCAL ] CYD: Deleted derivative data file. [2025-10-13T18:20:18.594460] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CYD took 28.7s. Estimated remaining: 4h 6m 41s. Rate: 7.3 symbols/min [2025-10-13T18:20:18.769899] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:18.782407] [DEBUG] [LOCAL ] DAC: Loaded 12754 existing records from primary storage. [2025-10-13T18:20:18.782675] [INFO ] [MAIN ] DAC: Loaded 12754 existing records. [2025-10-13T18:20:18.824495] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-13T18:20:18.968809] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:18.969274] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-13T18:20:18.969361] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-13T18:20:18.969614] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-13T18:20:18.969806] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-13T18:20:19.122894] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T18:20:19.391564] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:19.617907] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-13T18:20:19.856278] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T18:20:20.080439] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T18:20:20.417920] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-13T18:20:20.827467] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T18:20:21.217992] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-13T18:20:21.819898] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T18:20:22.017911] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-13T18:20:22.817928] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-13T18:20:23.192304] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T18:20:23.549317] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:20:23.617895] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-13T18:20:24.417905] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-13T18:20:24.476601] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:20:24.611898] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T18:20:25.217932] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-13T18:20:25.993449] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T18:20:26.017900] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-13T18:20:26.660098] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:20:26.817906] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-13T18:20:27.595067] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T18:20:27.617996] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-13T18:20:28.363154] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T18:20:28.417893] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-13T18:20:29.073683] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T18:20:29.078345] [INFO ] [REMOTE ] CXW: Full fetch complete (64866 records). [2025-10-13T18:20:29.078515] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-13T18:20:29.223171] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-13T18:20:29.471470] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-13T18:20:29.471550] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-13T18:20:29.472323] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-13T18:20:29.472385] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-13T18:20:29.473634] [DEBUG] [LOCAL ] CXW: Trimmed 64866 records to 43921 (keeping 200 days of data) [2025-10-13T18:20:29.741095] [DEBUG] [LOCAL ] CXW: Primary data saved (43921 records). [2025-10-13T18:20:29.741269] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-13T18:20:29.741428] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. CXW took 44.9s. Estimated remaining: 4h 6m 42s. Rate: 7.2 symbols/min [2025-10-13T18:20:29.924088] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:29.985739] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-10-13T18:20:29.986363] [INFO ] [MAIN ] DAL: Loaded 54533 existing records. [2025-10-13T18:20:30.036840] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-13T18:20:30.148635] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T18:20:30.257765] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:30.258369] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-13T18:20:30.258492] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-13T18:20:30.267462] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-13T18:20:30.267571] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-13T18:20:30.299302] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:20:30.617986] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:30.817892] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-13T18:20:31.617966] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-13T18:20:31.979781] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-13T18:20:32.418001] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-13T18:20:32.732947] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T18:20:33.217910] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-13T18:20:33.271933] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T18:20:34.018976] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-13T18:20:34.018845] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T18:20:34.817936] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-13T18:20:35.268822] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T18:20:35.331617] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:20:35.481745] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-13T18:20:35.617960] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-13T18:20:36.417929] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-13T18:20:37.096892] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:20:37.101600] [INFO ] [REMOTE ] CYH: Full fetch complete (69747 records). [2025-10-13T18:20:37.101780] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-13T18:20:37.223049] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-13T18:20:37.489291] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-13T18:20:37.489373] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-13T18:20:37.490243] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-13T18:20:37.490307] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-13T18:20:37.494247] [DEBUG] [LOCAL ] CYH: Trimmed 69747 records to 47691 (keeping 200 days of data) [2025-10-13T18:20:37.761241] [DEBUG] [LOCAL ] CYH: Primary data saved (47691 records). [2025-10-13T18:20:37.761376] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-13T18:20:37.762152] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. CYH took 27.7s. Estimated remaining: 4h 6m 33s. Rate: 7.2 symbols/min [2025-10-13T18:20:37.927579] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:37.980028] [DEBUG] [LOCAL ] DAN: Loaded 49881 existing records from primary storage. [2025-10-13T18:20:37.980330] [INFO ] [MAIN ] DAN: Loaded 49881 existing records. [2025-10-13T18:20:38.023126] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-13T18:20:38.165450] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:38.165855] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-13T18:20:38.165925] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-13T18:20:38.166376] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-13T18:20:38.166435] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-13T18:20:38.261178] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T18:20:38.537139] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:38.570116] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T18:20:38.817980] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-13T18:20:39.617895] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-13T18:20:39.758984] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T18:20:40.418005] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-13T18:20:40.786304] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T18:20:41.217914] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-13T18:20:41.654776] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-13T18:20:41.989807] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T18:20:42.017882] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-13T18:20:42.429807] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-13T18:20:42.817888] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-13T18:20:42.973217] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T18:20:43.617954] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-13T18:20:44.417927] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-13T18:20:45.185182] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:20:45.217883] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-13T18:20:45.259747] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-13T18:20:45.300513] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-13T18:20:46.017922] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-13T18:20:46.794955] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:20:46.817962] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-13T18:20:47.617902] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-13T18:20:47.693800] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T18:20:48.054631] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T18:20:48.418014] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-13T18:20:48.543182] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T18:20:48.953830] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T18:20:48.961092] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-10-13T18:20:48.961323] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-13T18:20:49.223240] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-13T18:20:49.550274] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-13T18:20:49.550400] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-13T18:20:49.552058] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-13T18:20:49.552159] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-13T18:20:49.554267] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 53646 (keeping 200 days of data) [2025-10-13T18:20:49.906986] [DEBUG] [LOCAL ] D: Primary data saved (53646 records). [2025-10-13T18:20:49.907138] [INFO ] [MAIN ] D: Full history saved. [2025-10-13T18:20:49.907226] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. D took 37.9s. Estimated remaining: 4h 6m 36s. Rate: 7.2 symbols/min [2025-10-13T18:20:50.019536] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-13T18:20:50.081710] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:50.081856] [DEBUG] [LOCAL ] DAO: No existing data file found in primary storage. [2025-10-13T18:20:50.081893] [WARN ] [MAIN ] DAO: No existing data found, performing full refresh instead. [2025-10-13T18:20:50.082016] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-13T18:20:50.082058] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-13T18:20:50.082102] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-13T18:20:50.082135] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-13T18:20:50.195843] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:20:50.447773] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:50.817887] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-13T18:20:51.617893] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-13T18:20:51.623860] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T18:20:51.626153] [INFO ] [REMOTE ] DAC: Full fetch complete (19333 records). [2025-10-13T18:20:51.626232] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-13T18:20:51.983822] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-13T18:20:51.983899] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-13T18:20:51.984307] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-13T18:20:51.984416] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-13T18:20:51.985103] [DEBUG] [LOCAL ] DAC: Trimmed 19333 records to 12609 (keeping 200 days of data) [2025-10-13T18:20:52.069238] [DEBUG] [LOCAL ] DAC: Primary data saved (12609 records). [2025-10-13T18:20:52.069391] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-13T18:20:52.069474] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAC took 33.5s. Estimated remaining: 4h 6m 9s. Rate: 7.3 symbols/min [2025-10-13T18:20:52.236829] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:20:52.284964] [DEBUG] [LOCAL ] DAR: Loaded 52630 existing records from primary storage. [2025-10-13T18:20:52.285332] [INFO ] [MAIN ] DAR: Loaded 52630 existing records. [2025-10-13T18:20:52.425307] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-13T18:20:52.467160] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:20:52.468441] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-13T18:20:52.468508] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-13T18:20:52.468892] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-13T18:20:52.468958] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-13T18:20:52.607373] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-13T18:20:52.869023] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:20:53.105214] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T18:20:53.217906] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-13T18:20:53.777331] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T18:20:54.017917] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-13T18:20:54.818008] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-13T18:20:55.399999] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T18:20:55.461979] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-13T18:20:55.617920] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-13T18:20:56.417896] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-13T18:20:56.486763] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T18:20:56.812309] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T18:20:57.218002] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-13T18:20:58.017899] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-13T18:20:58.154773] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T18:20:58.438895] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-13T18:20:58.817913] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-13T18:20:59.617888] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-13T18:20:59.729795] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:21:00.417925] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-13T18:21:00.924064] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-13T18:21:01.100055] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T18:21:01.217929] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-13T18:21:01.807148] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T18:21:02.017969] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-13T18:21:02.332159] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T18:21:02.817926] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-13T18:21:03.447664] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T18:21:03.617928] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-13T18:21:04.417970] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-13T18:21:05.116950] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-13T18:21:05.217980] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-13T18:21:05.503813] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T18:21:05.668342] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T18:21:05.674125] [INFO ] [REMOTE ] DAL: Full fetch complete (77824 records). [2025-10-13T18:21:05.674324] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-13T18:21:06.025239] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-13T18:21:06.075517] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-13T18:21:06.075688] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-13T18:21:06.076687] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-13T18:21:06.076785] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-13T18:21:06.116368] [DEBUG] [LOCAL ] DAL: Trimmed 77824 records to 53753 (keeping 200 days of data) [2025-10-13T18:21:06.118586] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-13T18:21:06.451142] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-13T18:21:06.451282] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-13T18:21:06.451361] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAL took 36.7s. Estimated remaining: 4h 6m 19s. Rate: 7.2 symbols/min [2025-10-13T18:21:06.634466] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:06.677880] [DEBUG] [LOCAL ] DAVA: Loaded 42130 existing records from primary storage. [2025-10-13T18:21:06.678271] [INFO ] [MAIN ] DAVA: Loaded 42130 existing records. [2025-10-13T18:21:06.823070] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-13T18:21:06.886574] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:21:06.886817] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-13T18:21:06.886869] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-13T18:21:06.887210] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-13T18:21:06.887275] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-13T18:21:07.307411] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:07.521860] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T18:21:07.527492] [INFO ] [REMOTE ] DAN: Full fetch complete (70920 records). [2025-10-13T18:21:07.527678] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-13T18:21:07.623163] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-13T18:21:07.936169] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-13T18:21:07.936379] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-13T18:21:07.937357] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-13T18:21:07.937465] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-13T18:21:07.955068] [DEBUG] [LOCAL ] DAN: Trimmed 70920 records to 49335 (keeping 200 days of data) [2025-10-13T18:21:07.955621] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T18:21:08.260737] [DEBUG] [LOCAL ] DAN: Primary data saved (49335 records). [2025-10-13T18:21:08.260878] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-13T18:21:08.261478] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAN took 30.5s. Estimated remaining: 4h 5m 52s. Rate: 7.3 symbols/min [2025-10-13T18:21:08.420896] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-13T18:21:08.431951] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:08.484348] [DEBUG] [LOCAL ] DAY: Loaded 49936 existing records from primary storage. [2025-10-13T18:21:08.484686] [INFO ] [MAIN ] DAY: Loaded 49936 existing records. [2025-10-13T18:21:08.658323] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:21:08.658558] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-13T18:21:08.658605] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-13T18:21:08.659056] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-13T18:21:08.659125] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-13T18:21:09.014357] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:09.139924] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T18:21:09.217889] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-13T18:21:09.414409] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:21:10.017921] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-13T18:21:10.135873] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-13T18:21:10.818002] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-13T18:21:11.497677] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T18:21:11.574316] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T18:21:11.617867] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-13T18:21:12.417917] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-13T18:21:13.126176] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T18:21:13.217954] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-13T18:21:13.351222] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T18:21:14.017913] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-13T18:21:14.817999] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-13T18:21:15.004875] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T18:21:15.363192] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T18:21:15.475556] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T18:21:15.617918] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-13T18:21:16.418007] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-13T18:21:17.043063] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T18:21:17.217984] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-13T18:21:17.958236] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T18:21:18.017894] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-13T18:21:18.817902] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-13T18:21:18.970147] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T18:21:19.618026] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-13T18:21:19.718958] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T18:21:19.724404] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T18:21:20.418012] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-13T18:21:21.217989] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-13T18:21:21.319458] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:21:22.017923] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-13T18:21:22.116973] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:21:22.288026] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T18:21:22.817955] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-13T18:21:23.459974] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:21:23.617920] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-13T18:21:23.716509] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T18:21:24.417929] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-13T18:21:25.217618] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T18:21:25.219198] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-13T18:21:25.220362] [INFO ] [REMOTE ] DAO: Full fetch complete (31997 records). [2025-10-13T18:21:25.220430] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-13T18:21:25.220968] [FATAL] [VALIDATOR ] DAO: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:21:25.221060] [FATAL] [MAIN ] DAO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:21:25.221103] [WARN ] [MAIN ] DAO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:21:25.221170] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-13T18:21:25.221226] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-13T18:21:25.221262] [INFO ] [LOCAL ] DAO: Starting deletion of derivative data. [2025-10-13T18:21:25.221386] [DEBUG] [LOCAL ] DAO: No derivative data file found to delete. [2025-10-13T18:21:25.221474] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAO took 35.3s. Estimated remaining: 4h 6m 10s. Rate: 7.2 symbols/min [2025-10-13T18:21:25.398460] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T18:21:25.480403] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:25.535815] [DEBUG] [LOCAL ] DB: Loaded 53277 existing records from primary storage. [2025-10-13T18:21:25.536259] [INFO ] [MAIN ] DB: Loaded 53277 existing records. [2025-10-13T18:21:25.729133] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:21:25.729387] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-13T18:21:25.729435] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-13T18:21:25.729877] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-13T18:21:25.729935] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-13T18:21:26.023185] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-13T18:21:26.080467] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:26.817970] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-13T18:21:26.858634] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T18:21:27.459903] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T18:21:27.617894] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-13T18:21:28.391768] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T18:21:28.417883] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-13T18:21:29.191021] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T18:21:29.217882] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-13T18:21:30.017901] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-13T18:21:30.210191] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T18:21:30.817903] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-13T18:21:30.908296] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T18:21:31.617897] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-13T18:21:31.968329] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T18:21:32.423795] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-13T18:21:32.429004] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T18:21:33.091967] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T18:21:33.217889] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-13T18:21:33.999816] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T18:21:34.017881] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-13T18:21:34.818005] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-13T18:21:35.308509] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T18:21:35.622973] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-13T18:21:35.637857] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T18:21:36.410251] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:21:36.419673] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-13T18:21:37.217898] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-13T18:21:37.404768] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T18:21:37.739726] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T18:21:38.017925] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-13T18:21:38.799305] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T18:21:38.804184] [INFO ] [REMOTE ] DAY: Full fetch complete (71512 records). [2025-10-13T18:21:38.804306] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-13T18:21:38.823117] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-13T18:21:39.248507] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-13T18:21:39.248587] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-13T18:21:39.249570] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-13T18:21:39.249685] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-13T18:21:39.251145] [DEBUG] [LOCAL ] DAY: Trimmed 71512 records to 49187 (keeping 200 days of data) [2025-10-13T18:21:39.538199] [DEBUG] [LOCAL ] DAY: Primary data saved (49187 records). [2025-10-13T18:21:39.538341] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-13T18:21:39.538893] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAY took 31.3s. Estimated remaining: 4h 6m 19s. Rate: 7.2 symbols/min [2025-10-13T18:21:39.623068] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-13T18:21:39.712794] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:39.713637] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-13T18:21:39.713739] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-13T18:21:39.713868] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-13T18:21:39.713911] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-13T18:21:39.713952] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-13T18:21:39.713985] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-13T18:21:40.073923] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:40.105629] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-13T18:21:40.417914] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-13T18:21:40.521876] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:21:40.527431] [INFO ] [REMOTE ] DAVA: Full fetch complete (56685 records). [2025-10-13T18:21:40.527570] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-13T18:21:40.899505] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-13T18:21:40.899582] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-13T18:21:40.900284] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-13T18:21:40.900345] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-13T18:21:40.901431] [DEBUG] [LOCAL ] DAVA: Trimmed 56685 records to 41698 (keeping 200 days of data) [2025-10-13T18:21:41.171751] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:21:41.184412] [DEBUG] [LOCAL ] DAVA: Primary data saved (41698 records). [2025-10-13T18:21:41.184800] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-13T18:21:41.185015] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAVA took 34.7s. Estimated remaining: 4h 5m 51s. Rate: 7.2 symbols/min [2025-10-13T18:21:41.227854] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-13T18:21:41.402281] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:41.403537] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T18:21:41.452188] [DEBUG] [LOCAL ] DBI: Loaded 44863 existing records from primary storage. [2025-10-13T18:21:41.452524] [INFO ] [MAIN ] DBI: Loaded 44863 existing records. [2025-10-13T18:21:41.667636] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:21:41.667847] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-13T18:21:41.667910] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-13T18:21:41.668434] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-13T18:21:41.668493] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-13T18:21:42.028909] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-13T18:21:42.234017] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:42.817962] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-13T18:21:42.989886] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T18:21:43.014787] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:21:43.021082] [INFO ] [REMOTE ] DAR: Full fetch complete (74641 records). [2025-10-13T18:21:43.021228] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-13T18:21:43.414767] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-13T18:21:43.414881] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-13T18:21:43.415777] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-13T18:21:43.415844] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-13T18:21:43.417272] [DEBUG] [LOCAL ] DAR: Trimmed 74641 records to 51978 (keeping 200 days of data) [2025-10-13T18:21:43.619921] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-13T18:21:43.710996] [DEBUG] [LOCAL ] DAR: Primary data saved (51978 records). [2025-10-13T18:21:43.711131] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-13T18:21:43.711210] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DAR took 51.6s. Estimated remaining: 4h 5m 26s. Rate: 7.2 symbols/min [2025-10-13T18:21:43.875261] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:21:43.875474] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-13T18:21:43.875516] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-13T18:21:43.875623] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-13T18:21:43.875715] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-13T18:21:43.875770] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-13T18:21:43.875803] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-13T18:21:44.232231] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:21:44.406592] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T18:21:44.417871] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-13T18:21:44.457349] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T18:21:45.217985] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-13T18:21:45.871912] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T18:21:46.018063] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-13T18:21:46.817962] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-13T18:21:46.896409] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T18:21:47.158255] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T18:21:47.617922] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-13T18:21:48.404895] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:21:48.417887] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-13T18:21:48.869053] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T18:21:49.217928] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-13T18:21:49.926518] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T18:21:50.017907] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-13T18:21:50.061964] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:21:50.652748] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T18:21:50.817907] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-13T18:21:51.452608] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T18:21:51.617910] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-13T18:21:52.377566] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-13T18:21:52.417971] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-13T18:21:53.217948] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-13T18:21:54.017917] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-13T18:21:54.402485] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T18:21:54.772808] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T18:21:54.803622] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T18:21:54.817880] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-13T18:21:55.617995] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-13T18:21:55.946514] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T18:21:56.417969] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-13T18:21:57.121193] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:21:57.217895] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-13T18:21:57.572990] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T18:21:58.018018] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-13T18:21:58.662235] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:21:58.818016] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-13T18:21:59.617897] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-13T18:21:59.628580] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T18:21:59.739725] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T18:22:00.418031] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-13T18:22:01.101276] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T18:22:01.217931] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-13T18:22:01.955671] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T18:22:01.979934] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T18:22:02.017973] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-13T18:22:02.817926] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-13T18:22:03.460198] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:22:03.617957] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-13T18:22:04.214000] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T18:22:04.331616] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T18:22:04.340588] [INFO ] [REMOTE ] DB: Full fetch complete (74943 records). [2025-10-13T18:22:04.340830] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-13T18:22:04.423131] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-13T18:22:04.758241] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-13T18:22:04.758331] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-13T18:22:04.759225] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-13T18:22:04.759289] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-13T18:22:04.760669] [DEBUG] [LOCAL ] DB: Trimmed 74943 records to 52505 (keeping 200 days of data) [2025-10-13T18:22:05.080602] [DEBUG] [LOCAL ] DB: Primary data saved (52505 records). [2025-10-13T18:22:05.080781] [INFO ] [MAIN ] DB: Full history saved. [2025-10-13T18:22:05.080888] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DB took 39.9s. Estimated remaining: 4h 5m 56s. Rate: 7.2 symbols/min [2025-10-13T18:22:05.223242] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-13T18:22:05.285479] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:05.349348] [DEBUG] [LOCAL ] DBRG: Loaded 50515 existing records from primary storage. [2025-10-13T18:22:05.349873] [INFO ] [MAIN ] DBRG: Loaded 50515 existing records. [2025-10-13T18:22:05.554420] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:05.554748] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-13T18:22:05.554808] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-13T18:22:05.555388] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-13T18:22:05.555448] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-13T18:22:05.987442] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:06.017955] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-13T18:22:06.177272] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T18:22:06.242981] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T18:22:06.817921] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-13T18:22:07.592928] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-13T18:22:07.617889] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-13T18:22:07.671196] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T18:22:08.417969] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-13T18:22:08.547889] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T18:22:08.903717] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-13T18:22:09.217962] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-13T18:22:10.017915] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-13T18:22:10.079589] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T18:22:10.817921] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-13T18:22:10.898893] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T18:22:10.900020] [INFO ] [REMOTE ] DBL: Full fetch complete (12508 records). [2025-10-13T18:22:10.900085] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-13T18:22:11.271573] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-13T18:22:11.271672] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-13T18:22:11.271972] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-13T18:22:11.272012] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-13T18:22:11.272472] [DEBUG] [LOCAL ] DBL: Trimmed 12508 records to 9289 (keeping 200 days of data) [2025-10-13T18:22:11.331718] [DEBUG] [LOCAL ] DBL: Primary data saved (9289 records). [2025-10-13T18:22:11.331847] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-13T18:22:11.331915] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBL took 27.6s. Estimated remaining: 4h 5m 42s. Rate: 7.2 symbols/min [2025-10-13T18:22:11.505580] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:11.539454] [DEBUG] [LOCAL ] DCI: Loaded 37528 existing records from primary storage. [2025-10-13T18:22:11.539794] [INFO ] [MAIN ] DCI: Loaded 37528 existing records. [2025-10-13T18:22:11.623057] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-13T18:22:11.731830] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:11.732096] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-13T18:22:11.732159] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-13T18:22:11.732469] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-13T18:22:11.732545] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-13T18:22:12.100421] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:12.167107] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T18:22:12.171386] [INFO ] [REMOTE ] DBI: Full fetch complete (65301 records). [2025-10-13T18:22:12.171498] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-13T18:22:12.430730] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-13T18:22:12.569613] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-13T18:22:12.569733] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-13T18:22:12.570552] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-13T18:22:12.570594] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-13T18:22:12.572014] [DEBUG] [LOCAL ] DBI: Trimmed 65301 records to 44091 (keeping 200 days of data) [2025-10-13T18:22:12.829187] [DEBUG] [LOCAL ] DBI: Primary data saved (44091 records). [2025-10-13T18:22:12.829319] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-13T18:22:12.829400] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBI took 31.6s. Estimated remaining: 4h 5m 13s. Rate: 7.2 symbols/min [2025-10-13T18:22:13.000786] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:13.015378] [DEBUG] [LOCAL ] DCO: Loaded 14259 existing records from primary storage. [2025-10-13T18:22:13.015611] [INFO ] [MAIN ] DCO: Loaded 14259 existing records. [2025-10-13T18:22:13.197624] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:13.197990] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-13T18:22:13.198075] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-13T18:22:13.198522] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-13T18:22:13.198592] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-13T18:22:13.233900] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-13T18:22:13.488109] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T18:22:13.621077] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:13.977949] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T18:22:14.017900] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-13T18:22:14.248125] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T18:22:14.250866] [INFO ] [REMOTE ] DBD: Full fetch complete (31249 records). [2025-10-13T18:22:14.251012] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-13T18:22:14.251713] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:22:14.251814] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:22:14.251858] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:22:14.251900] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-13T18:22:14.251956] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-13T18:22:14.251990] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-13T18:22:14.252031] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-13T18:22:14.252092] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DBD took 34.7s. Estimated remaining: 4h 4m 45s. Rate: 7.3 symbols/min [2025-10-13T18:22:14.429147] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:14.482513] [DEBUG] [LOCAL ] DD: Loaded 53623 existing records from primary storage. [2025-10-13T18:22:14.482853] [INFO ] [MAIN ] DD: Loaded 53623 existing records. [2025-10-13T18:22:14.659925] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:14.660162] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-13T18:22:14.660209] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-13T18:22:14.660734] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-13T18:22:14.660791] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-13T18:22:14.821631] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-13T18:22:15.035367] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:15.612701] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:22:15.626735] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-13T18:22:15.963949] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T18:22:16.418105] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-13T18:22:17.217927] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-13T18:22:17.360343] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T18:22:17.404747] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T18:22:18.017988] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-13T18:22:18.035629] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-13T18:22:18.817927] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-13T18:22:19.617911] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-13T18:22:19.660924] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T18:22:20.051155] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T18:22:20.418007] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-13T18:22:21.128614] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:22:21.217932] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-13T18:22:22.017899] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-13T18:22:22.058312] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T18:22:22.292077] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T18:22:22.817998] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-13T18:22:23.494928] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T18:22:23.617898] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-13T18:22:24.417901] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-13T18:22:24.621449] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T18:22:24.890030] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:22:25.217906] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-13T18:22:25.496944] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T18:22:26.018021] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-13T18:22:26.822577] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-13T18:22:26.826235] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T18:22:26.861596] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T18:22:27.617988] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-13T18:22:28.340009] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T18:22:28.417959] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-13T18:22:29.217894] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-13T18:22:29.620352] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T18:22:29.923806] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T18:22:30.017909] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-13T18:22:30.551705] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-13T18:22:30.818021] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-13T18:22:30.911969] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T18:22:31.617910] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-13T18:22:32.418001] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-13T18:22:32.481008] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T18:22:32.891102] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:22:33.217926] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-13T18:22:33.813846] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T18:22:34.017924] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-13T18:22:34.169106] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T18:22:34.817980] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-13T18:22:35.617920] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-13T18:22:35.700253] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T18:22:36.105001] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T18:22:36.421450] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-13T18:22:37.217975] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-13T18:22:37.571619] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T18:22:37.845064] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T18:22:37.850236] [INFO ] [REMOTE ] DBRG: Full fetch complete (72286 records). [2025-10-13T18:22:37.850477] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-13T18:22:38.026457] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-13T18:22:38.235530] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-13T18:22:38.235609] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-13T18:22:38.236445] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-13T18:22:38.236509] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-13T18:22:38.237904] [DEBUG] [LOCAL ] DBRG: Trimmed 72286 records to 49849 (keeping 200 days of data) [2025-10-13T18:22:38.537863] [DEBUG] [LOCAL ] DBRG: Primary data saved (49849 records). [2025-10-13T18:22:38.538050] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-13T18:22:38.538193] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DBRG took 33.5s. Estimated remaining: 4h 5m 24s. Rate: 7.2 symbols/min [2025-10-13T18:22:38.817990] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-13T18:22:38.860551] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T18:22:38.880753] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T18:22:39.617910] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-13T18:22:40.418007] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-13T18:22:40.788724] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T18:22:40.821826] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T18:22:41.217909] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-13T18:22:41.475691] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T18:22:42.017961] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-13T18:22:42.817904] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-13T18:22:43.082605] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T18:22:43.193619] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T18:22:43.197209] [INFO ] [REMOTE ] DCI: Full fetch complete (53554 records). [2025-10-13T18:22:43.197312] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-13T18:22:43.573181] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-13T18:22:43.573497] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-13T18:22:43.574256] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-13T18:22:43.574318] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-13T18:22:43.576986] [DEBUG] [LOCAL ] DCI: Trimmed 53554 records to 37041 (keeping 200 days of data) [2025-10-13T18:22:43.630631] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-13T18:22:43.809098] [DEBUG] [LOCAL ] DCI: Primary data saved (37041 records). [2025-10-13T18:22:43.809251] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-13T18:22:43.809352] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCI took 32.5s. Estimated remaining: 4h 5m 7s. Rate: 7.2 symbols/min [2025-10-13T18:22:43.908280] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:22:44.417924] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-13T18:22:45.451239] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-13T18:22:45.456205] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-13T18:22:45.651871] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-13T18:22:46.017924] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-13T18:22:46.196079] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T18:22:46.198942] [INFO ] [REMOTE ] DCO: Full fetch complete (19268 records). [2025-10-13T18:22:46.199029] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-13T18:22:46.608114] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-13T18:22:46.608195] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-13T18:22:46.608749] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-13T18:22:46.608813] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-13T18:22:46.609379] [DEBUG] [LOCAL ] DCO: Trimmed 19268 records to 14327 (keeping 200 days of data) [2025-10-13T18:22:46.700898] [DEBUG] [LOCAL ] DCO: Primary data saved (14327 records). [2025-10-13T18:22:46.701038] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-13T18:22:46.701135] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DCO took 33.9s. Estimated remaining: 4h 4m 43s. Rate: 7.2 symbols/min [2025-10-13T18:22:47.748855] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T18:22:47.755715] [INFO ] [REMOTE ] DD: Full fetch complete (76380 records). [2025-10-13T18:22:47.755849] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-13T18:22:48.188390] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-13T18:22:48.188471] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-13T18:22:48.189339] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-13T18:22:48.189402] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-13T18:22:48.190945] [DEBUG] [LOCAL ] DD: Trimmed 76380 records to 52897 (keeping 200 days of data) [2025-10-13T18:22:48.508845] [DEBUG] [LOCAL ] DD: Primary data saved (52897 records). [2025-10-13T18:22:48.508980] [INFO ] [MAIN ] DD: Full history saved. [2025-10-13T18:22:48.509684] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DD took 34.3s. Estimated remaining: 4h 4m 15s. Rate: 7.3 symbols/min [2025-10-13T18:22:49.255282] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:49.250900] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:49.256783] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:49.267791] [DEBUG] [LOCAL ] DDL: No existing data file found in primary storage. [2025-10-13T18:22:49.284997] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-13T18:22:49.285109] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-13T18:22:49.316751] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-13T18:22:49.285213] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-10-13T18:22:49.317413] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-13T18:22:49.318885] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:22:49.316895] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-13T18:22:49.319124] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-13T18:22:49.319848] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-13T18:22:49.319893] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-13T18:22:49.320675] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-13T18:22:49.320859] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-13T18:22:49.407911] [DEBUG] [LOCAL ] DDT: Loaded 2119 existing records from primary storage. [2025-10-13T18:22:49.422371] [INFO ] [MAIN ] DDT: Loaded 2119 existing records. [2025-10-13T18:22:49.962954] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:49.947994] [DEBUG] [LOCAL ] DDD: Loaded 51691 existing records from primary storage. [2025-10-13T18:22:49.985522] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-13T18:22:49.995580] [INFO ] [MAIN ] DDD: Loaded 51691 existing records. [2025-10-13T18:22:50.005901] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-13T18:22:50.146798] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-13T18:22:50.197143] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-13T18:22:50.420889] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:50.466395] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-13T18:22:50.614181] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:50.653352] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:22:50.674117] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-13T18:22:50.674441] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-13T18:22:50.674621] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-13T18:22:50.687311] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-13T18:22:50.697790] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-13T18:22:51.281030] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:51.303700] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-13T18:22:51.521372] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:22:51.521761] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-13T18:23:05.625831] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (14.32 seconds). [2025-10-13T18:23:05.627106] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-13T18:23:06.326300] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (14.80 seconds). [2025-10-13T18:23:06.337114] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-13T18:23:06.867971] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T18:23:06.869087] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-13T18:23:07.228307] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (16.76 seconds). [2025-10-13T18:23:07.231615] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-13T18:23:07.337585] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T18:23:07.338622] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-13T18:23:07.867363] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-13T18:23:07.868578] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-13T18:23:08.403410] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-13T18:23:08.405009] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-13T18:23:08.609599] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (17.94 seconds). [2025-10-13T18:23:08.618537] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-13T18:23:09.143829] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T18:23:09.144910] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-13T18:23:09.189461] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-10-13T18:23:09.200180] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-13T18:23:09.599214] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T18:23:09.600390] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-13T18:23:09.796975] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T18:23:09.804445] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-13T18:23:10.084189] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-13T18:23:10.085479] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-13T18:23:10.530321] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T18:23:10.531843] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-13T18:23:10.999512] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T18:23:11.000578] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-13T18:23:11.366114] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (4.13 seconds). [2025-10-13T18:23:11.369301] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-13T18:23:11.479974] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T18:23:11.480726] [INFO ] [REMOTE ] DDT: Full fetch complete (2845 records). [2025-10-13T18:23:11.480792] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-13T18:23:11.829347] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-13T18:23:11.829420] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-13T18:23:11.829524] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-13T18:23:11.829560] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-13T18:23:11.829913] [DEBUG] [LOCAL ] DDT: Trimmed 2845 records to 2104 (keeping 200 days of data) [2025-10-13T18:23:11.843351] [DEBUG] [LOCAL ] DDT: Primary data saved (2104 records). [2025-10-13T18:23:11.843409] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-13T18:23:11.843473] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 23.3s. Estimated remaining: 4h 4m 51s. Rate: 7.2 symbols/min [2025-10-13T18:23:12.010697] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:12.055278] [DEBUG] [LOCAL ] DE: Loaded 48254 existing records from primary storage. [2025-10-13T18:23:12.055612] [INFO ] [MAIN ] DE: Loaded 48254 existing records. [2025-10-13T18:23:12.240276] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:23:12.240683] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-13T18:23:12.240857] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-13T18:23:12.250555] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-13T18:23:12.250729] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-13T18:23:12.295479] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T18:23:12.350042] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-13T18:23:12.647521] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:12.648049] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-13T18:23:12.849276] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (3.65 seconds). [2025-10-13T18:23:12.858946] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-13T18:23:13.417522] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T18:23:13.421357] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-13T18:23:14.120107] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (4.32 seconds). [2025-10-13T18:23:14.128045] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-13T18:23:14.344026] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:23:14.354071] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-13T18:23:14.404245] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T18:23:14.415951] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-13T18:23:15.367929] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T18:23:15.377111] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-13T18:23:15.848687] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-13T18:23:15.852750] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-13T18:23:16.152321] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T18:23:16.163251] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-13T18:23:16.984373] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T18:23:16.988244] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-13T18:23:17.897700] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T18:23:17.901169] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-13T18:23:18.037021] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-13T18:23:18.047623] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-13T18:23:18.702802] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (4.29 seconds). [2025-10-13T18:23:18.714147] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-13T18:23:18.826860] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T18:23:18.830494] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-13T18:23:19.824209] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T18:23:19.828124] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-13T18:23:20.093829] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T18:23:20.105498] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-13T18:23:20.358250] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T18:23:20.369757] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-13T18:23:20.543141] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T18:23:20.546494] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-13T18:23:22.082715] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T18:23:22.094329] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-13T18:23:22.217343] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (6.84 seconds). [2025-10-13T18:23:22.228304] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-13T18:23:22.724459] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-13T18:23:22.726231] [INFO ] [REMOTE ] DDS: Full fetch complete (18716 records). [2025-10-13T18:23:22.726309] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-13T18:23:23.123072] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-13T18:23:23.123201] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-13T18:23:23.123883] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-13T18:23:23.123949] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-13T18:23:23.124690] [DEBUG] [LOCAL ] DDS: Trimmed 18716 records to 12758 (keeping 200 days of data) [2025-10-13T18:23:23.217208] [DEBUG] [LOCAL ] DDS: Primary data saved (12758 records). [2025-10-13T18:23:23.217403] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-13T18:23:23.217494] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 34.7s. Estimated remaining: 4h 4m 52s. Rate: 7.2 symbols/min [2025-10-13T18:23:23.402029] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:23.448566] [DEBUG] [LOCAL ] DEA: Loaded 41091 existing records from primary storage. [2025-10-13T18:23:23.448964] [INFO ] [MAIN ] DEA: Loaded 41091 existing records. [2025-10-13T18:23:23.636875] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:23:23.637383] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-13T18:23:23.637464] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-13T18:23:23.638155] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-13T18:23:23.638221] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-13T18:23:24.015434] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T18:23:24.065676] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-13T18:23:24.087356] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:24.088525] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-13T18:23:25.121132] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T18:23:25.128517] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-13T18:23:25.582216] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (5.21 seconds). [2025-10-13T18:23:25.594120] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-13T18:23:25.806774] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T18:23:25.817272] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-13T18:23:26.317860] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T18:23:26.324779] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-13T18:23:27.362373] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T18:23:27.372998] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-13T18:23:27.516101] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T18:23:27.528343] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-13T18:23:27.754765] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T18:23:27.762429] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-13T18:23:28.962831] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:23:28.973141] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-13T18:23:29.200810] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (7.11 seconds). [2025-10-13T18:23:29.213119] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-13T18:23:29.401791] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T18:23:29.431209] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-13T18:23:29.432270] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T18:23:29.445851] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-13T18:23:30.565076] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T18:23:30.576323] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-13T18:23:30.697405] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T18:23:30.797382] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T18:23:30.802391] [INFO ] [REMOTE ] DDL: Full fetch complete (53321 records). [2025-10-13T18:23:30.802513] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-13T18:23:30.825634] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-13T18:23:31.221620] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T18:23:31.257244] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-13T18:23:31.257360] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-13T18:23:31.258330] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-13T18:23:31.258419] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-13T18:23:31.261217] [DEBUG] [LOCAL ] DDL: Trimmed 53321 records to 36862 (keeping 200 days of data) [2025-10-13T18:23:31.489491] [DEBUG] [LOCAL ] DDL: Primary data saved (36862 records). [2025-10-13T18:23:31.489782] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-13T18:23:31.489923] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 42.9s. Estimated remaining: 4h 4m 44s. Rate: 7.2 symbols/min [2025-10-13T18:23:31.623104] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-13T18:23:31.668693] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:31.704767] [DEBUG] [LOCAL ] DEC: Loaded 30887 existing records from primary storage. [2025-10-13T18:23:31.705121] [INFO ] [MAIN ] DEC: Loaded 30887 existing records. [2025-10-13T18:23:31.892289] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:23:31.892895] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-13T18:23:31.893070] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-13T18:23:31.893700] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-13T18:23:31.893770] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-13T18:23:32.276506] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:32.315966] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T18:23:32.417902] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-13T18:23:32.498458] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T18:23:33.205883] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T18:23:33.214223] [INFO ] [REMOTE ] DDD: Full fetch complete (73752 records). [2025-10-13T18:23:33.214388] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-13T18:23:33.229339] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-13T18:23:33.629761] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-13T18:23:33.629962] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-13T18:23:33.631212] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-13T18:23:33.631305] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-13T18:23:33.633553] [DEBUG] [LOCAL ] DDD: Trimmed 73752 records to 50954 (keeping 200 days of data) [2025-10-13T18:23:33.869586] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T18:23:33.977711] [DEBUG] [LOCAL ] DDD: Primary data saved (50954 records). [2025-10-13T18:23:33.977902] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-13T18:23:33.978063] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DDD took 45.5s. Estimated remaining: 4h 4m 18s. Rate: 7.2 symbols/min [2025-10-13T18:23:34.023132] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-13T18:23:34.152307] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:34.152535] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-13T18:23:34.152575] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-13T18:23:34.152725] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-13T18:23:34.152775] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-13T18:23:34.152817] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-13T18:23:34.152850] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-13T18:23:34.521713] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:34.817959] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-13T18:23:35.159921] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T18:23:35.293811] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T18:23:35.617928] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-13T18:23:36.417911] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-13T18:23:36.725313] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T18:23:37.217964] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-13T18:23:37.861699] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:23:38.017909] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-13T18:23:38.609308] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T18:23:38.817971] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-13T18:23:39.361437] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T18:23:39.617975] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-13T18:23:40.276962] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T18:23:40.426839] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-13T18:23:40.445409] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (5.63 seconds). [2025-10-13T18:23:41.150612] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:23:41.218014] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-13T18:23:42.017899] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-13T18:23:42.259468] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T18:23:42.265142] [INFO ] [REMOTE ] DE: Full fetch complete (69527 records). [2025-10-13T18:23:42.265363] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-13T18:23:42.696837] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-13T18:23:42.697180] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-13T18:23:42.698433] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-13T18:23:42.698626] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-13T18:23:42.727400] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T18:23:42.736964] [DEBUG] [LOCAL ] DE: Trimmed 69527 records to 47658 (keeping 200 days of data) [2025-10-13T18:23:42.836207] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-13T18:23:43.068303] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-13T18:23:43.167305] [DEBUG] [LOCAL ] DE: Primary data saved (47658 records). [2025-10-13T18:23:43.167551] [INFO ] [MAIN ] DE: Full history saved. [2025-10-13T18:23:43.168800] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DE took 31.3s. Estimated remaining: 4h 4m 13s. Rate: 7.2 symbols/min [2025-10-13T18:23:43.429116] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:43.492450] [DEBUG] [LOCAL ] DEI: Loaded 49010 existing records from primary storage. [2025-10-13T18:23:43.493061] [INFO ] [MAIN ] DEI: Loaded 49010 existing records. [2025-10-13T18:23:43.625427] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-13T18:23:43.803151] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:23:43.803780] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-13T18:23:43.803858] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-13T18:23:43.804610] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-13T18:23:43.804736] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-13T18:23:44.245679] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:44.420977] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-13T18:23:44.423781] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T18:23:45.069278] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:23:45.217922] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-13T18:23:45.924756] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T18:23:46.017989] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-13T18:23:46.602726] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T18:23:46.817922] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-13T18:23:47.173836] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T18:23:47.178197] [INFO ] [REMOTE ] DEA: Full fetch complete (62019 records). [2025-10-13T18:23:47.178292] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-13T18:23:47.558778] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-13T18:23:47.558873] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-13T18:23:47.559672] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-13T18:23:47.559794] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-13T18:23:47.561040] [DEBUG] [LOCAL ] DEA: Trimmed 62019 records to 40492 (keeping 200 days of data) [2025-10-13T18:23:47.622732] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-13T18:23:47.802681] [DEBUG] [LOCAL ] DEA: Primary data saved (40492 records). [2025-10-13T18:23:47.802810] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-13T18:23:47.802882] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEA took 24.6s. Estimated remaining: 4h 3m 54s. Rate: 7.2 symbols/min [2025-10-13T18:23:47.969937] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:23:48.023187] [DEBUG] [LOCAL ] DELL: Loaded 54516 existing records from primary storage. [2025-10-13T18:23:48.023540] [INFO ] [MAIN ] DELL: Loaded 54516 existing records. [2025-10-13T18:23:48.195733] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:23:48.195986] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-13T18:23:48.196034] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-13T18:23:48.196575] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-13T18:23:48.196631] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-13T18:23:48.431102] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-13T18:23:48.547222] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:23:48.872854] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-13T18:23:49.217996] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-13T18:23:49.357441] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T18:23:49.529525] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T18:23:50.017964] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-13T18:23:50.817953] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-13T18:23:51.111999] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T18:23:51.618027] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-13T18:23:52.339956] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T18:23:52.417954] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-13T18:23:52.703623] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-10-13T18:23:53.217971] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-13T18:23:53.268198] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T18:23:53.878829] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T18:23:54.017945] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-13T18:23:54.412483] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T18:23:54.818070] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-13T18:23:55.617927] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-13T18:23:55.939764] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T18:23:56.421799] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-13T18:23:56.427818] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T18:23:57.217928] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-13T18:23:57.573802] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T18:23:57.956209] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-13T18:23:58.017928] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-13T18:23:58.645903] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T18:23:58.817925] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-13T18:23:59.617924] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-13T18:24:00.018603] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T18:24:00.022387] [INFO ] [REMOTE ] DEC: Full fetch complete (43982 records). [2025-10-13T18:24:00.022475] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-13T18:24:00.425899] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-13T18:24:00.463846] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-13T18:24:00.474609] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-13T18:24:00.475261] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-13T18:24:00.476338] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-13T18:24:00.476458] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-13T18:24:00.478582] [DEBUG] [LOCAL ] DEC: Trimmed 43982 records to 30365 (keeping 200 days of data) [2025-10-13T18:24:00.676796] [DEBUG] [LOCAL ] DEC: Primary data saved (30365 records). [2025-10-13T18:24:00.677047] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-13T18:24:00.677257] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DEC took 29.2s. Estimated remaining: 4h 3m 59s. Rate: 7.2 symbols/min [2025-10-13T18:24:00.859916] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:00.860119] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-13T18:24:00.860164] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-13T18:24:00.860289] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-13T18:24:00.860331] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-13T18:24:00.860371] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-13T18:24:00.860403] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-13T18:24:01.212337] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:01.217888] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-13T18:24:01.763228] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-13T18:24:02.017972] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-13T18:24:02.351285] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T18:24:02.814330] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T18:24:02.825339] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-13T18:24:03.617906] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-13T18:24:03.782507] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T18:24:04.022470] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T18:24:04.417966] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-13T18:24:05.217966] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-13T18:24:05.280760] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T18:24:06.017899] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-13T18:24:06.098038] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T18:24:06.817903] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-13T18:24:07.603462] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-13T18:24:07.617882] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-13T18:24:07.680067] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T18:24:08.417973] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-13T18:24:08.631603] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T18:24:09.217989] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-13T18:24:10.018071] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-13T18:24:10.084091] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-13T18:24:10.135047] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T18:24:10.817968] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-13T18:24:11.290925] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-13T18:24:11.296485] [INFO ] [REMOTE ] DECK: Full fetch complete (76805 records). [2025-10-13T18:24:11.296637] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-13T18:24:11.622002] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-13T18:24:11.701158] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-13T18:24:11.701336] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-13T18:24:11.702278] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-13T18:24:11.702357] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-13T18:24:11.731873] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:24:11.730518] [DEBUG] [LOCAL ] DECK: Trimmed 76805 records to 53297 (keeping 200 days of data) [2025-10-13T18:24:12.064664] [DEBUG] [LOCAL ] DECK: Primary data saved (53297 records). [2025-10-13T18:24:12.064808] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-13T18:24:12.064880] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DECK took 38.1s. Estimated remaining: 4h 3m 59s. Rate: 7.2 symbols/min [2025-10-13T18:24:12.235821] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:12.265214] [DEBUG] [LOCAL ] DFH: Loaded 32600 existing records from primary storage. [2025-10-13T18:24:12.265474] [INFO ] [MAIN ] DFH: Loaded 32600 existing records. [2025-10-13T18:24:12.423064] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-13T18:24:12.458101] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:24:12.458361] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-13T18:24:12.458408] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-13T18:24:12.458757] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-13T18:24:12.458814] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-13T18:24:12.838132] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:13.187589] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-13T18:24:13.217897] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-13T18:24:13.452515] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T18:24:14.017969] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-13T18:24:14.174047] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T18:24:14.818009] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-13T18:24:15.399945] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-13T18:24:15.475785] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T18:24:15.617965] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-13T18:24:16.123066] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:24:16.417951] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-13T18:24:17.217914] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-13T18:24:17.317540] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T18:24:17.933347] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T18:24:18.017900] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-13T18:24:18.758789] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T18:24:18.763855] [INFO ] [REMOTE ] DEI: Full fetch complete (69697 records). [2025-10-13T18:24:18.763974] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-13T18:24:18.823365] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-13T18:24:19.178969] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-13T18:24:19.179049] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-13T18:24:19.179846] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-13T18:24:19.179910] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-13T18:24:19.181357] [DEBUG] [LOCAL ] DEI: Trimmed 69697 records to 48334 (keeping 200 days of data) [2025-10-13T18:24:19.310232] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T18:24:19.502501] [DEBUG] [LOCAL ] DEI: Primary data saved (48334 records). [2025-10-13T18:24:19.502687] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-13T18:24:19.503467] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DEI took 36.3s. Estimated remaining: 4h 3m 48s. Rate: 7.2 symbols/min [2025-10-13T18:24:19.623020] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-13T18:24:19.675236] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:19.698034] [DEBUG] [LOCAL ] DFIN: Loaded 23143 existing records from primary storage. [2025-10-13T18:24:19.698322] [INFO ] [MAIN ] DFIN: Loaded 23143 existing records. [2025-10-13T18:24:19.881018] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:24:19.881263] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-13T18:24:19.881317] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-13T18:24:19.881536] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-13T18:24:19.881594] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-13T18:24:20.231456] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:20.418019] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-13T18:24:20.963789] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T18:24:21.136244] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T18:24:21.217926] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-13T18:24:21.568606] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T18:24:22.017916] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-13T18:24:22.504833] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T18:24:22.818015] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-13T18:24:23.617911] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-13T18:24:24.022086] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T18:24:24.417963] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-13T18:24:24.783880] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T18:24:25.163394] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T18:24:25.217899] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-13T18:24:25.459973] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T18:24:26.017957] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-13T18:24:26.492057] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:24:26.817957] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-13T18:24:27.115339] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T18:24:27.617920] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-13T18:24:28.412503] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T18:24:28.422392] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-13T18:24:28.876124] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T18:24:29.217994] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-13T18:24:29.642044] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T18:24:30.017978] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-13T18:24:30.818040] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-13T18:24:31.591144] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-13T18:24:31.617898] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-13T18:24:31.835520] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T18:24:31.895869] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T18:24:32.418000] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-13T18:24:33.217971] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-13T18:24:33.928932] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-13T18:24:33.934415] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-13T18:24:33.934595] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-13T18:24:34.023208] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-13T18:24:34.159823] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-13T18:24:34.390305] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-13T18:24:34.390426] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-13T18:24:34.391467] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-13T18:24:34.391532] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-13T18:24:34.393088] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 53736 (keeping 200 days of data) [2025-10-13T18:24:34.526065] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-13T18:24:34.539541] [INFO ] [REMOTE ] DEO: Full fetch complete (71531 records). [2025-10-13T18:24:34.539711] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-13T18:24:34.855901] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-13T18:24:35.153608] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-13T18:24:35.153879] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-13T18:24:35.154009] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-13T18:24:35.154281] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-13T18:24:35.154204] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DELL took 47.4s. Estimated remaining: 4h 4m 1s. Rate: 7.2 symbols/min [2025-10-13T18:24:35.155257] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-13T18:24:35.155353] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-13T18:24:35.257516] [DEBUG] [LOCAL ] DEO: Trimmed 71531 records to 49199 (keeping 200 days of data) [2025-10-13T18:24:35.421738] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:35.422856] [DEBUG] [LOCAL ] DFP: No existing data file found in primary storage. [2025-10-13T18:24:35.423542] [WARN ] [MAIN ] DFP: No existing data found, performing full refresh instead. [2025-10-13T18:24:35.426455] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-13T18:24:35.427014] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-13T18:24:35.428792] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-13T18:24:35.429486] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-13T18:24:35.565096] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T18:24:35.632192] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-13T18:24:36.116417] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:36.146017] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T18:24:36.248416] [DEBUG] [LOCAL ] DEO: Primary data saved (49199 records). [2025-10-13T18:24:36.248606] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-13T18:24:36.248787] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DEO took 35.6s. Estimated remaining: 4h 3m 32s. Rate: 7.2 symbols/min [2025-10-13T18:24:36.423039] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-13T18:24:36.452260] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:36.453304] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-10-13T18:24:36.453384] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-10-13T18:24:36.453591] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-13T18:24:36.453694] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-13T18:24:36.453779] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-13T18:24:36.453826] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-13T18:24:36.838205] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:37.077041] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:24:37.213405] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T18:24:37.218092] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-13T18:24:38.017898] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-13T18:24:38.253672] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T18:24:38.797371] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T18:24:38.817878] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-13T18:24:39.572043] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T18:24:39.617883] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-13T18:24:40.417949] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-13T18:24:40.436798] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T18:24:41.217963] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-13T18:24:42.018049] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-13T18:24:42.373694] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T18:24:42.474911] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-13T18:24:42.817983] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-13T18:24:43.279503] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T18:24:43.508492] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T18:24:43.617951] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-13T18:24:44.417970] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-13T18:24:44.722492] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T18:24:44.725879] [INFO ] [REMOTE ] DFH: Full fetch complete (48055 records). [2025-10-13T18:24:44.725955] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-13T18:24:45.095001] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-13T18:24:45.095080] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-13T18:24:45.095691] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-13T18:24:45.095752] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-13T18:24:45.097700] [DEBUG] [LOCAL ] DFH: Trimmed 48055 records to 32203 (keeping 200 days of data) [2025-10-13T18:24:45.240422] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-13T18:24:45.283480] [DEBUG] [LOCAL ] DFH: Primary data saved (32203 records). [2025-10-13T18:24:45.283618] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-13T18:24:45.283750] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFH took 33.2s. Estimated remaining: 4h 3m 26s. Rate: 7.2 symbols/min [2025-10-13T18:24:45.451334] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:45.451520] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-13T18:24:45.451558] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-13T18:24:45.451689] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-13T18:24:45.451742] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-13T18:24:45.451784] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-13T18:24:45.451817] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-13T18:24:45.805159] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:46.017927] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-13T18:24:46.298517] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T18:24:46.395742] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T18:24:46.398594] [INFO ] [REMOTE ] DFIN: Full fetch complete (33362 records). [2025-10-13T18:24:46.398711] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-13T18:24:46.776370] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-13T18:24:46.776450] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-13T18:24:46.777023] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-13T18:24:46.777086] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-13T18:24:46.778057] [DEBUG] [LOCAL ] DFIN: Trimmed 33362 records to 22684 (keeping 200 days of data) [2025-10-13T18:24:46.827395] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-13T18:24:46.917238] [DEBUG] [LOCAL ] DFIN: Primary data saved (22684 records). [2025-10-13T18:24:46.917366] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-13T18:24:46.917479] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFIN took 27.4s. Estimated remaining: 4h 2m 59s. Rate: 7.2 symbols/min [2025-10-13T18:24:47.103465] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:24:47.122779] [DEBUG] [LOCAL ] DHF: Loaded 21463 existing records from primary storage. [2025-10-13T18:24:47.123024] [INFO ] [MAIN ] DHF: Loaded 21463 existing records. [2025-10-13T18:24:47.300677] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:24:47.300903] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-13T18:24:47.300950] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-13T18:24:47.301253] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-13T18:24:47.301311] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-13T18:24:47.629953] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-13T18:24:47.673071] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:24:47.738935] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T18:24:48.417897] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-13T18:24:48.493126] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-13T18:24:48.878522] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-13T18:24:49.217926] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-13T18:24:50.021834] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-13T18:24:50.157703] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T18:24:50.788901] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-13T18:24:50.817882] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-13T18:24:51.051775] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T18:24:51.617929] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-13T18:24:51.823674] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T18:24:52.417962] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-13T18:24:52.508357] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-13T18:24:53.217961] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-13T18:24:54.017953] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-13T18:24:54.684089] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-13T18:24:54.721762] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T18:24:54.817928] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-13T18:24:54.845162] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-13T18:24:55.617921] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-13T18:24:56.316112] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T18:24:56.417902] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-13T18:24:56.860333] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-13T18:24:57.217896] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-13T18:24:57.380781] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T18:24:58.017964] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-13T18:24:58.698577] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T18:24:58.818008] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-13T18:24:59.145563] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T18:24:59.533243] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-13T18:24:59.617921] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-13T18:25:00.348031] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T18:25:00.349794] [INFO ] [REMOTE ] DFP: Full fetch complete (15864 records). [2025-10-13T18:25:00.349960] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-13T18:25:00.423093] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-13T18:25:00.738950] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-13T18:25:00.739094] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-13T18:25:00.739891] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-13T18:25:00.739965] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-13T18:25:00.741376] [DEBUG] [LOCAL ] DFP: Trimmed 15864 records to 11208 (keeping 200 days of data) [2025-10-13T18:25:00.823985] [DEBUG] [LOCAL ] DFP: Primary data saved (11208 records). [2025-10-13T18:25:00.824193] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-13T18:25:00.824289] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DFP took 25.7s. Estimated remaining: 4h 3m 6s. Rate: 7.2 symbols/min [2025-10-13T18:25:01.001937] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:01.073350] [DEBUG] [LOCAL ] DHI: Loaded 54122 existing records from primary storage. [2025-10-13T18:25:01.073868] [INFO ] [MAIN ] DHI: Loaded 54122 existing records. [2025-10-13T18:25:01.226926] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-13T18:25:01.309467] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:01.309800] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-13T18:25:01.309870] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-13T18:25:01.310561] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-13T18:25:01.310618] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-13T18:25:01.707492] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:02.017997] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-13T18:25:02.302628] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T18:25:02.817922] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-13T18:25:03.158101] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T18:25:03.617906] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-13T18:25:04.166841] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T18:25:04.417917] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-13T18:25:05.217911] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-13T18:25:05.341308] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-13T18:25:05.347787] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T18:25:05.384846] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T18:25:06.018025] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-13T18:25:06.817903] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-13T18:25:07.014816] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T18:25:07.130737] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T18:25:07.617921] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-13T18:25:08.417980] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-13T18:25:08.542971] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T18:25:09.217895] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-13T18:25:09.254252] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T18:25:09.476737] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T18:25:10.017923] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-13T18:25:10.817910] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-13T18:25:11.066512] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-13T18:25:11.467623] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:25:11.617950] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-13T18:25:11.895407] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T18:25:12.417998] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-13T18:25:13.047490] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:25:13.218031] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-13T18:25:14.017963] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-13T18:25:14.554508] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-13T18:25:14.817907] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-13T18:25:14.882120] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T18:25:15.018356] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-13T18:25:15.024096] [INFO ] [REMOTE ] DG: Full fetch complete (77208 records). [2025-10-13T18:25:15.024234] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-13T18:25:15.410840] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-13T18:25:15.410945] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-13T18:25:15.411812] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-13T18:25:15.411873] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-13T18:25:15.413394] [DEBUG] [LOCAL ] DG: Trimmed 77208 records to 53278 (keeping 200 days of data) [2025-10-13T18:25:15.625096] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-13T18:25:15.747718] [DEBUG] [LOCAL ] DG: Primary data saved (53278 records). [2025-10-13T18:25:15.747854] [INFO ] [MAIN ] DG: Full history saved. [2025-10-13T18:25:15.747923] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DG took 39.5s. Estimated remaining: 4h 3m 17s. Rate: 7.2 symbols/min [2025-10-13T18:25:15.911940] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:15.963256] [DEBUG] [LOCAL ] DHR: Loaded 54151 existing records from primary storage. [2025-10-13T18:25:15.963575] [INFO ] [MAIN ] DHR: Loaded 54151 existing records. [2025-10-13T18:25:16.139067] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:16.139346] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-13T18:25:16.139412] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-13T18:25:16.140189] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-13T18:25:16.140248] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-13T18:25:16.422186] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-13T18:25:16.500406] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:16.888505] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T18:25:16.913363] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-13T18:25:17.217956] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-13T18:25:17.971340] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:25:18.018000] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-13T18:25:18.817926] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-13T18:25:19.045362] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T18:25:19.617968] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-13T18:25:19.755193] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T18:25:20.107833] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-13T18:25:20.247801] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T18:25:20.417925] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-13T18:25:21.218035] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-13T18:25:22.005137] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T18:25:22.017886] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-13T18:25:22.219519] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T18:25:22.222982] [INFO ] [REMOTE ] DHF: Full fetch complete (30089 records). [2025-10-13T18:25:22.223161] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-13T18:25:22.635956] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-13T18:25:22.636080] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-13T18:25:22.637291] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-13T18:25:22.637374] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-13T18:25:22.638976] [DEBUG] [LOCAL ] DHF: Trimmed 30089 records to 21235 (keeping 200 days of data) [2025-10-13T18:25:22.773909] [DEBUG] [LOCAL ] DHF: Primary data saved (21235 records). [2025-10-13T18:25:22.774148] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-13T18:25:22.774258] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DHF took 35.9s. Estimated remaining: 4h 3m 5s. Rate: 7.2 symbols/min [2025-10-13T18:25:22.828563] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-13T18:25:22.953268] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:23.004891] [DEBUG] [LOCAL ] DHT: Loaded 48622 existing records from primary storage. [2025-10-13T18:25:23.005316] [INFO ] [MAIN ] DHT: Loaded 48622 existing records. [2025-10-13T18:25:23.185506] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:23.185834] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-13T18:25:23.185884] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-13T18:25:23.186304] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-13T18:25:23.186362] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-13T18:25:23.570005] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:23.617961] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-13T18:25:23.686725] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T18:25:24.418006] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-13T18:25:24.727493] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T18:25:25.223117] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-13T18:25:25.250877] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:25:26.017910] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-13T18:25:26.061878] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:25:26.066442] [INFO ] [REMOTE ] DGX: Full fetch complete (65128 records). [2025-10-13T18:25:26.066542] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-13T18:25:26.444849] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-13T18:25:26.444926] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-13T18:25:26.445697] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-13T18:25:26.445760] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-13T18:25:26.447035] [DEBUG] [LOCAL ] DGX: Trimmed 65128 records to 44805 (keeping 200 days of data) [2025-10-13T18:25:26.736874] [DEBUG] [LOCAL ] DGX: Primary data saved (44805 records). [2025-10-13T18:25:26.737003] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-13T18:25:26.737074] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DGX took 41.5s. Estimated remaining: 4h 2m 44s. Rate: 7.2 symbols/min [2025-10-13T18:25:26.822939] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-13T18:25:26.937331] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:26.951475] [DEBUG] [LOCAL ] DHX: Loaded 13393 existing records from primary storage. [2025-10-13T18:25:26.951739] [INFO ] [MAIN ] DHX: Loaded 13393 existing records. [2025-10-13T18:25:27.165694] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:27.166039] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-13T18:25:27.166311] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-13T18:25:27.168845] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T18:25:27.168917] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-13T18:25:27.180225] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-13T18:25:27.534284] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:27.617927] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-13T18:25:27.910709] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T18:25:28.418061] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-13T18:25:28.548843] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:25:28.722624] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T18:25:29.217972] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-13T18:25:30.017908] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-13T18:25:30.428675] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T18:25:30.471749] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T18:25:30.817927] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-13T18:25:30.997465] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T18:25:31.617917] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-13T18:25:32.418048] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-13T18:25:32.801445] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T18:25:32.813691] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T18:25:33.217999] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-13T18:25:34.017912] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-13T18:25:34.146987] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T18:25:34.408334] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T18:25:34.817903] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-13T18:25:35.530130] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T18:25:35.617909] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-13T18:25:36.417904] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-13T18:25:36.521161] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-13T18:25:37.018696] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-13T18:25:37.217951] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-13T18:25:37.741745] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T18:25:38.017993] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-13T18:25:38.818007] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-13T18:25:39.128059] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-13T18:25:39.133520] [INFO ] [REMOTE ] DHI: Full fetch complete (77216 records). [2025-10-13T18:25:39.133690] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-13T18:25:39.519058] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-13T18:25:39.519132] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-13T18:25:39.519991] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-13T18:25:39.520054] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-13T18:25:39.521534] [DEBUG] [LOCAL ] DHI: Trimmed 77216 records to 53356 (keeping 200 days of data) [2025-10-13T18:25:39.622016] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-13T18:25:39.853540] [DEBUG] [LOCAL ] DHI: Primary data saved (53356 records). [2025-10-13T18:25:39.853728] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-13T18:25:39.853830] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHI took 39.0s. Estimated remaining: 4h 2m 50s. Rate: 7.2 symbols/min [2025-10-13T18:25:40.025108] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:40.039870] [DEBUG] [LOCAL ] DIAX: Loaded 13282 existing records from primary storage. [2025-10-13T18:25:40.040349] [INFO ] [MAIN ] DIAX: Loaded 13282 existing records. [2025-10-13T18:25:40.172799] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T18:25:40.273195] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:40.273440] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-13T18:25:40.273502] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-13T18:25:40.273786] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-13T18:25:40.273850] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-13T18:25:40.423722] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-13T18:25:40.643937] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:40.649860] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T18:25:40.695889] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T18:25:41.217973] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-13T18:25:42.017904] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-13T18:25:42.064425] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T18:25:42.115090] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T18:25:42.621105] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T18:25:42.817924] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-13T18:25:43.617907] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-13T18:25:44.417984] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-13T18:25:44.446915] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T18:25:44.680339] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T18:25:45.128760] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T18:25:45.217911] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-13T18:25:46.017990] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-13T18:25:46.072035] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T18:25:46.560717] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-13T18:25:46.566271] [INFO ] [REMOTE ] DHR: Full fetch complete (77263 records). [2025-10-13T18:25:46.566420] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-13T18:25:46.823078] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-13T18:25:46.957261] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-13T18:25:46.957335] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-13T18:25:46.958207] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-13T18:25:46.958269] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-13T18:25:46.959691] [DEBUG] [LOCAL ] DHR: Trimmed 77263 records to 53378 (keeping 200 days of data) [2025-10-13T18:25:47.293364] [DEBUG] [LOCAL ] DHR: Primary data saved (53378 records). [2025-10-13T18:25:47.293686] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-13T18:25:47.293794] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHR took 31.5s. Estimated remaining: 4h 2m 39s. Rate: 7.2 symbols/min [2025-10-13T18:25:47.458849] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:47.494057] [DEBUG] [LOCAL ] DIN: Loaded 37849 existing records from primary storage. [2025-10-13T18:25:47.494329] [INFO ] [MAIN ] DIN: Loaded 37849 existing records. [2025-10-13T18:25:47.630778] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-13T18:25:47.676234] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:25:47.676622] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-13T18:25:47.676739] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-13T18:25:47.677200] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-13T18:25:47.677259] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-13T18:25:47.813585] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T18:25:48.047424] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:48.417980] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-13T18:25:48.446923] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T18:25:49.217997] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-13T18:25:49.352109] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T18:25:49.354310] [INFO ] [REMOTE ] DHX: Full fetch complete (21126 records). [2025-10-13T18:25:49.354376] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-13T18:25:49.707863] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-13T18:25:49.707958] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-13T18:25:49.708429] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-13T18:25:49.708470] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-13T18:25:49.709107] [DEBUG] [LOCAL ] DHX: Trimmed 21126 records to 13254 (keeping 200 days of data) [2025-10-13T18:25:49.780086] [DEBUG] [LOCAL ] DHX: Primary data saved (13254 records). [2025-10-13T18:25:49.780226] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-13T18:25:49.780301] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHX took 23.0s. Estimated remaining: 4h 2m 14s. Rate: 7.2 symbols/min [2025-10-13T18:25:49.945574] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:25:49.945811] [DEBUG] [LOCAL ] DINO: No existing data file found in primary storage. [2025-10-13T18:25:49.945853] [WARN ] [MAIN ] DINO: No existing data found, performing full refresh instead. [2025-10-13T18:25:49.945960] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-13T18:25:49.946000] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-13T18:25:49.946040] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-13T18:25:49.946071] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-13T18:25:50.023114] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-13T18:25:50.295999] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:25:50.797151] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T18:25:50.817920] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-13T18:25:51.563464] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T18:25:51.617916] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-13T18:25:52.277724] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:25:52.417885] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-13T18:25:53.217988] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-13T18:25:53.350122] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T18:25:53.908668] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T18:25:53.925029] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T18:25:54.017922] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-13T18:25:54.817971] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-13T18:25:54.948818] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T18:25:55.618013] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-13T18:25:56.382497] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T18:25:56.417886] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-13T18:25:57.070535] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T18:25:57.217962] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-13T18:25:57.926002] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T18:25:58.017881] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-13T18:25:58.673480] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T18:25:58.817902] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-13T18:25:59.565049] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T18:25:59.617874] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-13T18:25:59.810340] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T18:26:00.397153] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T18:26:00.417883] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-13T18:26:01.217986] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-13T18:26:01.258601] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-13T18:26:02.017920] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-13T18:26:02.601051] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T18:26:02.817955] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-13T18:26:03.457776] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T18:26:03.617914] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-13T18:26:03.698417] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T18:26:04.417970] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-13T18:26:04.619330] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T18:26:05.217970] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-13T18:26:06.021059] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-13T18:26:06.371522] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-13T18:26:06.787263] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T18:26:06.792364] [INFO ] [REMOTE ] DHT: Full fetch complete (69956 records). [2025-10-13T18:26:06.792483] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-13T18:26:06.823783] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-13T18:26:07.253323] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-13T18:26:07.253439] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-13T18:26:07.254394] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-13T18:26:07.254477] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-13T18:26:07.256010] [DEBUG] [LOCAL ] DHT: Trimmed 69956 records to 47907 (keeping 200 days of data) [2025-10-13T18:26:07.481921] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T18:26:07.525705] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T18:26:07.530409] [INFO ] [REMOTE ] DIAX: Full fetch complete (17748 records). [2025-10-13T18:26:07.532053] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-13T18:26:07.621268] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-13T18:26:07.746348] [DEBUG] [LOCAL ] DHT: Primary data saved (47907 records). [2025-10-13T18:26:07.771125] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-13T18:26:07.810186] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DHT took 45.0s. Estimated remaining: 4h 2m 33s. Rate: 7.2 symbols/min [2025-10-13T18:26:08.171043] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:08.188794] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-13T18:26:08.188877] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-13T18:26:08.189339] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-13T18:26:08.189510] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-13T18:26:08.190118] [DEBUG] [LOCAL ] DIAX: Trimmed 17748 records to 13102 (keeping 200 days of data) [2025-10-13T18:26:08.270505] [DEBUG] [LOCAL ] DIAX: Primary data saved (13102 records). [2025-10-13T18:26:08.270681] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-13T18:26:08.270856] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIAX took 28.4s. Estimated remaining: 4h 2m 3s. Rate: 7.2 symbols/min [2025-10-13T18:26:08.424257] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-13T18:26:08.457826] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:08.458219] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-13T18:26:08.473474] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-13T18:26:08.475233] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-13T18:26:08.475324] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-13T18:26:08.475439] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-13T18:26:08.475498] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-13T18:26:08.519848] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-10-13T18:26:08.551706] [INFO ] [MAIN ] DIS: Loaded 54568 existing records. [2025-10-13T18:26:08.894063] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:26:08.906032] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-13T18:26:08.916483] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-13T18:26:08.959057] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-13T18:26:08.959239] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-13T18:26:09.200374] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:09.234422] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-13T18:26:09.373087] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T18:26:09.480987] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:09.710576] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-13T18:26:09.881742] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T18:26:10.017895] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-13T18:26:10.817925] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-13T18:26:11.618002] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-13T18:26:11.718616] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T18:26:12.034448] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-13T18:26:12.260210] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T18:26:12.417919] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-13T18:26:12.752025] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-13T18:26:13.218028] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-13T18:26:14.017921] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-13T18:26:14.817905] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-13T18:26:15.105238] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T18:26:15.188271] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T18:26:15.378736] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:26:15.617921] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-13T18:26:16.039598] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-13T18:26:16.417969] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-13T18:26:17.217952] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-13T18:26:18.017962] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-13T18:26:18.420590] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T18:26:18.424708] [INFO ] [REMOTE ] DIN: Full fetch complete (55181 records). [2025-10-13T18:26:18.424809] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-13T18:26:18.526398] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-13T18:26:18.803807] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-13T18:26:18.803884] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-13T18:26:18.804702] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-13T18:26:18.804763] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-13T18:26:18.805949] [DEBUG] [LOCAL ] DIN: Trimmed 55181 records to 37419 (keeping 200 days of data) [2025-10-13T18:26:18.860914] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-13T18:26:19.042444] [DEBUG] [LOCAL ] DIN: Primary data saved (37419 records). [2025-10-13T18:26:19.042583] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-13T18:26:19.042695] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DIN took 31.7s. Estimated remaining: 4h 2m 1s. Rate: 7.2 symbols/min [2025-10-13T18:26:19.223454] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:19.254533] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-13T18:26:19.257613] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-10-13T18:26:19.308242] [DEBUG] [LOCAL ] DK: Loaded 50055 existing records from primary storage. [2025-10-13T18:26:19.308553] [INFO ] [MAIN ] DK: Loaded 50055 existing records. [2025-10-13T18:26:19.483534] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:26:19.483753] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-13T18:26:19.483805] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-13T18:26:19.484294] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-13T18:26:19.484357] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-13T18:26:19.623450] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-13T18:26:19.854923] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:20.186569] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T18:26:20.417985] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-13T18:26:21.217978] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-13T18:26:21.546752] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-13T18:26:22.018011] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-13T18:26:22.377799] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-13T18:26:22.733193] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-13T18:26:22.817887] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-13T18:26:23.216839] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-13T18:26:23.217537] [INFO ] [REMOTE ] DIVY: Full fetch complete (1699 records). [2025-10-13T18:26:23.217605] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-13T18:26:23.393803] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T18:26:23.394025] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:26:23.394095] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:26:23.394147] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-13T18:26:23.394204] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-13T18:26:23.394239] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-13T18:26:23.394279] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-13T18:26:23.394336] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIVY took 15.1s. Estimated remaining: 4h 1m 42s. Rate: 7.2 symbols/min [2025-10-13T18:26:23.561746] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:23.561941] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-10-13T18:26:23.561978] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-10-13T18:26:23.562090] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-13T18:26:23.562131] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-13T18:26:23.562171] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-13T18:26:23.562204] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-13T18:26:23.623192] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-13T18:26:23.941831] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:24.417924] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-13T18:26:25.217982] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-13T18:26:25.854534] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-13T18:26:25.984502] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-13T18:26:26.017900] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-13T18:26:26.817925] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-13T18:26:26.910977] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T18:26:27.618051] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-13T18:26:28.386738] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:26:28.417948] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-13T18:26:28.484208] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-13T18:26:29.217974] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-13T18:26:29.357017] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T18:26:29.866098] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T18:26:30.018012] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-13T18:26:30.817909] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-13T18:26:31.239475] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T18:26:31.617900] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-13T18:26:31.659530] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-13T18:26:32.417913] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-13T18:26:32.456866] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:26:33.179939] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T18:26:33.217891] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-13T18:26:33.287508] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-13T18:26:34.017974] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-13T18:26:34.818023] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-13T18:26:34.893302] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-13T18:26:34.993697] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T18:26:35.617954] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-13T18:26:36.417966] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-13T18:26:36.466752] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T18:26:37.217958] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-13T18:26:38.017922] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-13T18:26:38.072556] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-13T18:26:38.299546] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-13T18:26:38.332882] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T18:26:38.818067] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-13T18:26:39.498478] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T18:26:39.618049] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-13T18:26:40.418030] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-13T18:26:40.465345] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T18:26:40.471468] [INFO ] [REMOTE ] DINO: Full fetch complete (76568 records). [2025-10-13T18:26:40.471735] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-13T18:26:40.931334] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-13T18:26:40.931468] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-13T18:26:40.932726] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-13T18:26:40.932797] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-13T18:26:40.935383] [DEBUG] [LOCAL ] DINO: Trimmed 76568 records to 52852 (keeping 200 days of data) [2025-10-13T18:26:41.021912] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T18:26:41.218001] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-13T18:26:41.327610] [DEBUG] [LOCAL ] DINO: Primary data saved (52852 records). [2025-10-13T18:26:41.327876] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-13T18:26:41.328072] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DINO took 51.5s. Estimated remaining: 4h 2m 1s. Rate: 7.2 symbols/min [2025-10-13T18:26:41.509575] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:41.568793] [DEBUG] [LOCAL ] DKS: Loaded 50431 existing records from primary storage. [2025-10-13T18:26:41.569260] [INFO ] [MAIN ] DKS: Loaded 50431 existing records. [2025-10-13T18:26:41.773549] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:26:41.773895] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-13T18:26:41.773947] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-13T18:26:41.774497] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-13T18:26:41.774567] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-13T18:26:42.033488] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-13T18:26:42.172998] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:42.346084] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T18:26:42.635355] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-13T18:26:42.817968] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-13T18:26:43.617954] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-13T18:26:43.683164] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T18:26:44.417981] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-13T18:26:45.222540] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-13T18:26:45.225894] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T18:26:45.275805] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-13T18:26:45.348720] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T18:26:46.017976] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-13T18:26:46.817994] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-13T18:26:47.179910] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-13T18:26:47.617885] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-13T18:26:47.727684] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T18:26:47.727399] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T18:26:48.418003] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-13T18:26:49.217901] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-13T18:26:49.292435] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T18:26:49.795346] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T18:26:50.018054] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-13T18:26:50.076239] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T18:26:50.817964] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-13T18:26:51.619313] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-13T18:26:51.622143] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T18:26:51.837022] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T18:26:52.417956] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-13T18:26:53.148406] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T18:26:53.217901] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-13T18:26:53.359235] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T18:26:53.361039] [INFO ] [REMOTE ] DKL: Full fetch complete (27957 records). [2025-10-13T18:26:53.361111] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-13T18:26:53.717357] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-13T18:26:53.717431] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-13T18:26:53.717905] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-13T18:26:53.717988] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-13T18:26:53.718630] [DEBUG] [LOCAL ] DKL: Trimmed 27957 records to 17768 (keeping 200 days of data) [2025-10-13T18:26:53.824935] [DEBUG] [LOCAL ] DKL: Primary data saved (17768 records). [2025-10-13T18:26:53.825076] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-13T18:26:53.825173] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DKL took 30.4s. Estimated remaining: 4h 2m 4s. Rate: 7.2 symbols/min [2025-10-13T18:26:53.988822] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:53.989022] [DEBUG] [LOCAL ] DLB: No existing data file found in primary storage. [2025-10-13T18:26:53.989061] [WARN ] [MAIN ] DLB: No existing data found, performing full refresh instead. [2025-10-13T18:26:53.989174] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-13T18:26:53.989216] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-13T18:26:53.989258] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-13T18:26:53.989290] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-13T18:26:54.023133] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-13T18:26:54.339959] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:54.817925] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-13T18:26:55.191554] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T18:26:55.617948] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-13T18:26:55.786447] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T18:26:55.792613] [INFO ] [REMOTE ] DK: Full fetch complete (70864 records). [2025-10-13T18:26:55.792870] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-13T18:26:56.216743] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-13T18:26:56.216882] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-13T18:26:56.218248] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-13T18:26:56.218487] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-13T18:26:56.239334] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T18:26:56.247701] [DEBUG] [LOCAL ] DK: Trimmed 70864 records to 49383 (keeping 200 days of data) [2025-10-13T18:26:56.435602] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-13T18:26:56.578347] [DEBUG] [LOCAL ] DK: Primary data saved (49383 records). [2025-10-13T18:26:56.578484] [INFO ] [MAIN ] DK: Full history saved. [2025-10-13T18:26:56.578587] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DK took 37.5s. Estimated remaining: 4h 1m 40s. Rate: 7.2 symbols/min [2025-10-13T18:26:56.753332] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:26:56.760493] [DEBUG] [LOCAL ] DLNG: Loaded 6234 existing records from primary storage. [2025-10-13T18:26:56.760755] [INFO ] [MAIN ] DLNG: Loaded 6234 existing records. [2025-10-13T18:26:56.934461] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:26:56.934690] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-13T18:26:56.934746] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-13T18:26:56.934958] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-13T18:26:56.935013] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-13T18:26:57.223051] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-13T18:26:57.291344] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:26:57.560978] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T18:26:57.847061] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:26:58.017947] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-13T18:26:58.817979] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-13T18:26:59.499985] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-13T18:26:59.617889] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-13T18:26:59.758844] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T18:27:00.178897] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T18:27:00.336010] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T18:27:00.343119] [INFO ] [REMOTE ] DIS: Full fetch complete (77945 records). [2025-10-13T18:27:00.343346] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-13T18:27:00.423091] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-13T18:27:00.754120] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-13T18:27:00.754205] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-13T18:27:00.755190] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-13T18:27:00.755253] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-13T18:27:00.756851] [DEBUG] [LOCAL ] DIS: Trimmed 77945 records to 53788 (keeping 200 days of data) [2025-10-13T18:27:01.085964] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-13T18:27:01.086107] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-13T18:27:01.087209] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DIS took 53.3s. Estimated remaining: 4h 1m 21s. Rate: 7.2 symbols/min [2025-10-13T18:27:01.227031] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-13T18:27:01.259688] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:01.319287] [DEBUG] [LOCAL ] DLR: Loaded 51583 existing records from primary storage. [2025-10-13T18:27:01.319606] [INFO ] [MAIN ] DLR: Loaded 51583 existing records. [2025-10-13T18:27:01.516208] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:01.516448] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-13T18:27:01.516497] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-13T18:27:01.517152] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-13T18:27:01.517212] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-13T18:27:01.952174] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:02.017974] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-13T18:27:02.116850] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:27:02.623438] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T18:27:02.817995] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-13T18:27:03.618013] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-13T18:27:03.736047] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T18:27:03.756554] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T18:27:04.417977] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-13T18:27:05.217995] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-13T18:27:05.413738] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:27:05.454964] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T18:27:06.017990] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-13T18:27:06.730743] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T18:27:06.817964] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-13T18:27:07.617913] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-13T18:27:07.781825] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T18:27:08.417918] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-13T18:27:08.659857] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T18:27:08.719862] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T18:27:09.217983] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-13T18:27:10.018040] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-13T18:27:10.242981] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T18:27:10.658730] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T18:27:10.694855] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T18:27:10.817888] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-13T18:27:11.617992] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-13T18:27:12.417982] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-13T18:27:12.613807] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T18:27:13.113499] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T18:27:13.217927] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-13T18:27:13.358273] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T18:27:13.363553] [INFO ] [REMOTE ] DKS: Full fetch complete (71648 records). [2025-10-13T18:27:13.363728] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-13T18:27:13.754420] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-13T18:27:13.754503] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-13T18:27:13.755335] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-13T18:27:13.755398] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-13T18:27:13.756817] [DEBUG] [LOCAL ] DKS: Trimmed 71648 records to 49726 (keeping 200 days of data) [2025-10-13T18:27:14.037778] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-13T18:27:14.073552] [DEBUG] [LOCAL ] DKS: Primary data saved (49726 records). [2025-10-13T18:27:14.073717] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-13T18:27:14.073820] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DKS took 32.7s. Estimated remaining: 4h 1m 26s. Rate: 7.2 symbols/min [2025-10-13T18:27:14.243012] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:14.243288] [DEBUG] [LOCAL ] DLX: No existing data file found in primary storage. [2025-10-13T18:27:14.243333] [WARN ] [MAIN ] DLX: No existing data found, performing full refresh instead. [2025-10-13T18:27:14.243438] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-13T18:27:14.243478] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-13T18:27:14.243518] [DEBUG] [LOCAL ] DLX: No primary data file found to delete. [2025-10-13T18:27:14.243550] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-13T18:27:14.351933] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T18:27:14.601806] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:14.817909] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-13T18:27:15.289240] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T18:27:15.617924] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-13T18:27:16.050887] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T18:27:16.417915] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-13T18:27:17.217982] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-13T18:27:17.539117] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T18:27:17.907529] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T18:27:18.017911] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-13T18:27:18.283074] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T18:27:18.818001] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-13T18:27:19.097446] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T18:27:19.273928] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-13T18:27:19.617955] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-13T18:27:20.417978] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-13T18:27:20.993162] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T18:27:21.217918] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-13T18:27:22.017974] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-13T18:27:22.081819] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T18:27:22.585165] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T18:27:22.683555] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T18:27:22.817960] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-13T18:27:23.398115] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T18:27:23.617997] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-13T18:27:24.417988] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-13T18:27:25.128978] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T18:27:25.217974] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-13T18:27:25.966999] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T18:27:25.972229] [INFO ] [REMOTE ] DLB: Full fetch complete (47042 records). [2025-10-13T18:27:25.972361] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-13T18:27:26.023185] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-13T18:27:26.365914] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-13T18:27:26.366015] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-13T18:27:26.366835] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-13T18:27:26.366908] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-13T18:27:26.368209] [DEBUG] [LOCAL ] DLB: Trimmed 47042 records to 32122 (keeping 200 days of data) [2025-10-13T18:27:26.572052] [DEBUG] [LOCAL ] DLB: Primary data saved (32122 records). [2025-10-13T18:27:26.572193] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-13T18:27:26.572269] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLB took 32.7s. Estimated remaining: 4h 1m 29s. Rate: 7.2 symbols/min [2025-10-13T18:27:26.752420] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:26.774731] [DEBUG] [LOCAL ] DLY: Loaded 20638 existing records from primary storage. [2025-10-13T18:27:26.775057] [INFO ] [MAIN ] DLY: Loaded 20638 existing records. [2025-10-13T18:27:26.823095] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-13T18:27:26.978195] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:26.979386] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-13T18:27:26.979537] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-13T18:27:26.979966] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-13T18:27:26.980110] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-13T18:27:27.431551] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:27.447296] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-13T18:27:27.467908] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T18:27:27.617969] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-13T18:27:27.624920] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T18:27:28.417994] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-13T18:27:28.804919] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T18:27:29.217974] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-13T18:27:30.018015] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-13T18:27:30.150354] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T18:27:30.208192] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:27:30.539964] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T18:27:30.817995] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-13T18:27:31.527902] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T18:27:31.530023] [INFO ] [REMOTE ] DLNG: Full fetch complete (11854 records). [2025-10-13T18:27:31.530185] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-13T18:27:31.623412] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-13T18:27:32.089363] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-13T18:27:32.089448] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-13T18:27:32.089736] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-13T18:27:32.089797] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-13T18:27:32.090364] [DEBUG] [LOCAL ] DLNG: Trimmed 11854 records to 6171 (keeping 200 days of data) [2025-10-13T18:27:32.129252] [DEBUG] [LOCAL ] DLNG: Primary data saved (6171 records). [2025-10-13T18:27:32.129598] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-13T18:27:32.129708] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLNG took 35.6s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-13T18:27:32.302232] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:32.308396] [DEBUG] [LOCAL ] DMA: Loaded 4760 existing records from primary storage. [2025-10-13T18:27:32.308544] [INFO ] [MAIN ] DMA: Loaded 4760 existing records. [2025-10-13T18:27:32.423053] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-13T18:27:32.498146] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:32.498482] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-13T18:27:32.498556] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-13T18:27:32.498871] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-13T18:27:32.498933] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-13T18:27:32.868722] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:33.218029] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-13T18:27:33.472442] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T18:27:33.497743] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T18:27:34.018013] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-13T18:27:34.240795] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T18:27:34.691871] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T18:27:34.817977] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-13T18:27:35.617948] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-13T18:27:35.814130] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T18:27:36.417956] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-13T18:27:37.217896] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-13T18:27:37.290136] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T18:27:37.295220] [INFO ] [REMOTE ] DLR: Full fetch complete (73970 records). [2025-10-13T18:27:37.295400] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-13T18:27:37.689671] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-13T18:27:37.689836] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-13T18:27:37.690833] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-13T18:27:37.690944] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-13T18:27:37.704896] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T18:27:37.710166] [DEBUG] [LOCAL ] DLR: Trimmed 73970 records to 50768 (keeping 200 days of data) [2025-10-13T18:27:38.020121] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-13T18:27:38.037428] [DEBUG] [LOCAL ] DLR: Primary data saved (50768 records). [2025-10-13T18:27:38.037556] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-13T18:27:38.038243] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DLR took 37.0s. Estimated remaining: 4h 0m 58s. Rate: 7.2 symbols/min [2025-10-13T18:27:38.232267] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:38.244726] [DEBUG] [LOCAL ] DMB: Loaded 10356 existing records from primary storage. [2025-10-13T18:27:38.244961] [INFO ] [MAIN ] DMB: Loaded 10356 existing records. [2025-10-13T18:27:38.424611] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:38.424851] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-13T18:27:38.424920] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-13T18:27:38.425261] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-13T18:27:38.425366] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-13T18:27:38.585526] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T18:27:38.819020] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-13T18:27:38.900138] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:38.941067] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-13T18:27:39.360785] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-13T18:27:39.617967] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-13T18:27:40.417911] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-13T18:27:40.549337] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:27:41.217912] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-13T18:27:41.390131] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:27:41.868672] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-13T18:27:42.017950] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-13T18:27:42.817981] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-13T18:27:43.055481] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T18:27:43.443687] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T18:27:43.617919] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-13T18:27:44.197487] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T18:27:44.417953] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-13T18:27:45.221107] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-13T18:27:45.530938] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T18:27:46.017923] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-13T18:27:46.502027] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T18:27:46.817926] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-13T18:27:47.049088] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T18:27:47.617908] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-13T18:27:48.124806] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T18:27:48.417922] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-13T18:27:48.933259] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T18:27:49.217999] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-13T18:27:49.408339] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T18:27:49.702196] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T18:27:50.017970] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-13T18:27:50.817916] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-13T18:27:50.953519] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-13T18:27:51.617995] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-13T18:27:51.723200] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T18:27:51.726012] [INFO ] [REMOTE ] DLX: Full fetch complete (41196 records). [2025-10-13T18:27:51.726097] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-13T18:27:52.126836] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-13T18:27:52.127183] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-13T18:27:52.128467] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-13T18:27:52.128578] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-13T18:27:52.130349] [DEBUG] [LOCAL ] DLX: Trimmed 41196 records to 28464 (keeping 200 days of data) [2025-10-13T18:27:52.233041] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T18:27:52.327236] [DEBUG] [LOCAL ] DLX: Primary data saved (28464 records). [2025-10-13T18:27:52.327446] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-13T18:27:52.327541] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DLX took 38.3s. Estimated remaining: 4h 1m 6s. Rate: 7.2 symbols/min [2025-10-13T18:27:52.423234] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-13T18:27:52.507374] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:52.519844] [DEBUG] [LOCAL ] DMO: Loaded 10068 existing records from primary storage. [2025-10-13T18:27:52.520130] [INFO ] [MAIN ] DMO: Loaded 10068 existing records. [2025-10-13T18:27:52.702212] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:52.702496] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-13T18:27:52.702548] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-13T18:27:52.702837] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-13T18:27:52.702896] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-13T18:27:53.075944] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:53.217971] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-13T18:27:53.705849] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T18:27:53.711084] [INFO ] [REMOTE ] DLY: Full fetch complete (28280 records). [2025-10-13T18:27:53.711215] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-13T18:27:53.835198] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-13T18:27:54.023100] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-13T18:27:54.127515] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-13T18:27:54.127610] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-13T18:27:54.128411] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-13T18:27:54.128476] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-13T18:27:54.130190] [DEBUG] [LOCAL ] DLY: Trimmed 28280 records to 20376 (keeping 200 days of data) [2025-10-13T18:27:54.255578] [DEBUG] [LOCAL ] DLY: Primary data saved (20376 records). [2025-10-13T18:27:54.255738] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-13T18:27:54.255828] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DLY took 27.7s. Estimated remaining: 4h 0m 41s. Rate: 7.2 symbols/min [2025-10-13T18:27:54.428905] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:27:54.475621] [DEBUG] [LOCAL ] DNA: Loaded 49242 existing records from primary storage. [2025-10-13T18:27:54.475946] [INFO ] [MAIN ] DNA: Loaded 49242 existing records. [2025-10-13T18:27:54.653291] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:27:54.653507] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-13T18:27:54.653557] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-13T18:27:54.654058] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-13T18:27:54.654117] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-13T18:27:54.828535] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-13T18:27:54.960091] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T18:27:55.026199] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:27:55.523157] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T18:27:55.617952] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-13T18:27:56.417981] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-13T18:27:57.202576] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T18:27:57.217889] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-13T18:27:57.421679] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T18:27:57.684103] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T18:27:58.017925] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-13T18:27:58.764438] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T18:27:58.817878] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-13T18:27:59.617953] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-13T18:27:59.629012] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T18:28:00.251412] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-13T18:28:00.418006] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-13T18:28:01.217978] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-13T18:28:01.680593] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-13T18:28:02.017914] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-13T18:28:02.279443] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T18:28:02.817959] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-13T18:28:02.828474] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T18:28:03.333458] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T18:28:03.618005] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-13T18:28:04.383387] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T18:28:04.417889] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-13T18:28:05.217910] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-13T18:28:05.287012] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T18:28:06.018019] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-13T18:28:06.823041] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-13T18:28:06.829258] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T18:28:07.180400] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-13T18:28:07.596156] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T18:28:07.597613] [INFO ] [REMOTE ] DMB: Full fetch complete (14762 records). [2025-10-13T18:28:07.597713] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-13T18:28:07.623047] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-13T18:28:07.988923] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-13T18:28:07.989006] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-13T18:28:07.989328] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-13T18:28:07.989367] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-13T18:28:07.989872] [DEBUG] [LOCAL ] DMB: Trimmed 14762 records to 10219 (keeping 200 days of data) [2025-10-13T18:28:08.050769] [DEBUG] [LOCAL ] DMB: Primary data saved (10219 records). [2025-10-13T18:28:08.050904] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-13T18:28:08.050982] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMB took 30.0s. Estimated remaining: 4h 0m 47s. Rate: 7.2 symbols/min [2025-10-13T18:28:08.229173] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:08.274148] [DEBUG] [LOCAL ] DNOW: Loaded 44295 existing records from primary storage. [2025-10-13T18:28:08.274478] [INFO ] [MAIN ] DNOW: Loaded 44295 existing records. [2025-10-13T18:28:08.396167] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T18:28:08.423093] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-13T18:28:08.482599] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:28:08.483041] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-13T18:28:08.483139] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-13T18:28:08.483875] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-13T18:28:08.483932] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-13T18:28:08.842261] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:09.217917] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-13T18:28:09.243753] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T18:28:10.017968] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-13T18:28:10.641531] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T18:28:10.817956] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-13T18:28:11.066522] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T18:28:11.617923] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-13T18:28:11.647529] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T18:28:12.214901] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T18:28:12.417975] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-13T18:28:13.217968] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-13T18:28:13.992704] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T18:28:14.017904] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-13T18:28:14.065322] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T18:28:14.777859] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T18:28:14.817959] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-13T18:28:15.617962] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-13T18:28:16.372450] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T18:28:16.417908] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-13T18:28:16.577723] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T18:28:16.578874] [INFO ] [REMOTE ] DMA: Full fetch complete (6769 records). [2025-10-13T18:28:16.578942] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-13T18:28:16.949985] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-13T18:28:16.950081] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-13T18:28:16.950338] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-13T18:28:16.950380] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-13T18:28:16.950849] [DEBUG] [LOCAL ] DMA: Trimmed 6769 records to 4704 (keeping 200 days of data) [2025-10-13T18:28:16.981528] [DEBUG] [LOCAL ] DMA: Primary data saved (4704 records). [2025-10-13T18:28:16.981754] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-13T18:28:16.981869] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DMA took 44.9s. Estimated remaining: 4h 0m 41s. Rate: 7.2 symbols/min [2025-10-13T18:28:17.154325] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:17.185570] [DEBUG] [LOCAL ] DNP: Loaded 33717 existing records from primary storage. [2025-10-13T18:28:17.185896] [INFO ] [MAIN ] DNP: Loaded 33717 existing records. [2025-10-13T18:28:17.228201] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-13T18:28:17.365559] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:28:17.365822] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-13T18:28:17.365870] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-13T18:28:17.366124] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-13T18:28:17.366182] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-13T18:28:17.722916] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:18.017903] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-13T18:28:18.159938] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T18:28:18.230892] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T18:28:18.232409] [INFO ] [REMOTE ] DMO: Full fetch complete (14532 records). [2025-10-13T18:28:18.232478] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-13T18:28:18.608158] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-13T18:28:18.608240] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-13T18:28:18.608611] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-13T18:28:18.608698] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-13T18:28:18.609203] [DEBUG] [LOCAL ] DMO: Trimmed 14532 records to 9990 (keeping 200 days of data) [2025-10-13T18:28:18.669281] [DEBUG] [LOCAL ] DMO: Primary data saved (9990 records). [2025-10-13T18:28:18.669405] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-13T18:28:18.669484] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DMO took 26.3s. Estimated remaining: 4h 0m 14s. Rate: 7.2 symbols/min [2025-10-13T18:28:18.817927] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-13T18:28:19.466131] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T18:28:19.618029] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-13T18:28:20.210953] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T18:28:20.418011] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-13T18:28:21.148741] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T18:28:21.217956] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-13T18:28:22.018075] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-13T18:28:22.241789] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T18:28:22.551110] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T18:28:22.817922] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-13T18:28:23.396470] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T18:28:23.617957] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-13T18:28:24.312751] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T18:28:24.418076] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-13T18:28:25.217959] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-13T18:28:25.701146] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:28:25.817838] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-13T18:28:26.017957] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-13T18:28:26.632771] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T18:28:26.817900] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-13T18:28:27.421440] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T18:28:27.617915] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-13T18:28:28.007673] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T18:28:28.417979] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-13T18:28:29.146952] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:28:29.217925] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-13T18:28:30.017904] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-13T18:28:30.287521] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T18:28:30.724739] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T18:28:30.818027] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-13T18:28:31.448460] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:28:31.618049] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-13T18:28:32.417967] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-13T18:28:32.571930] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T18:28:33.150242] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:28:33.217967] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-13T18:28:33.550153] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T18:28:34.017969] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-13T18:28:34.817976] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-13T18:28:35.222079] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-13T18:28:35.228245] [INFO ] [REMOTE ] DNA: Full fetch complete (71056 records). [2025-10-13T18:28:35.228425] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-13T18:28:35.594573] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T18:28:35.632630] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-13T18:28:35.713038] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-13T18:28:35.713156] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-13T18:28:35.714230] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-13T18:28:35.714300] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-13T18:28:35.715882] [DEBUG] [LOCAL ] DNA: Trimmed 71056 records to 48522 (keeping 200 days of data) [2025-10-13T18:28:35.998744] [DEBUG] [LOCAL ] DNA: Primary data saved (48522 records). [2025-10-13T18:28:35.998876] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-13T18:28:35.999025] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNA took 41.7s. Estimated remaining: 4h 0m 30s. Rate: 7.2 symbols/min [2025-10-13T18:28:36.215708] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T18:28:36.417984] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-13T18:28:36.792543] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T18:28:37.217958] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-13T18:28:37.665490] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T18:28:37.670109] [INFO ] [REMOTE ] DNOW: Full fetch complete (62878 records). [2025-10-13T18:28:37.670214] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-13T18:28:38.104553] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-13T18:28:38.104677] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-13T18:28:38.105594] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-13T18:28:38.105741] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-13T18:28:38.107368] [DEBUG] [LOCAL ] DNOW: Trimmed 62878 records to 43595 (keeping 200 days of data) [2025-10-13T18:28:38.391829] [DEBUG] [LOCAL ] DNOW: Primary data saved (43595 records). [2025-10-13T18:28:38.392069] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-13T18:28:38.392943] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNOW took 30.3s. Estimated remaining: 4h 0m 6s. Rate: 7.2 symbols/min [2025-10-13T18:28:38.429507] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-13T18:28:38.437098] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-13T18:28:39.667982] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T18:28:39.671766] [INFO ] [REMOTE ] DNP: Full fetch complete (48573 records). [2025-10-13T18:28:39.671940] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-13T18:28:39.672628] [FATAL] [VALIDATOR ] DNP: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:28:39.672856] [FATAL] [MAIN ] DNP: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:28:39.672900] [WARN ] [MAIN ] DNP: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:28:39.672941] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-13T18:28:39.673078] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-10-13T18:28:39.673130] [INFO ] [LOCAL ] DNP: Starting deletion of derivative data. [2025-10-13T18:28:39.673372] [DEBUG] [LOCAL ] DNP: Deleted derivative data file. [2025-10-13T18:28:39.673514] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DNP took 22.7s. Estimated remaining: 3h 59m 39s. Rate: 7.2 symbols/min [2025-10-13T18:28:40.264292] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:40.374910] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:40.463209] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:40.465572] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:28:40.468102] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-10-13T18:28:40.468302] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-10-13T18:28:40.470247] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-13T18:28:40.470331] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-13T18:28:40.470389] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-13T18:28:40.470434] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-13T18:28:40.754615] [DEBUG] [LOCAL ] DOC: Loaded 54327 existing records from primary storage. [2025-10-13T18:28:40.805858] [INFO ] [MAIN ] DOC: Loaded 54327 existing records. [2025-10-13T18:28:40.915294] [DEBUG] [LOCAL ] DOLE: Loaded 39510 existing records from primary storage. [2025-10-13T18:28:40.953829] [DEBUG] [LOCAL ] DOCN: Loaded 51555 existing records from primary storage. [2025-10-13T18:28:40.954066] [INFO ] [MAIN ] DOLE: Loaded 39510 existing records. [2025-10-13T18:28:41.011145] [INFO ] [MAIN ] DOCN: Loaded 51555 existing records. [2025-10-13T18:28:41.102142] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:41.162532] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-13T18:28:41.365440] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:28:41.400337] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-13T18:28:41.435597] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-13T18:28:41.456022] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:28:41.456819] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-13T18:28:41.462305] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-13T18:28:41.483174] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-13T18:28:41.503774] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-13T18:28:41.554931] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:28:41.513140] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-13T18:28:41.555198] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-13T18:28:41.622390] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-13T18:28:41.654908] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-13T18:28:41.683338] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-13T18:28:41.701207] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-13T18:28:42.594970] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:42.645804] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-13T18:28:42.640252] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:42.677111] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-13T18:28:42.708200] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:28:42.708764] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-13T18:28:42.908763] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T18:28:42.919182] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-13T18:28:44.127178] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T18:28:44.136911] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-13T18:28:44.138269] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:28:44.146610] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-13T18:28:44.509052] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T18:28:44.519841] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-13T18:28:44.554919] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-13T18:28:45.217908] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-13T18:28:45.546410] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T18:28:45.712998] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T18:28:45.987077] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T18:28:46.017883] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-13T18:28:46.817997] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-13T18:28:46.894241] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T18:28:47.617907] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-13T18:28:47.843777] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T18:28:48.417912] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-13T18:28:48.533347] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T18:28:49.033234] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T18:28:49.217900] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-13T18:28:49.701014] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:28:50.017911] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-13T18:28:50.817909] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-13T18:28:50.993274] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T18:28:51.209591] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T18:28:51.617927] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-13T18:28:52.417906] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-13T18:28:52.678225] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T18:28:53.071628] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T18:28:53.217976] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-13T18:28:54.017954] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-13T18:28:54.436981] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-13T18:28:54.817448] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T18:28:54.825889] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-13T18:28:55.617897] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-13T18:28:55.746725] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T18:28:56.053795] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T18:28:56.417921] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-13T18:28:57.217893] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-13T18:28:57.529969] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T18:28:57.588736] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T18:28:58.018008] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-13T18:28:58.817903] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-13T18:28:58.983002] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T18:28:59.617899] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-13T18:28:59.663968] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:29:00.316113] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T18:29:00.417893] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-13T18:29:01.218008] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-13T18:29:01.371056] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T18:29:01.926110] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T18:29:02.017924] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-13T18:29:02.471801] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T18:29:02.817987] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-13T18:29:03.617905] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-13T18:29:03.920780] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T18:29:04.366587] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:29:04.417883] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-13T18:29:04.673899] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T18:29:05.217955] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-13T18:29:05.963172] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:29:06.017909] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-13T18:29:06.627254] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:29:06.817962] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-13T18:29:07.617966] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-13T18:29:07.870477] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T18:29:07.875553] [INFO ] [REMOTE ] DOCS: Full fetch complete (74037 records). [2025-10-13T18:29:07.875697] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-13T18:29:08.277593] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-13T18:29:08.277723] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-13T18:29:08.278633] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-13T18:29:08.278716] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-13T18:29:08.280444] [DEBUG] [LOCAL ] DOCS: Trimmed 74037 records to 50877 (keeping 200 days of data) [2025-10-13T18:29:08.450467] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-13T18:29:08.585686] [DEBUG] [LOCAL ] DOCS: Primary data saved (50877 records). [2025-10-13T18:29:08.585836] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-13T18:29:08.585923] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOCS took 28.9s. Estimated remaining: 4h 0m 26s. Rate: 7.2 symbols/min [2025-10-13T18:29:08.765326] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:08.803042] [DEBUG] [LOCAL ] DOUG: Loaded 34887 existing records from primary storage. [2025-10-13T18:29:08.803337] [INFO ] [MAIN ] DOUG: Loaded 34887 existing records. [2025-10-13T18:29:09.019345] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-13T18:29:09.029158] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:29:09.029424] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-13T18:29:09.029473] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-13T18:29:09.036491] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-13T18:29:09.037336] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-13T18:29:09.195503] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T18:29:09.223229] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-13T18:29:09.437048] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:10.017899] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-13T18:29:10.540127] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-13T18:29:10.817905] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-13T18:29:10.987044] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T18:29:10.992443] [INFO ] [REMOTE ] DOC: Full fetch complete (77386 records). [2025-10-13T18:29:10.992581] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-13T18:29:11.390917] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-13T18:29:11.391100] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-13T18:29:11.392265] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-13T18:29:11.392367] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-13T18:29:11.394032] [DEBUG] [LOCAL ] DOC: Trimmed 77386 records to 53550 (keeping 200 days of data) [2025-10-13T18:29:11.524630] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T18:29:11.620418] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-13T18:29:11.767331] [DEBUG] [LOCAL ] DOC: Primary data saved (53550 records). [2025-10-13T18:29:11.767494] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-13T18:29:11.767585] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOC took 32.1s. Estimated remaining: 4h 0m 4s. Rate: 7.2 symbols/min [2025-10-13T18:29:11.934131] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:11.981212] [DEBUG] [LOCAL ] DOV: Loaded 46220 existing records from primary storage. [2025-10-13T18:29:11.981590] [INFO ] [MAIN ] DOV: Loaded 46220 existing records. [2025-10-13T18:29:12.157110] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:29:12.157328] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-13T18:29:12.157384] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-13T18:29:12.157873] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-13T18:29:12.157941] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-13T18:29:12.424604] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-13T18:29:12.512720] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:12.723030] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T18:29:13.218004] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-13T18:29:13.299733] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T18:29:13.664736] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T18:29:13.669969] [INFO ] [REMOTE ] DOLE: Full fetch complete (54510 records). [2025-10-13T18:29:13.670090] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-13T18:29:14.031223] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-13T18:29:14.050150] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-13T18:29:14.050235] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-13T18:29:14.050941] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-13T18:29:14.051004] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-13T18:29:14.052288] [DEBUG] [LOCAL ] DOLE: Trimmed 54510 records to 39143 (keeping 200 days of data) [2025-10-13T18:29:14.291625] [DEBUG] [LOCAL ] DOLE: Primary data saved (39143 records). [2025-10-13T18:29:14.291849] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-13T18:29:14.291980] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOLE took 34.5s. Estimated remaining: 3h 59m 40s. Rate: 7.2 symbols/min [2025-10-13T18:29:14.468111] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:14.520891] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-10-13T18:29:14.521238] [INFO ] [MAIN ] DOW: Loaded 54513 existing records. [2025-10-13T18:29:14.702929] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:29:14.703148] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-13T18:29:14.703195] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-13T18:29:14.703794] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-13T18:29:14.703852] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-13T18:29:14.822119] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-13T18:29:15.069678] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:15.106879] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T18:29:15.617993] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-13T18:29:15.813288] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T18:29:16.313336] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T18:29:16.418004] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-13T18:29:17.218069] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-13T18:29:17.679066] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-13T18:29:17.832507] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:29:18.017999] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-13T18:29:18.145366] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T18:29:18.818036] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-13T18:29:19.623016] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-13T18:29:19.637107] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T18:29:20.224056] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T18:29:20.417982] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-13T18:29:21.217923] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-13T18:29:21.413632] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:29:21.418925] [INFO ] [REMOTE ] DOCN: Full fetch complete (72222 records). [2025-10-13T18:29:21.419036] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-13T18:29:21.830066] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-13T18:29:21.830154] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-13T18:29:21.830972] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-13T18:29:21.831035] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-13T18:29:21.832421] [DEBUG] [LOCAL ] DOCN: Trimmed 72222 records to 50954 (keeping 200 days of data) [2025-10-13T18:29:22.034413] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-13T18:29:22.155525] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T18:29:22.181128] [DEBUG] [LOCAL ] DOCN: Primary data saved (50954 records). [2025-10-13T18:29:22.181328] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-13T18:29:22.181469] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCN took 42.5s. Estimated remaining: 3h 59m 30s. Rate: 7.2 symbols/min [2025-10-13T18:29:22.380037] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:22.396863] [DEBUG] [LOCAL ] DPG: Loaded 13769 existing records from primary storage. [2025-10-13T18:29:22.397222] [INFO ] [MAIN ] DPG: Loaded 13769 existing records. [2025-10-13T18:29:22.599972] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:29:22.600446] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-13T18:29:22.600682] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-13T18:29:22.601168] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-13T18:29:22.601258] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-13T18:29:22.744304] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T18:29:22.821703] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-13T18:29:23.048338] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:23.467452] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T18:29:23.618008] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-13T18:29:24.417974] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-13T18:29:24.612989] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T18:29:24.658154] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T18:29:25.218010] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-13T18:29:25.856901] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:29:26.017965] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-13T18:29:26.817914] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-13T18:29:26.830660] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T18:29:27.014989] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T18:29:27.617909] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-13T18:29:27.825283] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T18:29:28.417982] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-13T18:29:29.093408] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-13T18:29:29.218005] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-13T18:29:29.464546] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T18:29:30.017950] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-13T18:29:30.332885] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T18:29:30.817900] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-13T18:29:30.892951] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-13T18:29:31.617974] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-13T18:29:31.993583] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T18:29:32.417962] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-13T18:29:33.218370] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-13T18:29:33.691455] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T18:29:33.925457] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-13T18:29:34.017919] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-13T18:29:34.081313] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-13T18:29:34.817919] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-13T18:29:35.617926] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-13T18:29:36.046497] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T18:29:36.098095] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T18:29:36.101448] [INFO ] [REMOTE ] DOUG: Full fetch complete (50623 records). [2025-10-13T18:29:36.101537] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-13T18:29:36.430074] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-13T18:29:36.487029] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-13T18:29:36.487155] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-13T18:29:36.487861] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-13T18:29:36.487927] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-13T18:29:36.489408] [DEBUG] [LOCAL ] DOUG: Trimmed 50623 records to 34290 (keeping 200 days of data) [2025-10-13T18:29:36.684512] [DEBUG] [LOCAL ] DOUG: Primary data saved (34290 records). [2025-10-13T18:29:36.684668] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-13T18:29:36.685470] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DOUG took 28.1s. Estimated remaining: 3h 59m 39s. Rate: 7.2 symbols/min [2025-10-13T18:29:36.861744] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:36.861893] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-10-13T18:29:36.861932] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-10-13T18:29:36.862128] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-13T18:29:36.862182] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-13T18:29:36.862242] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-13T18:29:36.862307] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-13T18:29:37.228002] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:37.223503] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-13T18:29:37.267123] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:29:37.554565] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T18:29:38.017944] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-13T18:29:38.817976] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-13T18:29:39.108893] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T18:29:39.391919] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-13T18:29:39.617887] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-13T18:29:39.715152] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:29:40.417925] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-13T18:29:41.063083] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T18:29:41.217900] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-13T18:29:41.886118] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T18:29:42.017920] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-13T18:29:42.659619] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T18:29:42.817924] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-13T18:29:43.540901] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T18:29:43.617912] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-13T18:29:43.806386] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-13T18:29:44.417951] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-13T18:29:44.914457] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-13T18:29:45.217927] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-13T18:29:46.017980] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-13T18:29:46.081747] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:29:46.443540] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T18:29:46.817899] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-13T18:29:46.967965] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T18:29:47.618017] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-13T18:29:47.978044] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T18:29:48.418021] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-13T18:29:48.896224] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T18:29:49.217961] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-13T18:29:49.465483] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T18:29:50.017966] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-13T18:29:50.707719] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T18:29:50.817922] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-13T18:29:51.617973] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-13T18:29:52.421786] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-13T18:29:52.443267] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-13T18:29:52.582339] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T18:29:53.048894] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T18:29:53.051424] [INFO ] [REMOTE ] DPG: Full fetch complete (18965 records). [2025-10-13T18:29:53.051601] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-13T18:29:53.229163] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-13T18:29:53.314749] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:29:53.363896] [INFO ] [REMOTE ] DOV: Full fetch complete (65377 records). [2025-10-13T18:29:53.371060] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-13T18:29:53.665414] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-13T18:29:53.684765] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-13T18:29:53.687177] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-13T18:29:53.687270] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-13T18:29:53.756441] [DEBUG] [LOCAL ] DPG: Trimmed 18965 records to 13590 (keeping 200 days of data) [2025-10-13T18:29:53.986754] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-13T18:29:53.989486] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-13T18:29:53.990822] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-13T18:29:53.991200] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-13T18:29:54.012702] [DEBUG] [LOCAL ] DOV: Trimmed 65377 records to 45577 (keeping 200 days of data) [2025-10-13T18:29:54.014857] [DEBUG] [LOCAL ] DPG: Primary data saved (13590 records). [2025-10-13T18:29:54.015512] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-13T18:29:54.015918] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DPG took 31.8s. Estimated remaining: 3h 59m 54s. Rate: 7.2 symbols/min [2025-10-13T18:29:54.090985] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-13T18:29:54.306203] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:54.469938] [DEBUG] [LOCAL ] DRD: Loaded 37897 existing records from primary storage. [2025-10-13T18:29:54.472933] [INFO ] [MAIN ] DRD: Loaded 37897 existing records. [2025-10-13T18:29:54.689584] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:29:54.693824] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-13T18:29:54.694572] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-13T18:29:54.696839] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-13T18:29:54.697607] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-13T18:29:54.706436] [DEBUG] [LOCAL ] DOV: Primary data saved (45577 records). [2025-10-13T18:29:54.738086] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-13T18:29:54.774861] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DOV took 43.0s. Estimated remaining: 3h 59m 26s. Rate: 7.2 symbols/min [2025-10-13T18:29:55.185871] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:29:55.240413] [DEBUG] [LOCAL ] DRH: No existing data file found in primary storage. [2025-10-13T18:29:55.272340] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:55.272425] [WARN ] [MAIN ] DRH: No existing data found, performing full refresh instead. [2025-10-13T18:29:55.273172] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-13T18:29:55.274431] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-13T18:29:55.274609] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-13T18:29:55.274812] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-13T18:29:55.274887] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-13T18:29:55.354579] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-13T18:29:55.623090] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-13T18:29:55.683186] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:29:56.364402] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-13T18:29:56.417892] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-13T18:29:56.665133] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T18:29:57.217894] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-13T18:29:57.479331] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T18:29:58.017968] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-13T18:29:58.374630] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T18:29:58.498060] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-13T18:29:58.817963] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-13T18:29:59.617992] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-13T18:29:59.804773] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:29:59.809838] [INFO ] [REMOTE ] DQ: Full fetch complete (63430 records). [2025-10-13T18:29:59.809976] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-13T18:30:00.199192] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-13T18:30:00.199277] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-13T18:30:00.200068] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-13T18:30:00.200133] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-13T18:30:00.201408] [DEBUG] [LOCAL ] DQ: Trimmed 63430 records to 43622 (keeping 200 days of data) [2025-10-13T18:30:00.419197] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-13T18:30:00.460111] [DEBUG] [LOCAL ] DQ: Primary data saved (43622 records). [2025-10-13T18:30:00.460225] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-13T18:30:00.460295] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DQ took 23.8s. Estimated remaining: 3h 59m 10s. Rate: 7.2 symbols/min [2025-10-13T18:30:00.629165] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:00.675553] [DEBUG] [LOCAL ] DRI: Loaded 48366 existing records from primary storage. [2025-10-13T18:30:00.675896] [INFO ] [MAIN ] DRI: Loaded 48366 existing records. [2025-10-13T18:30:00.860203] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:00.860513] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-13T18:30:00.860584] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-13T18:30:00.873736] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-13T18:30:00.874350] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-13T18:30:00.874853] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-13T18:30:00.944793] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-10-13T18:30:00.962107] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-13T18:30:01.524472] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-13T18:30:01.589886] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:01.614193] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-13T18:30:01.769269] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-13T18:30:01.769365] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-13T18:30:01.770238] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-13T18:30:01.770314] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-13T18:30:01.772165] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-10-13T18:30:02.019031] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-13T18:30:02.114472] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-13T18:30:02.114668] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-13T18:30:02.115020] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DOW took 47.8s. Estimated remaining: 3h 58m 44s. Rate: 7.2 symbols/min [2025-10-13T18:30:02.289764] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:02.331964] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-13T18:30:02.347839] [DEBUG] [LOCAL ] DRLL: Loaded 9406 existing records from primary storage. [2025-10-13T18:30:02.348155] [INFO ] [MAIN ] DRLL: Loaded 9406 existing records. [2025-10-13T18:30:02.525239] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:02.525544] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-13T18:30:02.525592] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-13T18:30:02.525809] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-13T18:30:02.525865] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-13T18:30:02.823270] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-13T18:30:02.902250] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:03.617972] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-13T18:30:03.665691] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T18:30:03.891368] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T18:30:04.271888] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T18:30:04.418018] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-13T18:30:04.538450] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-13T18:30:05.217921] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-13T18:30:06.017993] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-13T18:30:06.116373] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T18:30:06.295736] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T18:30:06.817951] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-13T18:30:07.352296] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T18:30:07.618210] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-13T18:30:08.419935] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-13T18:30:08.422823] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T18:30:08.470169] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T18:30:09.218129] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-13T18:30:09.926527] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:30:10.017916] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-13T18:30:10.776921] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T18:30:10.818004] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-13T18:30:11.617916] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-13T18:30:11.756011] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T18:30:11.790560] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T18:30:12.417971] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-13T18:30:12.947154] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T18:30:13.217969] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-13T18:30:13.969113] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T18:30:14.018013] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-13T18:30:14.817911] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-13T18:30:15.021245] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T18:30:15.617924] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-13T18:30:15.757189] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T18:30:16.417952] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-13T18:30:17.012668] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T18:30:17.048911] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-13T18:30:17.217966] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-13T18:30:17.246483] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T18:30:18.018042] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-13T18:30:18.532954] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T18:30:18.818023] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-13T18:30:19.532139] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T18:30:19.617952] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-13T18:30:19.768001] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T18:30:20.413162] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T18:30:20.417871] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-13T18:30:21.014639] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T18:30:21.217963] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-13T18:30:22.017956] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-13T18:30:22.817990] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-13T18:30:22.991100] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T18:30:23.441718] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T18:30:23.564282] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T18:30:23.617887] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-13T18:30:24.313065] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-13T18:30:24.417990] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-13T18:30:25.218034] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-13T18:30:25.877243] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T18:30:25.879112] [INFO ] [REMOTE ] DRLL: Full fetch complete (14822 records). [2025-10-13T18:30:25.879210] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-13T18:30:25.880516] [FATAL] [VALIDATOR ] DRLL: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:30:25.880886] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:30:25.880958] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:30:25.881035] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-13T18:30:25.881119] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-13T18:30:25.881159] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-10-13T18:30:25.881638] [DEBUG] [LOCAL ] DRLL: Deleted derivative data file. [2025-10-13T18:30:25.881847] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRLL took 23.8s. Estimated remaining: 3h 59m 17s. Rate: 7.2 symbols/min [2025-10-13T18:30:26.023165] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-13T18:30:26.106154] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:26.153193] [DEBUG] [LOCAL ] DSL: Loaded 29051 existing records from primary storage. [2025-10-13T18:30:26.153956] [INFO ] [MAIN ] DSL: Loaded 29051 existing records. [2025-10-13T18:30:26.432189] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:26.432884] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-13T18:30:26.453137] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-13T18:30:26.468482] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-13T18:30:26.468692] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-13T18:30:26.625191] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-13T18:30:26.827972] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-13T18:30:26.992822] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:27.529035] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T18:30:27.618035] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-13T18:30:28.417916] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-13T18:30:28.670460] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T18:30:29.146793] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:30:29.217890] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-13T18:30:30.017908] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-13T18:30:30.212426] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T18:30:30.817926] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-13T18:30:30.941224] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T18:30:31.571292] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:30:31.617899] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-13T18:30:32.148551] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T18:30:32.417929] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-13T18:30:33.217892] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-13T18:30:33.292229] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T18:30:33.297376] [INFO ] [REMOTE ] DRD: Full fetch complete (50863 records). [2025-10-13T18:30:33.297537] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-13T18:30:33.711859] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-13T18:30:33.712228] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-13T18:30:33.713509] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-13T18:30:33.713610] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-13T18:30:33.714706] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:30:33.725477] [DEBUG] [LOCAL ] DRD: Trimmed 50863 records to 37620 (keeping 200 days of data) [2025-10-13T18:30:33.951613] [DEBUG] [LOCAL ] DRD: Primary data saved (37620 records). [2025-10-13T18:30:33.951772] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-13T18:30:33.951859] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRD took 39.9s. Estimated remaining: 3h 59m 8s. Rate: 7.2 symbols/min [2025-10-13T18:30:34.023620] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-13T18:30:34.076209] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T18:30:34.126500] [INFO ] [REMOTE ] DRI: Full fetch complete (69018 records). [2025-10-13T18:30:34.144745] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-13T18:30:34.144639] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:34.145821] [FATAL] [VALIDATOR ] DRI: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:30:34.146161] [FATAL] [MAIN ] DRI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:30:34.146231] [WARN ] [MAIN ] DRI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:30:34.146301] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-13T18:30:34.146367] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-13T18:30:34.146512] [INFO ] [LOCAL ] DRI: Starting deletion of derivative data. [2025-10-13T18:30:34.146735] [DEBUG] [LOCAL ] DRI: Deleted derivative data file. [2025-10-13T18:30:34.146830] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRI took 33.7s. Estimated remaining: 3h 58m 38s. Rate: 7.2 symbols/min [2025-10-13T18:30:34.326769] [DEBUG] [LOCAL ] DSM: Loaded 14743 existing records from primary storage. [2025-10-13T18:30:34.329727] [INFO ] [MAIN ] DSM: Loaded 14743 existing records. [2025-10-13T18:30:34.329441] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:34.474353] [DEBUG] [LOCAL ] DSMC: Loaded 1870 existing records from primary storage. [2025-10-13T18:30:34.486780] [INFO ] [MAIN ] DSMC: Loaded 1870 existing records. [2025-10-13T18:30:34.557280] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:34.579954] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-13T18:30:34.608220] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-13T18:30:34.619865] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-13T18:30:34.635464] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-13T18:30:34.821007] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-13T18:30:34.826623] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:34.842465] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-13T18:30:34.865495] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-13T18:30:34.892550] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-13T18:30:34.919472] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-13T18:30:35.265860] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:35.462504] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:35.563932] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T18:30:35.568727] [INFO ] [REMOTE ] DRH: Full fetch complete (71535 records). [2025-10-13T18:30:35.568854] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-13T18:30:35.569618] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:30:35.569757] [FATAL] [MAIN ] DRH: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:30:35.569828] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:30:35.569918] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-13T18:30:35.570022] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-13T18:30:35.570100] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-10-13T18:30:35.570189] [DEBUG] [LOCAL ] DRH: No derivative data file found to delete. [2025-10-13T18:30:35.570297] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DRH took 40.8s. Estimated remaining: 3h 58m 11s. Rate: 7.2 symbols/min [2025-10-13T18:30:35.625673] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-13T18:30:35.747473] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:30:35.769394] [DEBUG] [LOCAL ] DSU: Loaded 23217 existing records from primary storage. [2025-10-13T18:30:35.769668] [INFO ] [MAIN ] DSU: Loaded 23217 existing records. [2025-10-13T18:30:35.954512] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:30:35.954878] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-13T18:30:35.954954] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-13T18:30:35.955283] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-13T18:30:35.955344] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-13T18:30:36.249568] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T18:30:36.269340] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-13T18:30:36.343342] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:30:36.417887] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-13T18:30:37.217987] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-13T18:30:37.503674] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T18:30:38.017964] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-13T18:30:38.430795] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-13T18:30:38.817973] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-13T18:30:39.198160] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T18:30:39.218843] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-13T18:30:39.617897] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-13T18:30:39.986323] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-13T18:30:40.417916] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-13T18:30:41.218050] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-13T18:30:41.582339] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T18:30:41.632210] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-13T18:30:42.017925] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-13T18:30:42.798231] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T18:30:42.817880] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-13T18:30:43.617904] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-13T18:30:43.936447] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T18:30:44.417969] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-13T18:30:44.574687] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T18:30:45.217985] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-13T18:30:45.685846] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T18:30:46.018017] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-13T18:30:46.064881] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T18:30:46.728308] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T18:30:46.817921] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-13T18:30:47.617915] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-13T18:30:47.934919] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T18:30:47.967602] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-13T18:30:48.417957] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-13T18:30:48.735973] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-13T18:30:49.217918] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-13T18:30:50.017966] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-13T18:30:50.509998] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T18:30:50.817927] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-13T18:30:51.195834] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T18:30:51.617998] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-13T18:30:51.971615] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T18:30:52.417896] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-13T18:30:52.756341] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T18:30:52.840604] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-13T18:30:53.217930] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-13T18:30:53.654062] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T18:30:54.017951] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-13T18:30:54.394578] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-13T18:30:54.817920] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-13T18:30:55.617919] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-13T18:30:56.058279] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T18:30:56.418000] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-13T18:30:57.095108] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T18:30:57.217922] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-13T18:30:57.440467] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T18:30:58.017896] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-13T18:30:58.123053] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T18:30:58.817960] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-13T18:30:59.041613] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T18:30:59.616669] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T18:30:59.619840] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-13T18:31:00.417982] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-13T18:31:00.768359] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T18:31:00.771756] [INFO ] [REMOTE ] DSL: Full fetch complete (41516 records). [2025-10-13T18:31:00.771834] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-13T18:31:01.147032] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-13T18:31:01.147113] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-13T18:31:01.147754] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-13T18:31:01.147815] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-13T18:31:01.148810] [DEBUG] [LOCAL ] DSL: Trimmed 41516 records to 28681 (keeping 200 days of data) [2025-10-13T18:31:01.235833] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-13T18:31:01.328040] [DEBUG] [LOCAL ] DSL: Primary data saved (28681 records). [2025-10-13T18:31:01.328203] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-13T18:31:01.328309] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSL took 35.4s. Estimated remaining: 3h 58m 49s. Rate: 7.2 symbols/min [2025-10-13T18:31:01.506583] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:01.531110] [DEBUG] [LOCAL ] DSX: Loaded 24407 existing records from primary storage. [2025-10-13T18:31:01.531435] [INFO ] [MAIN ] DSX: Loaded 24407 existing records. [2025-10-13T18:31:01.682021] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T18:31:01.765871] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:31:01.766139] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-13T18:31:01.766188] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-13T18:31:01.766394] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-13T18:31:01.766450] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-13T18:31:02.023281] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-13T18:31:02.094783] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T18:31:02.096578] [INFO ] [REMOTE ] DSMC: Full fetch complete (2839 records). [2025-10-13T18:31:02.102429] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-13T18:31:02.279057] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:02.620844] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-13T18:31:02.620943] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-13T18:31:02.621066] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-13T18:31:02.621106] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-13T18:31:02.621532] [DEBUG] [LOCAL ] DSMC: Trimmed 2839 records to 1838 (keeping 200 days of data) [2025-10-13T18:31:02.633606] [DEBUG] [LOCAL ] DSMC: Primary data saved (1838 records). [2025-10-13T18:31:02.633764] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-13T18:31:02.633863] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSMC took 28.5s. Estimated remaining: 3h 58m 22s. Rate: 7.2 symbols/min [2025-10-13T18:31:02.811964] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:02.817965] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-13T18:31:02.878070] [DEBUG] [LOCAL ] DT: Loaded 53704 existing records from primary storage. [2025-10-13T18:31:02.878485] [INFO ] [MAIN ] DT: Loaded 53704 existing records. [2025-10-13T18:31:03.069518] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:31:03.069857] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-13T18:31:03.069909] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-13T18:31:03.070534] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-13T18:31:03.070595] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-13T18:31:03.303710] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T18:31:03.527052] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:03.617923] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-13T18:31:04.290056] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T18:31:04.417922] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-13T18:31:05.218158] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-13T18:31:05.221772] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T18:31:05.257120] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:31:06.017986] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-13T18:31:06.232287] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-13T18:31:06.817909] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-13T18:31:07.176208] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T18:31:07.617982] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-13T18:31:07.796694] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T18:31:08.418017] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-13T18:31:08.679678] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T18:31:09.218007] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-13T18:31:09.606100] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T18:31:09.609021] [INFO ] [REMOTE ] DSU: Full fetch complete (32920 records). [2025-10-13T18:31:09.609147] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-13T18:31:09.971634] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-13T18:31:09.971744] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-13T18:31:09.972288] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-13T18:31:09.972349] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-13T18:31:09.973116] [DEBUG] [LOCAL ] DSU: Trimmed 32920 records to 22953 (keeping 200 days of data) [2025-10-13T18:31:10.023983] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-13T18:31:10.121897] [DEBUG] [LOCAL ] DSU: Primary data saved (22953 records). [2025-10-13T18:31:10.122062] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-13T18:31:10.122204] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSU took 34.6s. Estimated remaining: 3h 58m 12s. Rate: 7.2 symbols/min [2025-10-13T18:31:10.234394] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T18:31:10.308420] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:10.308591] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-13T18:31:10.308628] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-13T18:31:10.308761] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-13T18:31:10.308801] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-13T18:31:10.308840] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-13T18:31:10.308888] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-13T18:31:10.659292] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:10.817997] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-13T18:31:11.244759] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T18:31:11.608641] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T18:31:11.617869] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-13T18:31:12.182386] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T18:31:12.417970] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-13T18:31:13.217965] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-13T18:31:13.694893] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T18:31:14.017990] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-13T18:31:14.817916] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-13T18:31:14.841394] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T18:31:14.863804] [INFO ] [REMOTE ] DSM: Full fetch complete (23921 records). [2025-10-13T18:31:14.883145] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-13T18:31:14.951408] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T18:31:15.287190] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-13T18:31:15.287295] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-13T18:31:15.288190] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-13T18:31:15.288259] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-13T18:31:15.289079] [DEBUG] [LOCAL ] DSM: Trimmed 23921 records to 14307 (keeping 200 days of data) [2025-10-13T18:31:15.378950] [DEBUG] [LOCAL ] DSM: Primary data saved (14307 records). [2025-10-13T18:31:15.379191] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-13T18:31:15.379324] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSM took 41.4s. Estimated remaining: 3h 57m 55s. Rate: 7.2 symbols/min [2025-10-13T18:31:15.560998] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:15.617128] [DEBUG] [LOCAL ] DTE: Loaded 48226 existing records from primary storage. [2025-10-13T18:31:15.617577] [INFO ] [MAIN ] DTE: Loaded 48226 existing records. [2025-10-13T18:31:15.623253] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-13T18:31:15.804190] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:31:15.804588] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-13T18:31:15.804661] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-13T18:31:15.805427] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-13T18:31:15.805486] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-13T18:31:16.204959] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:16.221965] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T18:31:16.417926] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-13T18:31:17.217905] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-13T18:31:17.643174] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-13T18:31:17.680350] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-13T18:31:18.017913] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-13T18:31:18.120627] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:31:18.800553] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T18:31:18.817911] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-13T18:31:19.618016] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-13T18:31:20.095035] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T18:31:20.162451] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T18:31:20.418003] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-13T18:31:20.989530] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T18:31:21.217962] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-13T18:31:22.017962] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-13T18:31:22.336444] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-13T18:31:22.817984] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-13T18:31:23.617902] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-13T18:31:23.720568] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T18:31:24.046142] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T18:31:24.329898] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:31:24.417923] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-13T18:31:25.217920] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-13T18:31:26.017901] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-13T18:31:26.282592] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T18:31:26.817895] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-13T18:31:26.851416] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T18:31:27.254686] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T18:31:27.474937] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T18:31:27.617913] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-13T18:31:28.417916] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-13T18:31:29.217904] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-13T18:31:29.511207] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T18:31:29.553908] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T18:31:30.018022] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-13T18:31:30.817984] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-13T18:31:31.030044] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T18:31:31.408790] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-13T18:31:31.617914] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-13T18:31:31.728830] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T18:31:32.208758] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T18:31:32.417988] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-13T18:31:33.218006] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-13T18:31:33.952452] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T18:31:34.017880] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-13T18:31:34.817913] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-13T18:31:35.010571] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T18:31:35.447429] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-13T18:31:35.492438] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T18:31:35.617888] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-13T18:31:36.417954] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-13T18:31:37.217897] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-13T18:31:37.314067] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:31:37.711823] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T18:31:37.714575] [INFO ] [REMOTE ] DSX: Full fetch complete (35943 records). [2025-10-13T18:31:37.714670] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-13T18:31:37.890456] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T18:31:37.903708] [INFO ] [REMOTE ] DTB: Full fetch complete (6685 records). [2025-10-13T18:31:37.946902] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-13T18:31:37.973167] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:31:38.004521] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:31:38.004627] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:31:38.004980] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-13T18:31:38.015487] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-13T18:31:38.021762] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-13T18:31:38.022634] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-10-13T18:31:38.049159] [DEBUG] [LOCAL ] DTB: No derivative data file found to delete. [2025-10-13T18:31:38.067846] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTB took 27.9s. Estimated remaining: 3h 58m 24s. Rate: 7.2 symbols/min [2025-10-13T18:31:38.127159] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-13T18:31:38.158606] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-13T18:31:38.159323] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-13T18:31:38.164927] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-13T18:31:38.202961] [DEBUG] [LOCAL ] DSX: Trimmed 35943 records to 24104 (keeping 200 days of data) [2025-10-13T18:31:38.349425] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:38.352147] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-13T18:31:38.352478] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-13T18:31:38.356367] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-13T18:31:38.356726] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-13T18:31:38.359670] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-13T18:31:38.362435] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-13T18:31:38.744522] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:38.758559] [DEBUG] [LOCAL ] DSX: Primary data saved (24104 records). [2025-10-13T18:31:38.758630] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-13T18:31:38.758746] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DSX took 37.4s. Estimated remaining: 3h 57m 56s. Rate: 7.2 symbols/min [2025-10-13T18:31:38.823021] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-13T18:31:38.924687] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:38.932051] [DEBUG] [LOCAL ] DTG: Loaded 5919 existing records from primary storage. [2025-10-13T18:31:38.932200] [INFO ] [MAIN ] DTG: Loaded 5919 existing records. [2025-10-13T18:31:39.103224] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:31:39.103449] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-13T18:31:39.103495] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-13T18:31:39.103699] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-13T18:31:39.103755] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-13T18:31:39.216288] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-13T18:31:39.462041] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:39.617880] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-13T18:31:39.662075] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T18:31:40.417900] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-13T18:31:40.450808] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T18:31:41.217959] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-13T18:31:41.926614] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T18:31:42.017888] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-13T18:31:42.817899] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-13T18:31:43.013584] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:31:43.277399] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T18:31:43.617955] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-13T18:31:43.670980] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T18:31:43.676864] [INFO ] [REMOTE ] DT: Full fetch complete (76662 records). [2025-10-13T18:31:43.677021] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-13T18:31:44.085972] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-13T18:31:44.086052] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-13T18:31:44.086918] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-13T18:31:44.086981] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-13T18:31:44.088732] [DEBUG] [LOCAL ] DT: Trimmed 76662 records to 52943 (keeping 200 days of data) [2025-10-13T18:31:44.197978] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T18:31:44.402396] [DEBUG] [LOCAL ] DT: Primary data saved (52943 records). [2025-10-13T18:31:44.402537] [INFO ] [MAIN ] DT: Full history saved. [2025-10-13T18:31:44.403483] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DT took 41.8s. Estimated remaining: 3h 57m 41s. Rate: 7.2 symbols/min [2025-10-13T18:31:44.423181] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-13T18:31:44.575092] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:44.575241] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-13T18:31:44.575277] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-13T18:31:44.575383] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-13T18:31:44.575423] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-13T18:31:44.575504] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-13T18:31:44.575557] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-13T18:31:44.927742] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:45.217923] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-13T18:31:45.914993] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T18:31:46.017897] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-13T18:31:46.199131] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T18:31:46.658439] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-13T18:31:46.817920] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-13T18:31:47.451131] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-13T18:31:47.617917] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-13T18:31:48.162031] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T18:31:48.417926] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-13T18:31:48.974688] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T18:31:49.217973] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-13T18:31:49.407210] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:31:49.407533] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-13T18:31:49.407621] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:31:49.407715] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-13T18:31:49.407779] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:31:49.407866] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-13T18:31:49.407928] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-13T18:31:49.408027] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-13T18:31:49.408111] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-13T18:31:49.408204] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTK took 5.0s. Estimated remaining: 3h 57m 24s. Rate: 7.2 symbols/min [2025-10-13T18:31:49.573737] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:49.573907] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-10-13T18:31:49.573944] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-10-13T18:31:49.574051] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-13T18:31:49.574090] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-13T18:31:49.574130] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-13T18:31:49.574161] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-13T18:31:49.923623] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:50.017886] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-13T18:31:50.817988] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-13T18:31:51.617901] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-13T18:31:51.724811] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T18:31:52.250161] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T18:31:52.417896] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-13T18:31:52.548119] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T18:31:52.793303] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-13T18:31:53.217963] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-13T18:31:54.017969] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-13T18:31:54.376878] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-13T18:31:54.796560] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T18:31:54.817896] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-13T18:31:55.617923] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-13T18:31:56.147408] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T18:31:56.239776] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T18:31:56.244717] [INFO ] [REMOTE ] DTE: Full fetch complete (68804 records). [2025-10-13T18:31:56.244837] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-13T18:31:56.420349] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-13T18:31:56.661456] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-13T18:31:56.661596] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-13T18:31:56.662593] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-13T18:31:56.662682] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-13T18:31:56.664478] [DEBUG] [LOCAL ] DTE: Trimmed 68804 records to 47508 (keeping 200 days of data) [2025-10-13T18:31:56.964053] [DEBUG] [LOCAL ] DTE: Primary data saved (47508 records). [2025-10-13T18:31:56.964195] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-13T18:31:56.964291] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTE took 41.6s. Estimated remaining: 3h 57m 13s. Rate: 7.2 symbols/min [2025-10-13T18:31:57.129150] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:31:57.135859] [DEBUG] [LOCAL ] DTW: Loaded 4937 existing records from primary storage. [2025-10-13T18:31:57.136056] [INFO ] [MAIN ] DTW: Loaded 4937 existing records. [2025-10-13T18:31:57.225807] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-13T18:31:57.314982] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:31:57.315217] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-13T18:31:57.315264] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-13T18:31:57.315486] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-13T18:31:57.315543] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-13T18:31:57.661567] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:31:57.798158] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:31:58.017955] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-13T18:31:58.195947] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T18:31:58.796018] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-13T18:31:58.817897] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-13T18:31:59.617891] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-13T18:32:00.054787] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T18:32:00.425381] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-13T18:32:00.444049] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T18:32:01.079989] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T18:32:01.217890] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-13T18:32:01.934364] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T18:32:01.935627] [INFO ] [REMOTE ] DTG: Full fetch complete (8780 records). [2025-10-13T18:32:01.935766] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-13T18:32:02.023189] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-13T18:32:02.329549] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-13T18:32:02.329633] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-13T18:32:02.329883] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-13T18:32:02.329928] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-13T18:32:02.330323] [DEBUG] [LOCAL ] DTG: Trimmed 8780 records to 5799 (keeping 200 days of data) [2025-10-13T18:32:02.366604] [DEBUG] [LOCAL ] DTG: Primary data saved (5799 records). [2025-10-13T18:32:02.366755] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-13T18:32:02.366841] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTG took 23.6s. Estimated remaining: 3h 56m 58s. Rate: 7.2 symbols/min [2025-10-13T18:32:02.523169] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-13T18:32:02.558321] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:02.619407] [DEBUG] [LOCAL ] DUK: Loaded 54219 existing records from primary storage. [2025-10-13T18:32:02.619820] [INFO ] [MAIN ] DUK: Loaded 54219 existing records. [2025-10-13T18:32:02.823952] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-13T18:32:02.840325] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:32:02.841246] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-13T18:32:02.841314] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-13T18:32:02.841628] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-13T18:32:02.841720] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-13T18:32:03.200034] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:03.617930] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-13T18:32:04.417925] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-13T18:32:04.509889] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T18:32:04.968682] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T18:32:05.217915] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-13T18:32:05.575962] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T18:32:05.787412] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T18:32:06.017923] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-13T18:32:06.360690] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T18:32:06.817926] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-13T18:32:07.171983] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-13T18:32:07.617965] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-13T18:32:08.121702] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-13T18:32:08.417995] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-13T18:32:09.049258] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T18:32:09.217965] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-13T18:32:09.567385] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-13T18:32:10.017927] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-13T18:32:10.817899] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-13T18:32:11.316134] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-13T18:32:11.316889] [INFO ] [REMOTE ] DTF: Full fetch complete (1842 records). [2025-10-13T18:32:11.316956] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-13T18:32:11.317289] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:32:11.317372] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:32:11.317415] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:32:11.317477] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-13T18:32:11.317539] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-13T18:32:11.317574] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-13T18:32:11.317613] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-13T18:32:11.317691] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTF took 33.2s. Estimated remaining: 3h 56m 51s. Rate: 7.2 symbols/min [2025-10-13T18:32:11.525361] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:11.525575] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-13T18:32:11.525625] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-13T18:32:11.525835] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-13T18:32:11.525930] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-13T18:32:11.526030] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-13T18:32:11.526071] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-13T18:32:11.618833] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-13T18:32:11.700456] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T18:32:12.039249] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:12.295516] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-13T18:32:12.417963] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-13T18:32:13.218057] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-13T18:32:13.954468] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-13T18:32:14.024687] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-13T18:32:14.041168] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T18:32:14.629230] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-13T18:32:14.817990] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-13T18:32:15.617930] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-13T18:32:16.235492] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T18:32:16.417966] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-13T18:32:16.720753] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T18:32:17.009818] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T18:32:17.217958] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-13T18:32:18.017955] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-13T18:32:18.550974] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T18:32:18.817965] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-13T18:32:18.978945] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T18:32:19.524354] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T18:32:19.617994] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-13T18:32:20.274346] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-13T18:32:20.417975] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-13T18:32:21.045321] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T18:32:21.217990] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-13T18:32:22.007203] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T18:32:22.017870] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-13T18:32:22.765031] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T18:32:22.817974] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-13T18:32:23.411825] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T18:32:23.618001] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-13T18:32:24.276603] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T18:32:24.277915] [INFO ] [REMOTE ] DTW: Full fetch complete (7272 records). [2025-10-13T18:32:24.278018] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-13T18:32:24.278504] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:32:24.278659] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:32:24.278718] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:32:24.278789] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-13T18:32:24.278897] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-13T18:32:24.278980] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-13T18:32:24.279381] [DEBUG] [LOCAL ] DTW: Deleted derivative data file. [2025-10-13T18:32:24.279775] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DTW took 27.3s. Estimated remaining: 3h 56m 54s. Rate: 7.2 symbols/min [2025-10-13T18:32:24.423142] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-13T18:32:24.457203] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:24.509146] [DEBUG] [LOCAL ] DV: Loaded 52041 existing records from primary storage. [2025-10-13T18:32:24.509484] [INFO ] [MAIN ] DV: Loaded 52041 existing records. [2025-10-13T18:32:24.685263] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:32:24.685497] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-13T18:32:24.685544] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-13T18:32:24.686033] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-13T18:32:24.686090] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-13T18:32:25.040040] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:25.217921] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-13T18:32:25.948420] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T18:32:26.017924] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-13T18:32:26.197223] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T18:32:26.817925] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-13T18:32:27.335158] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T18:32:27.618020] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-13T18:32:28.048333] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T18:32:28.418001] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-13T18:32:28.965235] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T18:32:29.217928] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-13T18:32:29.269924] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T18:32:30.017922] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-13T18:32:30.648296] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T18:32:30.817928] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-13T18:32:31.497691] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T18:32:31.617898] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-13T18:32:32.179953] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-13T18:32:32.417989] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-13T18:32:32.787078] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-13T18:32:33.136938] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T18:32:33.217889] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-13T18:32:33.886693] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T18:32:33.887740] [INFO ] [REMOTE ] DUKB: Full fetch complete (9312 records). [2025-10-13T18:32:33.887811] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-13T18:32:34.029415] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-13T18:32:34.267065] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-13T18:32:34.267148] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-13T18:32:34.267450] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-13T18:32:34.267490] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-13T18:32:34.267970] [DEBUG] [LOCAL ] DUKB: Trimmed 9312 records to 6319 (keeping 200 days of data) [2025-10-13T18:32:34.310050] [DEBUG] [LOCAL ] DUKB: Primary data saved (6319 records). [2025-10-13T18:32:34.310219] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-13T18:32:34.310321] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUKB took 23.0s. Estimated remaining: 3h 56m 50s. Rate: 7.2 symbols/min [2025-10-13T18:32:34.485906] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:34.530709] [DEBUG] [LOCAL ] DVA: Loaded 41566 existing records from primary storage. [2025-10-13T18:32:34.531008] [INFO ] [MAIN ] DVA: Loaded 41566 existing records. [2025-10-13T18:32:34.707581] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:32:34.708140] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-13T18:32:34.709017] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-13T18:32:34.709584] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-13T18:32:34.709679] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-13T18:32:34.823134] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-13T18:32:35.060111] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:35.617896] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-13T18:32:35.813438] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T18:32:36.417960] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-13T18:32:36.471477] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T18:32:36.745282] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T18:32:36.750295] [INFO ] [REMOTE ] DTM: Full fetch complete (64747 records). [2025-10-13T18:32:36.750412] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-13T18:32:37.127486] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-13T18:32:37.127567] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-13T18:32:37.128353] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-13T18:32:37.128414] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-13T18:32:37.129685] [DEBUG] [LOCAL ] DTM: Trimmed 64747 records to 43975 (keeping 200 days of data) [2025-10-13T18:32:37.222045] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-13T18:32:37.410355] [DEBUG] [LOCAL ] DTM: Primary data saved (43975 records). [2025-10-13T18:32:37.410492] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-13T18:32:37.410560] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DTM took 48.0s. Estimated remaining: 3h 56m 29s. Rate: 7.2 symbols/min [2025-10-13T18:32:37.577087] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:37.627690] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-10-13T18:32:37.628043] [INFO ] [MAIN ] DVN: Loaded 54479 existing records. [2025-10-13T18:32:37.802095] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:32:37.802296] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-13T18:32:37.802343] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-13T18:32:37.802940] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-13T18:32:37.802996] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-13T18:32:38.021485] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-13T18:32:38.187434] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:38.319126] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T18:32:38.826612] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-13T18:32:38.832696] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T18:32:39.617903] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-13T18:32:39.704849] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T18:32:40.417971] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-13T18:32:41.217920] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-13T18:32:41.597020] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-13T18:32:41.872528] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-13T18:32:42.017968] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-13T18:32:42.292520] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T18:32:42.817904] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-13T18:32:43.035164] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T18:32:43.617963] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-13T18:32:43.825174] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T18:32:44.348482] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T18:32:44.417924] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-13T18:32:45.220250] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-13T18:32:45.435462] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T18:32:45.747771] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T18:32:45.753296] [INFO ] [REMOTE ] DUK: Full fetch complete (77390 records). [2025-10-13T18:32:45.753423] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-13T18:32:46.023164] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-13T18:32:46.136299] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-13T18:32:46.136379] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-13T18:32:46.137291] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-13T18:32:46.137355] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-13T18:32:46.138907] [DEBUG] [LOCAL ] DUK: Trimmed 77390 records to 53437 (keeping 200 days of data) [2025-10-13T18:32:46.467484] [DEBUG] [LOCAL ] DUK: Primary data saved (53437 records). [2025-10-13T18:32:46.467625] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-13T18:32:46.467739] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DUK took 44.1s. Estimated remaining: 3h 56m 22s. Rate: 7.2 symbols/min [2025-10-13T18:32:46.637422] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:32:46.637792] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-13T18:32:46.637880] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-13T18:32:46.638168] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-13T18:32:46.638213] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-13T18:32:46.638254] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-13T18:32:46.638286] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-13T18:32:46.824398] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-13T18:32:47.024105] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T18:32:47.028243] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:32:47.617919] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-13T18:32:47.990562] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T18:32:48.417902] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-13T18:32:48.544004] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:32:49.217982] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-13T18:32:49.463161] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T18:32:50.017972] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-13T18:32:50.350602] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-13T18:32:50.470706] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T18:32:50.817929] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-13T18:32:51.617926] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-13T18:32:51.695374] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T18:32:52.420800] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-13T18:32:52.425436] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:32:53.217907] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-13T18:32:53.430619] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T18:32:54.017988] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-13T18:32:54.384189] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T18:32:54.745137] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T18:32:54.817978] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-13T18:32:55.408445] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T18:32:55.617969] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-13T18:32:56.423622] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-13T18:32:56.429947] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T18:32:57.217910] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-13T18:32:57.396945] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T18:32:58.017979] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-13T18:32:58.591786] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-13T18:32:58.818027] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-13T18:32:58.981471] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T18:32:59.617926] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-13T18:32:59.860254] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:33:00.368030] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T18:33:00.417915] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-13T18:33:01.218000] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-13T18:33:01.358246] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T18:33:02.017982] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-13T18:33:02.289395] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-13T18:33:02.817923] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-13T18:33:02.872349] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:33:03.388801] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T18:33:03.394692] [INFO ] [REMOTE ] DV: Full fetch complete (73572 records). [2025-10-13T18:33:03.394902] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-13T18:33:03.628745] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-13T18:33:03.805619] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-13T18:33:03.805758] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-13T18:33:03.806869] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-13T18:33:03.806936] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-13T18:33:03.808900] [DEBUG] [LOCAL ] DV: Trimmed 73572 records to 51298 (keeping 200 days of data) [2025-10-13T18:33:04.130737] [DEBUG] [LOCAL ] DV: Primary data saved (51298 records). [2025-10-13T18:33:04.130930] [INFO ] [MAIN ] DV: Full history saved. [2025-10-13T18:33:04.131033] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DV took 39.9s. Estimated remaining: 3h 56m 38s. Rate: 7.2 symbols/min [2025-10-13T18:33:04.311909] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:04.371186] [DEBUG] [LOCAL ] DXC: Loaded 50583 existing records from primary storage. [2025-10-13T18:33:04.371772] [INFO ] [MAIN ] DXC: Loaded 50583 existing records. [2025-10-13T18:33:04.423805] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-13T18:33:04.578245] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:04.578512] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-13T18:33:04.578565] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-13T18:33:04.579017] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-13T18:33:04.579078] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-13T18:33:05.035754] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:05.104278] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-13T18:33:05.157984] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T18:33:05.218030] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-13T18:33:06.017985] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-13T18:33:06.325879] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T18:33:06.817883] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-13T18:33:06.912062] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T18:33:07.540569] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T18:33:07.617907] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-13T18:33:07.712112] [DEBUG] [REMOTE ] DVA: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-13T18:33:07.712437] [WARN ] [REMOTE ] DVA: No data returned for month 2025-10 [2025-10-13T18:33:07.712529] [FATAL] [REMOTE ] DVA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:33:07.712623] [FATAL] [MAIN ] DVA: Failed to fetch primary data. [2025-10-13T18:33:07.712720] [WARN ] [MAIN ] DVA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:33:07.712803] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-13T18:33:07.712881] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-13T18:33:07.712929] [INFO ] [LOCAL ] DVA: Starting deletion of derivative data. [2025-10-13T18:33:07.713144] [DEBUG] [LOCAL ] DVA: Deleted derivative data file. [2025-10-13T18:33:07.713256] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DVA took 33.4s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-10-13T18:33:07.878200] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:07.913427] [DEBUG] [LOCAL ] DXYZ: Loaded 37713 existing records from primary storage. [2025-10-13T18:33:07.913740] [INFO ] [MAIN ] DXYZ: Loaded 37713 existing records. [2025-10-13T18:33:08.086617] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:08.086869] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-13T18:33:08.086931] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-13T18:33:08.087400] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-13T18:33:08.087456] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-13T18:33:08.425127] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-13T18:33:08.452300] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:08.686956] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T18:33:09.217966] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-13T18:33:09.824772] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T18:33:10.017965] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-13T18:33:10.817960] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-13T18:33:11.009929] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:33:11.617961] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-13T18:33:12.058193] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-13T18:33:12.417956] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-13T18:33:13.010687] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T18:33:13.042823] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T18:33:13.047707] [INFO ] [REMOTE ] DVN: Full fetch complete (77376 records). [2025-10-13T18:33:13.047825] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-13T18:33:13.048669] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:33:13.048759] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:33:13.048802] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:33:13.048841] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-13T18:33:13.048899] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-13T18:33:13.048935] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-13T18:33:13.049095] [DEBUG] [LOCAL ] DVN: Deleted derivative data file. [2025-10-13T18:33:13.049833] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DVN took 35.6s. Estimated remaining: 3h 56m 1s. Rate: 7.2 symbols/min [2025-10-13T18:33:13.220727] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-13T18:33:13.224319] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:13.225377] [DEBUG] [LOCAL ] DY: No existing data file found in primary storage. [2025-10-13T18:33:13.225423] [WARN ] [MAIN ] DY: No existing data found, performing full refresh instead. [2025-10-13T18:33:13.225535] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-13T18:33:13.225577] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-13T18:33:13.225626] [DEBUG] [LOCAL ] DY: No primary data file found to delete. [2025-10-13T18:33:13.225696] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-13T18:33:13.586459] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:13.720511] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-10-13T18:33:14.017929] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-13T18:33:14.461404] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T18:33:14.817911] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-13T18:33:15.617977] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-13T18:33:15.865558] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T18:33:16.418018] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-13T18:33:16.894694] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T18:33:17.145917] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T18:33:17.217889] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-13T18:33:18.008313] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T18:33:18.018303] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-13T18:33:18.515130] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:33:18.817926] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-13T18:33:19.465682] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T18:33:19.617971] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-13T18:33:20.417920] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-13T18:33:20.555236] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T18:33:20.560886] [INFO ] [REMOTE ] DX: Full fetch complete (75564 records). [2025-10-13T18:33:20.561031] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-13T18:33:20.956999] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-13T18:33:20.957078] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-13T18:33:20.957933] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-13T18:33:20.958020] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-13T18:33:20.959537] [DEBUG] [LOCAL ] DX: Trimmed 75564 records to 52474 (keeping 200 days of data) [2025-10-13T18:33:21.237439] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-13T18:33:21.284173] [DEBUG] [LOCAL ] DX: Primary data saved (52474 records). [2025-10-13T18:33:21.284369] [INFO ] [MAIN ] DX: Full history saved. [2025-10-13T18:33:21.284533] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DX took 34.8s. Estimated remaining: 3h 55m 53s. Rate: 7.2 symbols/min [2025-10-13T18:33:21.456075] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:21.489983] [DEBUG] [LOCAL ] E: Loaded 33622 existing records from primary storage. [2025-10-13T18:33:21.490313] [INFO ] [MAIN ] E: Loaded 33622 existing records. [2025-10-13T18:33:21.692979] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:21.695436] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T18:33:21.695723] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-13T18:33:21.704390] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-13T18:33:21.704813] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-13T18:33:21.704881] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-13T18:33:22.025859] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-13T18:33:22.072145] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:22.102545] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T18:33:22.304441] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T18:33:22.817952] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-13T18:33:23.617997] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-13T18:33:24.094324] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T18:33:24.136370] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-13T18:33:24.417988] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-13T18:33:25.040349] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T18:33:25.217987] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-13T18:33:25.314080] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T18:33:26.017955] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-13T18:33:26.751710] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:33:26.817990] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-13T18:33:27.325037] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T18:33:27.617926] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-13T18:33:28.417900] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-13T18:33:28.487495] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-13T18:33:29.217927] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-13T18:33:29.570599] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T18:33:29.870107] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T18:33:30.018008] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-13T18:33:30.717718] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T18:33:30.817896] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-13T18:33:31.139567] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T18:33:31.617961] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-13T18:33:32.417930] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-13T18:33:32.539684] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:33:32.659893] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T18:33:33.217952] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-13T18:33:34.018003] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-13T18:33:34.111623] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T18:33:34.817982] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-13T18:33:35.392288] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-13T18:33:35.488408] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T18:33:35.617922] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-13T18:33:35.991707] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T18:33:36.417932] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-13T18:33:37.009754] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T18:33:37.218001] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-13T18:33:37.920770] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T18:33:38.017893] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-13T18:33:38.624035] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:33:38.817899] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-13T18:33:39.617908] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-13T18:33:39.894322] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-13T18:33:39.920555] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T18:33:40.417925] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-13T18:33:41.217958] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-13T18:33:42.017945] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-13T18:33:42.056812] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T18:33:42.817991] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-13T18:33:43.041816] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (3.42 seconds). [2025-10-13T18:33:43.255102] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T18:33:43.315587] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-13T18:33:43.320144] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57335 records). [2025-10-13T18:33:43.320262] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-13T18:33:43.623082] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-13T18:33:43.692487] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-13T18:33:43.692575] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-13T18:33:43.693378] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-13T18:33:43.693825] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-13T18:33:43.695007] [DEBUG] [LOCAL ] DXYZ: Trimmed 57335 records to 37107 (keeping 200 days of data) [2025-10-13T18:33:43.912771] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37107 records). [2025-10-13T18:33:43.912918] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-13T18:33:43.913019] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DXYZ took 36.2s. Estimated remaining: 3h 56m 21s. Rate: 7.2 symbols/min [2025-10-13T18:33:44.076202] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:44.119695] [DEBUG] [LOCAL ] EAF: Loaded 42686 existing records from primary storage. [2025-10-13T18:33:44.120131] [INFO ] [MAIN ] EAF: Loaded 42686 existing records. [2025-10-13T18:33:44.319322] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:44.320002] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-13T18:33:44.332437] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-13T18:33:44.333385] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T18:33:44.338033] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-13T18:33:44.338677] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-13T18:33:44.344345] [INFO ] [REMOTE ] DXC: Full fetch complete (69761 records). [2025-10-13T18:33:44.374022] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-13T18:33:44.435564] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-13T18:33:45.110585] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:45.166044] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-13T18:33:45.166129] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-13T18:33:45.167060] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-13T18:33:45.167126] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-13T18:33:45.172073] [DEBUG] [LOCAL ] DXC: Trimmed 69761 records to 49851 (keeping 200 days of data) [2025-10-13T18:33:45.219314] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-13T18:33:45.464308] [DEBUG] [LOCAL ] DXC: Primary data saved (49851 records). [2025-10-13T18:33:45.464450] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-13T18:33:45.464529] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. DXC took 41.3s. Estimated remaining: 3h 55m 55s. Rate: 7.2 symbols/min [2025-10-13T18:33:45.647175] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:45.682995] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T18:33:45.686396] [DEBUG] [LOCAL ] EAI: Loaded 4046 existing records from primary storage. [2025-10-13T18:33:45.697124] [INFO ] [MAIN ] EAI: Loaded 4046 existing records. [2025-10-13T18:33:45.880461] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:45.880809] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-13T18:33:45.880904] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-13T18:33:45.881115] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-13T18:33:45.881172] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-13T18:33:46.027278] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-13T18:33:46.255935] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:46.499515] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-13T18:33:46.817909] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-13T18:33:46.952181] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T18:33:46.955063] [INFO ] [REMOTE ] DY: Full fetch complete (43575 records). [2025-10-13T18:33:46.955141] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-13T18:33:47.341372] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-13T18:33:47.341473] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-13T18:33:47.342150] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-13T18:33:47.342325] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-13T18:33:47.369726] [DEBUG] [LOCAL ] DY: Trimmed 43575 records to 28501 (keeping 200 days of data) [2025-10-13T18:33:47.369555] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T18:33:47.554369] [DEBUG] [LOCAL ] DY: Primary data saved (28501 records). [2025-10-13T18:33:47.554520] [INFO ] [MAIN ] DY: Full history saved. [2025-10-13T18:33:47.554595] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. DY took 34.5s. Estimated remaining: 3h 55m 31s. Rate: 7.2 symbols/min [2025-10-13T18:33:47.627858] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-13T18:33:47.726872] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:47.759351] [DEBUG] [LOCAL ] EARN: Loaded 29576 existing records from primary storage. [2025-10-13T18:33:47.759636] [INFO ] [MAIN ] EARN: Loaded 29576 existing records. [2025-10-13T18:33:47.944507] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:47.944777] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-13T18:33:47.944862] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-13T18:33:47.945241] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-13T18:33:47.945299] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-13T18:33:48.310665] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:48.328036] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-13T18:33:48.417884] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-13T18:33:49.217982] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-13T18:33:49.287465] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T18:33:49.691147] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T18:33:49.694486] [INFO ] [REMOTE ] E: Full fetch complete (47834 records). [2025-10-13T18:33:49.694608] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-13T18:33:50.023139] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-13T18:33:50.073144] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-13T18:33:50.073232] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-13T18:33:50.073981] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-13T18:33:50.074044] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-13T18:33:50.076370] [DEBUG] [LOCAL ] E: Trimmed 47834 records to 33186 (keeping 200 days of data) [2025-10-13T18:33:50.284292] [DEBUG] [LOCAL ] E: Primary data saved (33186 records). [2025-10-13T18:33:50.284482] [INFO ] [MAIN ] E: Full history saved. [2025-10-13T18:33:50.284602] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. E took 29.0s. Estimated remaining: 3h 55m 9s. Rate: 7.2 symbols/min [2025-10-13T18:33:50.466319] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:33:50.517575] [DEBUG] [LOCAL ] EAT: Loaded 50552 existing records from primary storage. [2025-10-13T18:33:50.517920] [INFO ] [MAIN ] EAT: Loaded 50552 existing records. [2025-10-13T18:33:50.697771] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:33:50.698128] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-13T18:33:50.698209] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-13T18:33:50.699001] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-13T18:33:50.699062] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-13T18:33:50.824530] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-13T18:33:50.862267] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T18:33:50.996430] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T18:33:51.114769] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:33:51.617973] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-13T18:33:52.284192] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T18:33:52.417966] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-13T18:33:52.989806] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T18:33:53.217915] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-13T18:33:54.017930] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-13T18:33:54.566207] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T18:33:54.670125] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-13T18:33:54.714793] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T18:33:54.817914] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-13T18:33:55.617927] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-13T18:33:56.417977] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-13T18:33:56.503352] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:33:56.753208] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-13T18:33:57.201429] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T18:33:57.217897] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-13T18:33:58.018013] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-13T18:33:58.464754] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-13T18:33:58.817990] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-13T18:33:58.972385] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T18:33:59.617915] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-13T18:34:00.412550] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T18:34:00.422898] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-13T18:34:01.188156] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T18:34:01.226547] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-13T18:34:01.247904] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T18:34:02.017973] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-13T18:34:02.509804] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T18:34:02.817933] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-13T18:34:02.850188] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T18:34:03.617979] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-13T18:34:04.354370] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T18:34:04.417903] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-13T18:34:05.217968] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-13T18:34:05.317037] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T18:34:05.816187] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T18:34:05.958281] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T18:34:06.017904] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-13T18:34:06.817965] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-13T18:34:07.575293] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T18:34:07.617909] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-13T18:34:08.417915] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-13T18:34:08.536937] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T18:34:08.663002] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T18:34:08.927902] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T18:34:09.217998] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-13T18:34:10.017980] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-13T18:34:10.818000] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-13T18:34:10.975335] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T18:34:11.403290] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T18:34:11.617923] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-13T18:34:12.118476] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T18:34:12.121964] [INFO ] [REMOTE ] EAF: Full fetch complete (62847 records). [2025-10-13T18:34:12.122076] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-13T18:34:12.423112] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-13T18:34:12.502312] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-13T18:34:12.502402] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-13T18:34:12.503195] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-13T18:34:12.503259] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-13T18:34:12.504479] [DEBUG] [LOCAL ] EAF: Trimmed 62847 records to 41883 (keeping 200 days of data) [2025-10-13T18:34:12.739840] [DEBUG] [LOCAL ] EAF: Primary data saved (41883 records). [2025-10-13T18:34:12.739975] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-13T18:34:12.740054] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EAF took 28.8s. Estimated remaining: 3h 55m 36s. Rate: 7.2 symbols/min [2025-10-13T18:34:13.221575] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-13T18:34:13.223784] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:34:13.972711] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T18:34:14.024631] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-13T18:34:14.049067] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T18:34:14.514313] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-13T18:34:14.818045] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-13T18:34:15.617923] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-13T18:34:16.417906] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-13T18:34:16.457306] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T18:34:16.787616] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T18:34:16.990714] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T18:34:16.991754] [INFO ] [REMOTE ] EAI: Full fetch complete (6079 records). [2025-10-13T18:34:16.991831] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-13T18:34:17.229107] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-13T18:34:17.344006] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-13T18:34:17.344083] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-13T18:34:17.344243] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-13T18:34:17.344281] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-13T18:34:17.344632] [DEBUG] [LOCAL ] EAI: Trimmed 6079 records to 4003 (keeping 200 days of data) [2025-10-13T18:34:17.368411] [DEBUG] [LOCAL ] EAI: Primary data saved (4003 records). [2025-10-13T18:34:17.368529] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-13T18:34:17.368615] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EAI took 31.9s. Estimated remaining: 3h 55m 18s. Rate: 7.2 symbols/min [2025-10-13T18:34:18.017961] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-13T18:34:18.166211] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-13T18:34:18.817921] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-13T18:34:19.884187] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T18:34:19.910169] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-13T18:34:19.912063] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:34:20.417926] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-13T18:34:21.422401] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T18:34:21.427889] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-13T18:34:21.741089] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T18:34:22.017929] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-13T18:34:22.826709] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T18:34:22.829960] [INFO ] [REMOTE ] EARN: Full fetch complete (45449 records). [2025-10-13T18:34:22.830041] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-13T18:34:22.830577] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:34:22.830684] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:34:22.830736] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:34:22.830778] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-13T18:34:22.830833] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-13T18:34:22.830867] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-10-13T18:34:22.831046] [DEBUG] [LOCAL ] EARN: Deleted derivative data file. [2025-10-13T18:34:22.831888] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EARN took 35.3s. Estimated remaining: 3h 55m 3s. Rate: 7.2 symbols/min [2025-10-13T18:34:23.723780] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T18:34:23.728765] [INFO ] [REMOTE ] EAT: Full fetch complete (71813 records). [2025-10-13T18:34:23.728861] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-13T18:34:23.729581] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:34:23.729698] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:34:23.729747] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:34:23.729785] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-13T18:34:23.729839] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-13T18:34:23.729872] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-10-13T18:34:23.730043] [DEBUG] [LOCAL ] EAT: Deleted derivative data file. [2025-10-13T18:34:23.730131] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EAT took 33.4s. Estimated remaining: 3h 54m 36s. Rate: 7.2 symbols/min [2025-10-13T18:34:24.386388] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:24.385590] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:24.382471] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:24.393064] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-10-13T18:34:24.393131] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-10-13T18:34:24.422124] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-13T18:34:24.422195] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-13T18:34:24.422241] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-13T18:34:24.422274] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-13T18:34:24.432615] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:24.574369] [DEBUG] [LOCAL ] EBF: Loaded 19352 existing records from primary storage. [2025-10-13T18:34:24.585117] [INFO ] [MAIN ] EBF: Loaded 19352 existing records. [2025-10-13T18:34:24.847141] [DEBUG] [LOCAL ] EBR: Loaded 43824 existing records from primary storage. [2025-10-13T18:34:24.972633] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:34:24.978018] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-13T18:34:24.935991] [DEBUG] [LOCAL ] EB: Loaded 37311 existing records from primary storage. [2025-10-13T18:34:24.978118] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-13T18:34:24.992233] [INFO ] [MAIN ] EB: Loaded 37311 existing records. [2025-10-13T18:34:24.992009] [INFO ] [MAIN ] EBR: Loaded 43824 existing records. [2025-10-13T18:34:25.008746] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-13T18:34:25.081709] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-13T18:34:25.245097] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:25.266178] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-13T18:34:25.503926] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:34:25.538152] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:34:25.544101] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-13T18:34:25.544309] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-13T18:34:25.549543] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-13T18:34:25.549696] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-13T18:34:25.578157] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-13T18:34:25.565465] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-13T18:34:25.578352] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-13T18:34:25.578503] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-13T18:34:26.092714] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:26.196556] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-13T18:34:26.506970] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:26.530054] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-13T18:34:26.573538] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:26.573927] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-13T18:34:27.119941] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T18:34:27.129313] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-13T18:34:27.502430] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T18:34:27.506784] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-13T18:34:28.168903] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:34:28.178252] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-13T18:34:28.216044] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T18:34:28.354687] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T18:34:28.417887] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-13T18:34:28.750259] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T18:34:29.217889] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-13T18:34:29.484001] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T18:34:30.017902] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-13T18:34:30.065421] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T18:34:30.276001] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T18:34:30.817920] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-13T18:34:31.547494] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T18:34:31.617893] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-13T18:34:31.975453] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T18:34:32.417921] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-13T18:34:33.227217] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-13T18:34:33.249399] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T18:34:33.284343] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T18:34:34.017923] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-13T18:34:34.659153] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T18:34:34.817957] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-13T18:34:35.617899] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-13T18:34:35.711532] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:34:36.343723] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:34:36.417960] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-13T18:34:37.020892] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T18:34:37.217922] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-13T18:34:38.017349] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T18:34:38.025926] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-13T18:34:38.789107] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T18:34:38.817881] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-13T18:34:39.064011] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T18:34:39.617927] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-13T18:34:40.417913] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-13T18:34:40.450703] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T18:34:41.133144] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T18:34:41.217954] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-13T18:34:42.017911] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-13T18:34:42.128817] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T18:34:42.412835] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-13T18:34:42.817932] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-13T18:34:43.439759] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T18:34:43.617922] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-13T18:34:44.168240] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T18:34:44.417965] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-13T18:34:45.217925] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-13T18:34:45.289004] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T18:34:45.666232] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T18:34:46.021755] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-13T18:34:46.263872] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T18:34:46.817963] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-13T18:34:47.410156] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T18:34:47.617981] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-13T18:34:47.936426] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T18:34:48.417975] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-13T18:34:49.217909] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-13T18:34:49.292857] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T18:34:49.298093] [INFO ] [REMOTE ] EBS: Full fetch complete (67311 records). [2025-10-13T18:34:49.298204] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-13T18:34:49.680681] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-13T18:34:49.680797] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-13T18:34:49.681667] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-13T18:34:49.681745] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-13T18:34:49.683269] [DEBUG] [LOCAL ] EBS: Trimmed 67311 records to 46756 (keeping 200 days of data) [2025-10-13T18:34:49.783302] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T18:34:49.967994] [DEBUG] [LOCAL ] EBS: Primary data saved (46756 records). [2025-10-13T18:34:49.968144] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-13T18:34:49.968222] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBS took 26.2s. Estimated remaining: 3h 55m 12s. Rate: 7.2 symbols/min [2025-10-13T18:34:50.024864] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-13T18:34:50.143789] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:50.144171] [DEBUG] [LOCAL ] EC: No existing data file found in primary storage. [2025-10-13T18:34:50.144287] [WARN ] [MAIN ] EC: No existing data found, performing full refresh instead. [2025-10-13T18:34:50.144440] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-13T18:34:50.144598] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-13T18:34:50.144704] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-13T18:34:50.144754] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-13T18:34:50.273846] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T18:34:50.513600] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:50.817927] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-13T18:34:51.291515] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T18:34:51.295566] [INFO ] [REMOTE ] EB: Full fetch complete (55574 records). [2025-10-13T18:34:51.295711] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-13T18:34:51.619243] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-13T18:34:51.716008] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-13T18:34:51.716130] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-13T18:34:51.717086] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-13T18:34:51.717161] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-13T18:34:51.718993] [DEBUG] [LOCAL ] EB: Trimmed 55574 records to 36701 (keeping 200 days of data) [2025-10-13T18:34:51.945602] [DEBUG] [LOCAL ] EB: Primary data saved (36701 records). [2025-10-13T18:34:51.945820] [INFO ] [MAIN ] EB: Full history saved. [2025-10-13T18:34:51.945930] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EB took 28.2s. Estimated remaining: 3h 54m 48s. Rate: 7.2 symbols/min [2025-10-13T18:34:52.150279] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:34:52.188277] [DEBUG] [LOCAL ] ECAT: Loaded 29861 existing records from primary storage. [2025-10-13T18:34:52.188716] [INFO ] [MAIN ] ECAT: Loaded 29861 existing records. [2025-10-13T18:34:52.385783] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:34:52.386048] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-13T18:34:52.386098] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-13T18:34:52.386343] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-13T18:34:52.386406] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-13T18:34:52.421541] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-13T18:34:52.710274] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:34:52.798542] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T18:34:52.803053] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:34:53.217913] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-13T18:34:54.020437] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-13T18:34:54.214084] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T18:34:54.445871] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T18:34:54.817934] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-13T18:34:54.992757] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:34:55.617927] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-13T18:34:56.249623] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T18:34:56.417984] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-13T18:34:57.085351] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T18:34:57.217923] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-13T18:34:57.615026] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T18:34:58.017969] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-13T18:34:58.644327] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:34:58.817977] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-13T18:34:59.617929] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-13T18:34:59.661477] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:35:00.382294] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T18:35:00.417904] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-13T18:35:00.726064] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T18:35:00.728839] [INFO ] [REMOTE ] EBF: Full fetch complete (27542 records). [2025-10-13T18:35:00.728933] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-13T18:35:00.729492] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:35:00.729613] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:35:00.729727] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:35:00.729819] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-13T18:35:00.729919] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-13T18:35:00.729985] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-10-13T18:35:00.730211] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-10-13T18:35:00.730322] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBF took 37.0s. Estimated remaining: 3h 54m 40s. Rate: 7.2 symbols/min [2025-10-13T18:35:00.911309] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:00.954390] [DEBUG] [LOCAL ] ECC: Loaded 43742 existing records from primary storage. [2025-10-13T18:35:00.954789] [INFO ] [MAIN ] ECC: Loaded 43742 existing records. [2025-10-13T18:35:01.137500] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:35:01.137834] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-13T18:35:01.137897] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-13T18:35:01.138313] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-13T18:35:01.138374] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-13T18:35:01.225687] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-13T18:35:01.547882] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:02.018050] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-13T18:35:02.087204] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:35:02.530970] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T18:35:02.817986] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-13T18:35:03.627416] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-13T18:35:03.651733] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:35:03.809413] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T18:35:04.417997] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-13T18:35:05.217974] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-13T18:35:05.411412] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-13T18:35:05.417213] [INFO ] [REMOTE ] EBR: Full fetch complete (62468 records). [2025-10-13T18:35:05.417421] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-13T18:35:05.856221] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-13T18:35:05.856342] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-13T18:35:05.857348] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-13T18:35:05.857421] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-13T18:35:05.859976] [DEBUG] [LOCAL ] EBR: Trimmed 62468 records to 43212 (keeping 200 days of data) [2025-10-13T18:35:06.047087] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-13T18:35:06.132437] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T18:35:06.205939] [DEBUG] [LOCAL ] EBR: Primary data saved (43212 records). [2025-10-13T18:35:06.206144] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-13T18:35:06.207185] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EBR took 42.5s. Estimated remaining: 3h 54m 25s. Rate: 7.2 symbols/min [2025-10-13T18:35:06.430590] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:06.430920] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-13T18:35:06.431115] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-13T18:35:06.431300] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-13T18:35:06.431376] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-13T18:35:06.431562] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-13T18:35:06.431630] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-13T18:35:06.659260] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T18:35:06.823435] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-13T18:35:07.011447] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:07.618056] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-13T18:35:07.970060] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T18:35:08.097511] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T18:35:08.164451] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T18:35:08.417993] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-13T18:35:09.218203] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-13T18:35:10.017996] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-13T18:35:10.265382] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-13T18:35:10.817926] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-13T18:35:10.905706] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T18:35:11.124979] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:35:11.617979] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-13T18:35:12.418044] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-13T18:35:12.470761] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:35:12.752184] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-13T18:35:12.849044] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T18:35:13.217957] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-13T18:35:14.018000] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-13T18:35:14.560772] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T18:35:14.818017] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-13T18:35:15.173044] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-13T18:35:15.617992] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-13T18:35:16.001001] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-13T18:35:16.417988] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-13T18:35:17.032494] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T18:35:17.217994] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-13T18:35:18.017921] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-13T18:35:18.219480] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:35:18.514823] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T18:35:18.817919] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-13T18:35:18.946797] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T18:35:19.617977] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-13T18:35:20.107911] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-13T18:35:20.418008] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-13T18:35:21.217990] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-13T18:35:21.371262] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T18:35:21.778769] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T18:35:21.782355] [INFO ] [REMOTE ] ECAT: Full fetch complete (42923 records). [2025-10-13T18:35:21.782457] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-13T18:35:22.023167] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-13T18:35:22.190305] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-13T18:35:22.190427] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-13T18:35:22.191334] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-13T18:35:22.191409] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-13T18:35:22.193096] [DEBUG] [LOCAL ] ECAT: Trimmed 42923 records to 29435 (keeping 200 days of data) [2025-10-13T18:35:22.387879] [DEBUG] [LOCAL ] ECAT: Primary data saved (29435 records). [2025-10-13T18:35:22.388101] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-13T18:35:22.388207] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECAT took 30.4s. Estimated remaining: 3h 54m 36s. Rate: 7.2 symbols/min [2025-10-13T18:35:22.581880] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:22.587399] [DEBUG] [LOCAL ] ECCU: Loaded 2271 existing records from primary storage. [2025-10-13T18:35:22.587629] [INFO ] [MAIN ] ECCU: Loaded 2271 existing records. [2025-10-13T18:35:22.787503] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:35:22.787793] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-13T18:35:22.787847] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-13T18:35:22.788049] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-13T18:35:22.788107] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-13T18:35:22.830109] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-13T18:35:23.194978] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:23.210041] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T18:35:23.224769] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-13T18:35:23.461614] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:35:23.617973] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-13T18:35:23.995358] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-13T18:35:24.417992] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-13T18:35:25.217977] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-13T18:35:25.576844] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-13T18:35:25.967984] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T18:35:26.021145] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-13T18:35:26.593811] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T18:35:26.818025] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-13T18:35:27.210373] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-13T18:35:27.617982] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-13T18:35:28.418027] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-13T18:35:29.188545] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T18:35:29.217904] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-13T18:35:30.017925] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-13T18:35:30.124584] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T18:35:30.419869] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-13T18:35:30.486336] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T18:35:30.494393] [INFO ] [REMOTE ] EC: Full fetch complete (71818 records). [2025-10-13T18:35:30.494627] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-13T18:35:30.818425] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-13T18:35:30.927604] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-13T18:35:30.927747] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-13T18:35:30.928988] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-13T18:35:30.929056] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-13T18:35:30.931233] [DEBUG] [LOCAL ] EC: Trimmed 71818 records to 49023 (keeping 200 days of data) [2025-10-13T18:35:31.238242] [DEBUG] [LOCAL ] EC: Primary data saved (49023 records). [2025-10-13T18:35:31.238516] [INFO ] [MAIN ] EC: Full history saved. [2025-10-13T18:35:31.238638] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. EC took 41.3s. Estimated remaining: 3h 54m 29s. Rate: 7.2 symbols/min [2025-10-13T18:35:31.412099] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:31.412311] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-13T18:35:31.412349] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-13T18:35:31.412490] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-13T18:35:31.412531] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-13T18:35:31.412572] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-13T18:35:31.412605] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-13T18:35:31.522444] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-13T18:35:31.623090] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-13T18:35:31.832478] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:32.417988] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-13T18:35:33.127341] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T18:35:33.217977] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-13T18:35:33.425078] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T18:35:34.017911] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-13T18:35:34.481964] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T18:35:34.482744] [INFO ] [REMOTE ] ECCC: Full fetch complete (1314 records). [2025-10-13T18:35:34.482811] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-13T18:35:34.702012] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-13T18:35:34.705518] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T18:35:34.705777] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:35:34.710355] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:35:34.710815] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-13T18:35:34.711072] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-13T18:35:34.711122] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-13T18:35:34.711165] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-13T18:35:34.711243] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCC took 28.5s. Estimated remaining: 3h 54m 9s. Rate: 7.2 symbols/min [2025-10-13T18:35:34.716699] [INFO ] [REMOTE ] ECC: Full fetch complete (61095 records). [2025-10-13T18:35:34.745629] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-13T18:35:34.818728] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-13T18:35:35.031065] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:35.060905] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-13T18:35:35.078002] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-13T18:35:35.112632] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-13T18:35:35.150400] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-13T18:35:35.203459] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-13T18:35:35.211512] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-13T18:35:35.333421] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-13T18:35:35.469279] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-13T18:35:35.469789] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-13T18:35:35.476282] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-13T18:35:35.481490] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-13T18:35:35.623359] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-13T18:35:35.623214] [DEBUG] [LOCAL ] ECC: Trimmed 61095 records to 43166 (keeping 200 days of data) [2025-10-13T18:35:35.824789] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:35.990234] [DEBUG] [LOCAL ] ECC: Primary data saved (43166 records). [2025-10-13T18:35:35.990382] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-13T18:35:35.990510] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECC took 35.3s. Estimated remaining: 3h 53m 43s. Rate: 7.2 symbols/min [2025-10-13T18:35:36.170825] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:36.171044] [DEBUG] [LOCAL ] ECG: No existing data file found in primary storage. [2025-10-13T18:35:36.171089] [WARN ] [MAIN ] ECG: No existing data found, performing full refresh instead. [2025-10-13T18:35:36.171201] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-13T18:35:36.171243] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-13T18:35:36.171285] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-10-13T18:35:36.171327] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-13T18:35:36.421550] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-13T18:35:36.455174] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T18:35:36.543627] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:37.072610] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T18:35:37.217910] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-13T18:35:37.988743] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T18:35:38.017887] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-13T18:35:38.485386] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T18:35:38.817915] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-13T18:35:39.232558] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-13T18:35:39.617922] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-13T18:35:40.378295] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T18:35:40.417892] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-13T18:35:41.217924] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-13T18:35:41.582525] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-13T18:35:41.868813] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T18:35:42.017931] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-13T18:35:42.395836] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-13T18:35:42.817920] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-13T18:35:43.617931] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-13T18:35:44.030131] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-13T18:35:44.227785] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:35:44.418034] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-13T18:35:44.746503] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-13T18:35:45.217927] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-13T18:35:46.018001] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-13T18:35:46.459025] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T18:35:46.692108] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T18:35:46.817904] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-13T18:35:47.617922] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-13T18:35:48.231183] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T18:35:48.272500] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T18:35:48.417898] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-13T18:35:49.217921] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-13T18:35:49.592991] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-13T18:35:49.593956] [INFO ] [REMOTE ] ECCU: Full fetch complete (4408 records). [2025-10-13T18:35:49.594027] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-13T18:35:50.003468] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-13T18:35:50.004361] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-13T18:35:50.006005] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-13T18:35:50.005634] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T18:35:50.006121] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-13T18:35:50.015772] [DEBUG] [LOCAL ] ECCU: Trimmed 4408 records to 2215 (keeping 200 days of data) [2025-10-13T18:35:50.017879] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-13T18:35:50.033795] [DEBUG] [LOCAL ] ECCU: Primary data saved (2215 records). [2025-10-13T18:35:50.033990] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-13T18:35:50.034121] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCU took 27.6s. Estimated remaining: 3h 53m 49s. Rate: 7.2 symbols/min [2025-10-13T18:35:50.211935] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:35:50.265542] [DEBUG] [LOCAL ] ECL: Loaded 47324 existing records from primary storage. [2025-10-13T18:35:50.265976] [INFO ] [MAIN ] ECL: Loaded 47324 existing records. [2025-10-13T18:35:50.449752] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:35:50.450016] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-13T18:35:50.450066] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-13T18:35:50.450636] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-13T18:35:50.450727] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-13T18:35:50.804143] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:35:50.817894] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-13T18:35:51.128781] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:35:51.617930] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-13T18:35:52.283224] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T18:35:52.417903] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-13T18:35:52.868521] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T18:35:52.986633] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:35:53.218004] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-13T18:35:54.017935] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-13T18:35:54.502702] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-13T18:35:54.617713] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T18:35:54.817950] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-13T18:35:55.195178] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-13T18:35:55.617926] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-13T18:35:56.417927] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-13T18:35:56.771507] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-13T18:35:57.218000] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-13T18:35:57.329144] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T18:35:58.017979] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-13T18:35:58.273113] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T18:35:58.340703] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-13T18:35:58.817966] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-13T18:35:59.144039] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-13T18:35:59.618009] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-13T18:36:00.006165] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-13T18:36:00.418061] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-13T18:36:01.217990] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-13T18:36:01.819036] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T18:36:01.863177] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T18:36:02.018026] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-13T18:36:02.817933] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-13T18:36:03.241299] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-13T18:36:03.617988] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-13T18:36:03.809109] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T18:36:04.418002] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-13T18:36:05.125900] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T18:36:05.129375] [INFO ] [REMOTE ] ECG: Full fetch complete (50840 records). [2025-10-13T18:36:05.129473] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-13T18:36:05.223009] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-13T18:36:05.512662] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-13T18:36:05.512752] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-13T18:36:05.513388] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-13T18:36:05.513429] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-13T18:36:05.514381] [DEBUG] [LOCAL ] ECG: Trimmed 50840 records to 33411 (keeping 200 days of data) [2025-10-13T18:36:05.692912] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T18:36:05.715903] [DEBUG] [LOCAL ] ECG: Primary data saved (33411 records). [2025-10-13T18:36:05.716003] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-13T18:36:05.716092] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECG took 29.7s. Estimated remaining: 3h 53m 58s. Rate: 7.2 symbols/min [2025-10-13T18:36:05.884580] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:05.902611] [DEBUG] [LOCAL ] ECO: Loaded 18639 existing records from primary storage. [2025-10-13T18:36:05.902893] [INFO ] [MAIN ] ECO: Loaded 18639 existing records. [2025-10-13T18:36:06.018774] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-13T18:36:06.087138] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:06.087357] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-13T18:36:06.087514] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-13T18:36:06.087909] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-13T18:36:06.087996] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-13T18:36:06.464826] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T18:36:06.469995] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:06.497475] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T18:36:06.498154] [INFO ] [REMOTE ] ECCX: Full fetch complete (1451 records). [2025-10-13T18:36:06.498221] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-13T18:36:06.674447] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-13T18:36:06.674634] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:36:06.674728] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:36:06.674778] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-13T18:36:06.674836] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-13T18:36:06.674872] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-13T18:36:06.674912] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-13T18:36:06.674966] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECCX took 32.0s. Estimated remaining: 3h 53m 32s. Rate: 7.2 symbols/min [2025-10-13T18:36:06.819737] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-13T18:36:06.843252] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:06.844104] [DEBUG] [LOCAL ] ECVT: No existing data file found in primary storage. [2025-10-13T18:36:06.844149] [WARN ] [MAIN ] ECVT: No existing data found, performing full refresh instead. [2025-10-13T18:36:06.844257] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-13T18:36:06.844299] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-13T18:36:06.844341] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-13T18:36:06.844374] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-13T18:36:07.217232] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:07.379194] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T18:36:07.617930] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-13T18:36:08.417986] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-13T18:36:08.750265] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-13T18:36:09.199735] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T18:36:09.217933] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-13T18:36:10.017977] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-13T18:36:10.367071] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-13T18:36:10.615736] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T18:36:10.817933] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-13T18:36:11.196450] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-13T18:36:11.617919] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-13T18:36:12.417958] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-13T18:36:12.714874] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T18:36:12.745368] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-13T18:36:13.217903] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-13T18:36:14.018043] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-13T18:36:14.817887] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-13T18:36:14.887399] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T18:36:15.107309] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T18:36:15.617925] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-13T18:36:15.976108] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T18:36:16.417929] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-13T18:36:16.870933] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T18:36:16.871681] [INFO ] [REMOTE ] ECCW: Full fetch complete (1437 records). [2025-10-13T18:36:16.871748] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-13T18:36:17.036917] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T18:36:17.089350] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-13T18:36:17.089549] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:36:17.089619] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:36:17.089724] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-13T18:36:17.089802] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-13T18:36:17.089840] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-13T18:36:17.089880] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-13T18:36:17.089940] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECCW took 45.9s. Estimated remaining: 3h 53m 29s. Rate: 7.2 symbols/min [2025-10-13T18:36:17.229104] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-13T18:36:17.263539] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:17.330678] [DEBUG] [LOCAL ] ED: Loaded 53462 existing records from primary storage. [2025-10-13T18:36:17.331040] [INFO ] [MAIN ] ED: Loaded 53462 existing records. [2025-10-13T18:36:17.506603] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:17.506823] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-13T18:36:17.506868] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-13T18:36:17.507321] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-13T18:36:17.507376] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-13T18:36:17.856058] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:18.017910] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-13T18:36:18.475958] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T18:36:18.817988] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-13T18:36:19.617989] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-13T18:36:19.773232] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T18:36:19.949331] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-13T18:36:20.417961] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-13T18:36:21.116286] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T18:36:21.217904] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-13T18:36:22.027098] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-13T18:36:22.046496] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T18:36:22.307805] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T18:36:22.817924] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-13T18:36:23.617987] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-13T18:36:23.677811] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:36:24.389274] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-13T18:36:24.420013] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-13T18:36:24.423875] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T18:36:25.217930] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-13T18:36:26.011830] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T18:36:26.020513] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-13T18:36:26.757108] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T18:36:26.817909] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-13T18:36:27.476930] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:36:27.617917] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-13T18:36:28.417918] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-13T18:36:28.609462] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T18:36:29.217912] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-13T18:36:29.557283] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T18:36:30.023284] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-13T18:36:30.028312] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:36:30.631990] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T18:36:30.817986] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-13T18:36:31.617892] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-13T18:36:31.697617] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T18:36:31.872261] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T18:36:32.417986] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-13T18:36:33.217904] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-13T18:36:33.416245] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T18:36:33.955525] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T18:36:34.017993] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-13T18:36:34.527634] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T18:36:34.817933] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-13T18:36:35.621151] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-13T18:36:35.624949] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T18:36:35.630668] [INFO ] [REMOTE ] ECL: Full fetch complete (67968 records). [2025-10-13T18:36:35.630805] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-13T18:36:36.015814] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-13T18:36:36.015959] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-13T18:36:36.016767] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-13T18:36:36.016829] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-13T18:36:36.018173] [DEBUG] [LOCAL ] ECL: Trimmed 67968 records to 46627 (keeping 200 days of data) [2025-10-13T18:36:36.282747] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T18:36:36.357688] [DEBUG] [LOCAL ] ECL: Primary data saved (46627 records). [2025-10-13T18:36:36.357890] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-13T18:36:36.358026] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECL took 46.3s. Estimated remaining: 3h 53m 47s. Rate: 7.2 symbols/min [2025-10-13T18:36:36.421928] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-13T18:36:36.530575] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:36.556908] [DEBUG] [LOCAL ] EDD: Loaded 27263 existing records from primary storage. [2025-10-13T18:36:36.557186] [INFO ] [MAIN ] EDD: Loaded 27263 existing records. [2025-10-13T18:36:36.676943] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T18:36:36.757926] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:36.758195] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-13T18:36:36.758250] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-13T18:36:36.758561] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-13T18:36:36.758617] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-13T18:36:37.098313] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:37.217963] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-13T18:36:38.017913] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-13T18:36:38.188047] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T18:36:38.817898] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-13T18:36:38.843298] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:36:39.148706] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T18:36:39.617923] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-13T18:36:40.267815] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T18:36:40.417923] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-13T18:36:40.869130] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T18:36:40.871406] [INFO ] [REMOTE ] ECO: Full fetch complete (28527 records). [2025-10-13T18:36:40.871478] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-13T18:36:41.225492] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-13T18:36:41.239402] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-13T18:36:41.239483] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-13T18:36:41.240057] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-13T18:36:41.240119] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-13T18:36:41.240930] [DEBUG] [LOCAL ] ECO: Trimmed 28527 records to 18380 (keeping 200 days of data) [2025-10-13T18:36:41.354269] [DEBUG] [LOCAL ] ECO: Primary data saved (18380 records). [2025-10-13T18:36:41.354423] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-13T18:36:41.354507] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECO took 35.6s. Estimated remaining: 3h 53m 30s. Rate: 7.2 symbols/min [2025-10-13T18:36:41.569410] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:41.566187] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T18:36:41.587887] [DEBUG] [LOCAL ] EDF: Loaded 13415 existing records from primary storage. [2025-10-13T18:36:41.588186] [INFO ] [MAIN ] EDF: Loaded 13415 existing records. [2025-10-13T18:36:41.766899] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:41.767170] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-13T18:36:41.767219] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-13T18:36:41.767437] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-13T18:36:41.767476] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-13T18:36:42.023042] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-13T18:36:42.135205] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:42.817911] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-13T18:36:42.921953] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-13T18:36:43.272175] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T18:36:43.617959] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-13T18:36:44.417975] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-13T18:36:44.567208] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T18:36:44.734575] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T18:36:45.221587] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-13T18:36:46.017969] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-13T18:36:46.103732] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T18:36:46.108311] [INFO ] [REMOTE ] ECVT: Full fetch complete (60011 records). [2025-10-13T18:36:46.108415] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-13T18:36:46.485710] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T18:36:46.535371] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-13T18:36:46.535485] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-13T18:36:46.536349] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-13T18:36:46.536670] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-13T18:36:46.538870] [DEBUG] [LOCAL ] ECVT: Trimmed 60011 records to 43268 (keeping 200 days of data) [2025-10-13T18:36:46.787362] [DEBUG] [LOCAL ] ECVT: Primary data saved (43268 records). [2025-10-13T18:36:46.787506] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-13T18:36:46.787577] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. ECVT took 40.1s. Estimated remaining: 3h 53m 15s. Rate: 7.2 symbols/min [2025-10-13T18:36:46.831471] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-13T18:36:46.948626] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:36:47.005551] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:47.025372] [DEBUG] [LOCAL ] EDN: Loaded 18681 existing records from primary storage. [2025-10-13T18:36:47.025693] [INFO ] [MAIN ] EDN: Loaded 18681 existing records. [2025-10-13T18:36:47.210969] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:47.211225] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-13T18:36:47.211271] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-13T18:36:47.211596] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-13T18:36:47.211694] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-13T18:36:47.556251] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:47.617905] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-13T18:36:48.062232] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T18:36:48.417924] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-13T18:36:49.127604] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T18:36:49.217917] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-13T18:36:49.593982] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T18:36:50.017933] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-13T18:36:50.204591] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T18:36:50.817925] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-13T18:36:51.617895] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-13T18:36:51.851800] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T18:36:51.896937] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:36:52.417971] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-13T18:36:53.119037] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T18:36:53.218026] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-13T18:36:54.017916] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-13T18:36:54.138385] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T18:36:54.144246] [INFO ] [REMOTE ] ED: Full fetch complete (76271 records). [2025-10-13T18:36:54.144409] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-13T18:36:54.530832] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T18:36:54.656239] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-13T18:36:54.656351] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-13T18:36:54.657578] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-13T18:36:54.657704] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-13T18:36:54.660169] [DEBUG] [LOCAL ] ED: Trimmed 76271 records to 52680 (keeping 200 days of data) [2025-10-13T18:36:54.867105] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-13T18:36:55.024007] [DEBUG] [LOCAL ] ED: Primary data saved (52680 records). [2025-10-13T18:36:55.024191] [INFO ] [MAIN ] ED: Full history saved. [2025-10-13T18:36:55.024302] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. ED took 37.9s. Estimated remaining: 3h 53m 6s. Rate: 7.2 symbols/min [2025-10-13T18:36:55.194896] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:36:55.219699] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T18:36:55.265196] [DEBUG] [LOCAL ] EDU: Loaded 45535 existing records from primary storage. [2025-10-13T18:36:55.265528] [INFO ] [MAIN ] EDU: Loaded 45535 existing records. [2025-10-13T18:36:55.438430] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:36:55.438680] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-13T18:36:55.438740] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-13T18:36:55.439152] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-13T18:36:55.439210] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-13T18:36:55.624157] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-13T18:36:55.766898] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T18:36:55.833102] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:36:56.417905] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-13T18:36:56.807690] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-13T18:36:57.217998] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-13T18:36:57.474472] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T18:36:58.017907] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-13T18:36:58.160017] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T18:36:58.817959] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-13T18:36:59.033525] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T18:36:59.617975] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-13T18:37:00.006016] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T18:37:00.009116] [INFO ] [REMOTE ] EDD: Full fetch complete (38491 records). [2025-10-13T18:37:00.009194] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-13T18:37:00.376978] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-13T18:37:00.377080] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-13T18:37:00.377696] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-13T18:37:00.377756] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-13T18:37:00.378587] [DEBUG] [LOCAL ] EDD: Trimmed 38491 records to 26815 (keeping 200 days of data) [2025-10-13T18:37:00.425856] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-13T18:37:00.534632] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T18:37:00.548980] [DEBUG] [LOCAL ] EDD: Primary data saved (26815 records). [2025-10-13T18:37:00.549071] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-13T18:37:00.549138] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. EDD took 24.2s. Estimated remaining: 3h 52m 51s. Rate: 7.2 symbols/min [2025-10-13T18:37:00.716049] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:00.747875] [DEBUG] [LOCAL ] EE: Loaded 33445 existing records from primary storage. [2025-10-13T18:37:00.748193] [INFO ] [MAIN ] EE: Loaded 33445 existing records. [2025-10-13T18:37:00.923290] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:37:00.923563] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-13T18:37:00.923611] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-13T18:37:00.924007] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-13T18:37:00.924065] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-13T18:37:01.223006] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-13T18:37:01.280701] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:01.703712] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T18:37:02.018013] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-13T18:37:02.274696] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T18:37:02.817972] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-13T18:37:03.299171] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T18:37:03.617901] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-13T18:37:03.846200] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T18:37:04.417907] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-13T18:37:04.509092] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-13T18:37:05.217887] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-13T18:37:05.538143] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:37:06.017918] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-13T18:37:06.213586] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T18:37:06.817894] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-13T18:37:07.123318] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T18:37:07.617981] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-13T18:37:07.962865] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T18:37:07.965482] [INFO ] [REMOTE ] EDN: Full fetch complete (29700 records). [2025-10-13T18:37:07.965553] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-13T18:37:08.322528] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-13T18:37:08.322604] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-13T18:37:08.323206] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-13T18:37:08.323266] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-13T18:37:08.323963] [DEBUG] [LOCAL ] EDN: Trimmed 29700 records to 18698 (keeping 200 days of data) [2025-10-13T18:37:08.418803] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-13T18:37:08.430413] [DEBUG] [LOCAL ] EDN: Primary data saved (18698 records). [2025-10-13T18:37:08.430560] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-13T18:37:08.430672] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 21.6s. Estimated remaining: 3h 52m 42s. Rate: 7.2 symbols/min [2025-10-13T18:37:08.599152] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:08.599362] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-13T18:37:08.599406] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-13T18:37:08.599514] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-13T18:37:08.599555] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-13T18:37:08.599594] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-13T18:37:08.599625] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-13T18:37:08.957606] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:08.970300] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-13T18:37:09.217927] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-13T18:37:10.017935] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-13T18:37:10.578477] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-13T18:37:10.817923] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-13T18:37:10.846024] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T18:37:11.129188] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:37:11.617933] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-13T18:37:12.072153] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T18:37:12.417963] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-13T18:37:12.769125] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-13T18:37:13.217914] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-13T18:37:13.385561] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:37:14.018001] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-13T18:37:14.523675] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T18:37:14.817989] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-13T18:37:15.008995] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T18:37:15.198924] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-13T18:37:15.617999] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-13T18:37:16.041183] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T18:37:16.417960] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-13T18:37:17.217969] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-13T18:37:17.800469] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T18:37:18.017936] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-13T18:37:18.742235] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T18:37:18.817993] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-13T18:37:18.887068] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T18:37:19.299409] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-13T18:37:19.617913] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-13T18:37:20.121986] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-13T18:37:20.417928] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-13T18:37:20.974690] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T18:37:21.217930] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-13T18:37:22.017925] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-13T18:37:22.423820] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T18:37:22.817969] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-13T18:37:22.949886] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T18:37:23.618015] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-13T18:37:24.053467] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T18:37:24.417929] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-13T18:37:25.082466] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:37:25.218006] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-13T18:37:25.281412] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T18:37:26.017989] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-13T18:37:26.817909] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-13T18:37:26.855340] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:37:27.065777] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T18:37:27.617924] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-13T18:37:27.670137] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T18:37:28.417932] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-13T18:37:29.083423] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T18:37:29.106843] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T18:37:29.108443] [INFO ] [REMOTE ] EDF: Full fetch complete (20398 records). [2025-10-13T18:37:29.108512] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-13T18:37:29.109038] [FATAL] [VALIDATOR ] EDF: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:37:29.109122] [FATAL] [MAIN ] EDF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:37:29.109163] [WARN ] [MAIN ] EDF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:37:29.109225] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-13T18:37:29.109311] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-13T18:37:29.109367] [INFO ] [LOCAL ] EDF: Starting deletion of derivative data. [2025-10-13T18:37:29.109534] [DEBUG] [LOCAL ] EDF: Deleted derivative data file. [2025-10-13T18:37:29.109622] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EDF took 47.8s. Estimated remaining: 3h 53m 3s. Rate: 7.2 symbols/min [2025-10-13T18:37:29.223081] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-13T18:37:29.296389] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:29.309399] [DEBUG] [LOCAL ] EEX: Loaded 10898 existing records from primary storage. [2025-10-13T18:37:29.309762] [INFO ] [MAIN ] EEX: Loaded 10898 existing records. [2025-10-13T18:37:29.496601] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:37:29.496885] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-13T18:37:29.496939] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-13T18:37:29.497545] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-13T18:37:29.497603] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-13T18:37:29.911243] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:30.017984] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-13T18:37:30.542991] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T18:37:30.817912] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-13T18:37:30.947536] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:37:31.617928] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-13T18:37:32.417912] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-13T18:37:32.539236] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T18:37:32.972572] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T18:37:32.972922] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T18:37:32.979728] [INFO ] [REMOTE ] EE: Full fetch complete (43968 records). [2025-10-13T18:37:32.979913] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-13T18:37:33.223221] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-13T18:37:33.378839] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-13T18:37:33.378947] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-13T18:37:33.379866] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-13T18:37:33.379934] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-13T18:37:33.381311] [DEBUG] [LOCAL ] EE: Trimmed 43968 records to 33066 (keeping 200 days of data) [2025-10-13T18:37:33.578480] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-13T18:37:33.598611] [DEBUG] [LOCAL ] EE: Primary data saved (33066 records). [2025-10-13T18:37:33.598866] [INFO ] [MAIN ] EE: Full history saved. [2025-10-13T18:37:33.598980] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EE took 33.0s. Estimated remaining: 3h 52m 45s. Rate: 7.2 symbols/min [2025-10-13T18:37:33.783559] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:33.833531] [DEBUG] [LOCAL ] EFC: Loaded 47108 existing records from primary storage. [2025-10-13T18:37:33.834054] [INFO ] [MAIN ] EFC: Loaded 47108 existing records. [2025-10-13T18:37:34.019131] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-13T18:37:34.023395] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:37:34.024736] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-13T18:37:34.024797] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-13T18:37:34.025339] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-13T18:37:34.025413] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-13T18:37:34.384705] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:34.817920] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-13T18:37:35.293787] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-13T18:37:35.294608] [INFO ] [REMOTE ] EEA: Full fetch complete (3855 records). [2025-10-13T18:37:35.294700] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-13T18:37:35.473314] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T18:37:35.473708] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:37:35.473889] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:37:35.474047] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-13T18:37:35.474144] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-13T18:37:35.474260] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-13T18:37:35.474371] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-13T18:37:35.474524] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EEA took 27.0s. Estimated remaining: 3h 52m 21s. Rate: 7.2 symbols/min [2025-10-13T18:37:35.621965] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-13T18:37:35.677708] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:35.681661] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:37:35.704943] [DEBUG] [LOCAL ] EFR: Loaded 15218 existing records from primary storage. [2025-10-13T18:37:35.705183] [INFO ] [MAIN ] EFR: Loaded 15218 existing records. [2025-10-13T18:37:35.887383] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:37:35.887673] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-13T18:37:35.887741] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-13T18:37:35.888063] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-13T18:37:35.888127] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-13T18:37:36.246479] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:36.418033] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-13T18:37:36.632989] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T18:37:37.217906] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-13T18:37:38.017931] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-13T18:37:38.146520] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T18:37:38.278328] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T18:37:38.817902] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-13T18:37:38.982590] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T18:37:39.562085] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T18:37:39.617937] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-13T18:37:40.336989] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T18:37:40.417894] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-13T18:37:41.222283] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-13T18:37:41.540304] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T18:37:42.017989] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-13T18:37:42.817919] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-13T18:37:42.981543] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-13T18:37:43.047175] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T18:37:43.617916] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-13T18:37:44.067743] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T18:37:44.072152] [INFO ] [REMOTE ] EDU: Full fetch complete (66289 records). [2025-10-13T18:37:44.072275] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-13T18:37:44.073038] [FATAL] [VALIDATOR ] EDU: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:37:44.073150] [FATAL] [MAIN ] EDU: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:37:44.073219] [WARN ] [MAIN ] EDU: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:37:44.073298] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-13T18:37:44.073361] [DEBUG] [LOCAL ] EDU: No primary data file found to delete. [2025-10-13T18:37:44.073397] [INFO ] [LOCAL ] EDU: Starting deletion of derivative data. [2025-10-13T18:37:44.073580] [DEBUG] [LOCAL ] EDU: Deleted derivative data file. [2025-10-13T18:37:44.073705] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EDU took 49.0s. Estimated remaining: 3h 52m 14s. Rate: 7.2 symbols/min [2025-10-13T18:37:44.240806] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:37:44.241065] [DEBUG] [LOCAL ] EFT: No existing data file found in primary storage. [2025-10-13T18:37:44.241192] [WARN ] [MAIN ] EFT: No existing data found, performing full refresh instead. [2025-10-13T18:37:44.241303] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-13T18:37:44.241344] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-13T18:37:44.241385] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-10-13T18:37:44.241416] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-13T18:37:44.423191] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-13T18:37:44.499141] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T18:37:44.611918] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:37:45.217920] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-13T18:37:45.911449] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T18:37:46.017998] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-13T18:37:46.086669] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T18:37:46.817984] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-13T18:37:46.885219] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T18:37:47.617982] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-13T18:37:48.372121] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T18:37:48.417907] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-13T18:37:49.217965] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-13T18:37:49.255513] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T18:37:49.342414] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T18:37:49.978280] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T18:37:50.017925] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-13T18:37:50.817925] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-13T18:37:50.969941] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-13T18:37:51.618022] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-13T18:37:52.418000] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-13T18:37:52.468062] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T18:37:52.542400] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T18:37:53.145525] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-13T18:37:53.218006] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-13T18:37:53.974774] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-13T18:37:54.017965] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-13T18:37:54.673391] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T18:37:54.817982] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-13T18:37:55.378290] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T18:37:55.617974] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-13T18:37:56.183822] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T18:37:56.418025] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-13T18:37:57.018495] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-13T18:37:57.217963] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-13T18:37:58.018017] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-13T18:37:58.817935] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-13T18:37:58.878996] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T18:37:59.203096] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T18:37:59.369518] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T18:37:59.371029] [INFO ] [REMOTE ] EEX: Full fetch complete (18654 records). [2025-10-13T18:37:59.371175] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-13T18:37:59.623176] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-13T18:37:59.748346] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-13T18:37:59.748454] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-13T18:37:59.749359] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-13T18:37:59.749428] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-13T18:37:59.750091] [DEBUG] [LOCAL ] EEX: Trimmed 18654 records to 10407 (keeping 200 days of data) [2025-10-13T18:37:59.814835] [DEBUG] [LOCAL ] EEX: Primary data saved (10407 records). [2025-10-13T18:37:59.815020] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-13T18:37:59.815181] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EEX took 30.7s. Estimated remaining: 3h 52m 23s. Rate: 7.2 symbols/min [2025-10-13T18:38:00.002500] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:00.054168] [DEBUG] [LOCAL ] EFX: Loaded 45270 existing records from primary storage. [2025-10-13T18:38:00.054553] [INFO ] [MAIN ] EFX: Loaded 45270 existing records. [2025-10-13T18:38:00.239505] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:00.239746] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-13T18:38:00.239805] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-13T18:38:00.240875] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-13T18:38:00.240948] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-13T18:38:00.426403] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-13T18:38:00.595261] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:01.035617] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:38:01.218050] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-13T18:38:02.017971] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-13T18:38:02.377161] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T18:38:02.817974] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-13T18:38:02.912101] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T18:38:03.167724] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T18:38:03.617922] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-13T18:38:03.678271] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T18:38:04.417981] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-13T18:38:05.217914] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-13T18:38:05.415060] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T18:38:05.417539] [INFO ] [REMOTE ] EFR: Full fetch complete (19284 records). [2025-10-13T18:38:05.417619] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-13T18:38:05.707267] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-13T18:38:05.868923] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-13T18:38:05.869025] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-13T18:38:05.869718] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-13T18:38:05.869784] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-13T18:38:05.870699] [DEBUG] [LOCAL ] EFR: Trimmed 19284 records to 15082 (keeping 200 days of data) [2025-10-13T18:38:05.972261] [DEBUG] [LOCAL ] EFR: Primary data saved (15082 records). [2025-10-13T18:38:05.972477] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-13T18:38:05.972598] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFR took 30.5s. Estimated remaining: 3h 52m 9s. Rate: 7.2 symbols/min [2025-10-13T18:38:06.029152] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-13T18:38:06.146038] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:06.183219] [DEBUG] [LOCAL ] EFXT: Loaded 29929 existing records from primary storage. [2025-10-13T18:38:06.183592] [INFO ] [MAIN ] EFXT: Loaded 29929 existing records. [2025-10-13T18:38:06.373284] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:06.373599] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-13T18:38:06.373682] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-13T18:38:06.374088] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-13T18:38:06.374145] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-13T18:38:06.757282] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:06.786242] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T18:38:06.817912] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-13T18:38:07.088805] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-13T18:38:07.618002] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-13T18:38:08.417908] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-13T18:38:08.518901] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T18:38:09.164143] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T18:38:09.217935] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-13T18:38:09.271056] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T18:38:10.008185] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T18:38:10.017871] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-13T18:38:10.765455] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T18:38:10.817888] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-13T18:38:11.617906] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-13T18:38:11.744208] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T18:38:11.746348] [INFO ] [REMOTE ] EFT: Full fetch complete (18015 records). [2025-10-13T18:38:11.746421] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-13T18:38:12.108137] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-13T18:38:12.108212] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-13T18:38:12.108627] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-13T18:38:12.108709] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-13T18:38:12.109300] [DEBUG] [LOCAL ] EFT: Trimmed 18015 records to 13195 (keeping 200 days of data) [2025-10-13T18:38:12.195630] [DEBUG] [LOCAL ] EFT: Primary data saved (13195 records). [2025-10-13T18:38:12.195804] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-13T18:38:12.195876] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFT took 28.1s. Estimated remaining: 3h 51m 56s. Rate: 7.2 symbols/min [2025-10-13T18:38:12.362775] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:12.390430] [DEBUG] [LOCAL ] EG: Loaded 28194 existing records from primary storage. [2025-10-13T18:38:12.390746] [INFO ] [MAIN ] EG: Loaded 28194 existing records. [2025-10-13T18:38:12.423205] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-13T18:38:12.568387] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:12.568640] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-13T18:38:12.568726] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-13T18:38:12.569170] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-13T18:38:12.569238] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-13T18:38:12.918534] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:13.059247] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T18:38:13.217923] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-13T18:38:14.017922] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-13T18:38:14.503098] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-13T18:38:14.817985] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-13T18:38:14.966119] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T18:38:15.617911] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-13T18:38:15.648423] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:38:16.309599] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T18:38:16.417882] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-13T18:38:16.853482] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-13T18:38:17.218017] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-13T18:38:17.803826] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T18:38:18.017934] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-13T18:38:18.398458] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T18:38:18.817910] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-13T18:38:19.497295] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T18:38:19.617928] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-13T18:38:19.903081] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T18:38:20.417909] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-13T18:38:21.056147] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T18:38:21.218000] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-13T18:38:21.897833] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:38:21.902829] [INFO ] [REMOTE ] EFC: Full fetch complete (66618 records). [2025-10-13T18:38:21.902938] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-13T18:38:22.023084] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-13T18:38:22.277515] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-13T18:38:22.277598] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-13T18:38:22.278488] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-13T18:38:22.278553] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-13T18:38:22.279898] [DEBUG] [LOCAL ] EFC: Trimmed 66618 records to 46412 (keeping 200 days of data) [2025-10-13T18:38:22.559730] [DEBUG] [LOCAL ] EFC: Primary data saved (46412 records). [2025-10-13T18:38:22.559862] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-13T18:38:22.559940] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFC took 49.0s. Estimated remaining: 3h 51m 52s. Rate: 7.2 symbols/min [2025-10-13T18:38:22.724330] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:22.774182] [DEBUG] [LOCAL ] EGO: Loaded 52453 existing records from primary storage. [2025-10-13T18:38:22.774518] [INFO ] [MAIN ] EGO: Loaded 52453 existing records. [2025-10-13T18:38:22.827410] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-13T18:38:22.952304] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:22.952632] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-13T18:38:22.952723] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-13T18:38:22.953270] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-13T18:38:22.953327] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-13T18:38:23.157347] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T18:38:23.293259] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T18:38:23.375888] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:23.617888] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-13T18:38:24.072928] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T18:38:24.417997] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-13T18:38:25.165306] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T18:38:25.217981] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-13T18:38:26.017985] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-13T18:38:26.042925] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T18:38:26.494087] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T18:38:26.817919] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-13T18:38:27.617917] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-13T18:38:27.813951] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T18:38:27.911507] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T18:38:28.417915] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-13T18:38:28.934081] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T18:38:29.217892] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-13T18:38:29.906856] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T18:38:30.017890] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-13T18:38:30.172916] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T18:38:30.817918] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-13T18:38:31.617895] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-13T18:38:31.692404] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T18:38:32.417889] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-13T18:38:32.459807] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:38:32.464266] [INFO ] [REMOTE ] EFX: Full fetch complete (64244 records). [2025-10-13T18:38:32.464352] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-13T18:38:32.465152] [FATAL] [VALIDATOR ] EFX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:38:32.465236] [FATAL] [MAIN ] EFX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:38:32.465277] [WARN ] [MAIN ] EFX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:38:32.465314] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-13T18:38:32.465367] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-10-13T18:38:32.465402] [INFO ] [LOCAL ] EFX: Starting deletion of derivative data. [2025-10-13T18:38:32.465569] [DEBUG] [LOCAL ] EFX: Deleted derivative data file. [2025-10-13T18:38:32.465712] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EFX took 32.7s. Estimated remaining: 3h 51m 47s. Rate: 7.2 symbols/min [2025-10-13T18:38:32.625715] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T18:38:32.649990] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:32.687400] [DEBUG] [LOCAL ] EGP: Loaded 31009 existing records from primary storage. [2025-10-13T18:38:32.687684] [INFO ] [MAIN ] EGP: Loaded 31009 existing records. [2025-10-13T18:38:32.860958] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:32.861166] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-13T18:38:32.861211] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-13T18:38:32.861601] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-13T18:38:32.861690] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-13T18:38:33.208842] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:33.217885] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-13T18:38:33.880240] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T18:38:34.017882] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-13T18:38:34.628071] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T18:38:34.817970] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-13T18:38:35.579984] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T18:38:35.617909] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-13T18:38:36.238279] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T18:38:36.417903] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-13T18:38:37.227759] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-13T18:38:37.247022] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T18:38:37.970293] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T18:38:38.017883] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-13T18:38:38.547603] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T18:38:38.817918] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-13T18:38:39.396885] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T18:38:39.617901] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-13T18:38:40.160690] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T18:38:40.164245] [INFO ] [REMOTE ] EFXT: Full fetch complete (44063 records). [2025-10-13T18:38:40.164316] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-13T18:38:40.423089] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-13T18:38:40.537914] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-13T18:38:40.538035] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-13T18:38:40.538637] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-13T18:38:40.538727] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-13T18:38:40.539621] [DEBUG] [LOCAL ] EFXT: Trimmed 44063 records to 29521 (keeping 200 days of data) [2025-10-13T18:38:40.710248] [DEBUG] [LOCAL ] EFXT: Primary data saved (29521 records). [2025-10-13T18:38:40.710375] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-13T18:38:40.711239] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EFXT took 34.7s. Estimated remaining: 3h 51m 39s. Rate: 7.2 symbols/min [2025-10-13T18:38:40.898741] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:40.940325] [DEBUG] [LOCAL ] EGY: Loaded 42345 existing records from primary storage. [2025-10-13T18:38:40.940781] [INFO ] [MAIN ] EGY: Loaded 42345 existing records. [2025-10-13T18:38:41.037730] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T18:38:41.138681] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:41.138907] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-13T18:38:41.138952] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-13T18:38:41.139344] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-13T18:38:41.139399] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-13T18:38:41.227356] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-13T18:38:41.490018] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:42.017978] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-13T18:38:42.309075] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T18:38:42.590312] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T18:38:42.817933] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-13T18:38:43.618006] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-13T18:38:43.763561] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T18:38:44.184342] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T18:38:44.417905] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-13T18:38:44.741792] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T18:38:45.218037] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-13T18:38:46.017912] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-13T18:38:46.136504] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:38:46.670144] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T18:38:46.817908] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-13T18:38:47.480955] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:38:47.617918] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-13T18:38:48.147723] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T18:38:48.154726] [INFO ] [REMOTE ] EG: Full fetch complete (43078 records). [2025-10-13T18:38:48.154898] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-13T18:38:48.423109] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-13T18:38:48.530690] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-13T18:38:48.530776] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-13T18:38:48.531383] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-13T18:38:48.531423] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-13T18:38:48.532308] [DEBUG] [LOCAL ] EG: Trimmed 43078 records to 27796 (keeping 200 days of data) [2025-10-13T18:38:48.703972] [DEBUG] [LOCAL ] EG: Primary data saved (27796 records). [2025-10-13T18:38:48.704116] [INFO ] [MAIN ] EG: Full history saved. [2025-10-13T18:38:48.704193] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EG took 36.5s. Estimated remaining: 3h 51m 30s. Rate: 7.2 symbols/min [2025-10-13T18:38:48.897075] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:38:48.927498] [DEBUG] [LOCAL ] EHAB: Loaded 29667 existing records from primary storage. [2025-10-13T18:38:48.927808] [INFO ] [MAIN ] EHAB: Loaded 29667 existing records. [2025-10-13T18:38:49.105854] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:38:49.106220] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-13T18:38:49.106269] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-13T18:38:49.106612] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-13T18:38:49.106702] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-13T18:38:49.222565] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-13T18:38:49.450366] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T18:38:49.498887] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:38:50.018006] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-13T18:38:50.371023] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T18:38:50.638005] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T18:38:50.817972] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-13T18:38:51.178076] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T18:38:51.617969] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-13T18:38:52.098967] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T18:38:52.417986] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-13T18:38:52.954604] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T18:38:53.217981] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-13T18:38:54.017910] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-13T18:38:54.281731] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T18:38:54.308959] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T18:38:54.818027] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-13T18:38:55.617910] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-13T18:38:55.701897] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T18:38:56.236801] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T18:38:56.417908] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-13T18:38:56.695719] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T18:38:57.217973] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-13T18:38:57.669571] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T18:38:58.017929] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-13T18:38:58.356136] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T18:38:58.817986] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-13T18:38:59.606297] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T18:38:59.617931] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-13T18:39:00.153778] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T18:39:00.417936] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-13T18:39:00.950288] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T18:39:01.217989] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-13T18:39:01.596750] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T18:39:02.017930] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-13T18:39:02.554220] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T18:39:02.817996] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-13T18:39:03.514576] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T18:39:03.617911] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-13T18:39:04.178123] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:39:04.418013] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-13T18:39:04.933423] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T18:39:05.217935] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-13T18:39:06.018032] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-13T18:39:06.311886] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-13T18:39:06.317364] [INFO ] [REMOTE ] EGO: Full fetch complete (73985 records). [2025-10-13T18:39:06.317501] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-13T18:39:06.496060] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T18:39:06.730470] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-13T18:39:06.730556] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-13T18:39:06.731439] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-13T18:39:06.731507] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-13T18:39:06.733010] [DEBUG] [LOCAL ] EGO: Trimmed 73985 records to 51689 (keeping 200 days of data) [2025-10-13T18:39:06.819960] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-13T18:39:07.042105] [DEBUG] [LOCAL ] EGO: Primary data saved (51689 records). [2025-10-13T18:39:07.042267] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-13T18:39:07.042383] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGO took 44.5s. Estimated remaining: 3h 51m 45s. Rate: 7.2 symbols/min [2025-10-13T18:39:07.209623] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:07.250915] [DEBUG] [LOCAL ] EHC: Loaded 41702 existing records from primary storage. [2025-10-13T18:39:07.251228] [INFO ] [MAIN ] EHC: Loaded 41702 existing records. [2025-10-13T18:39:07.429511] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:39:07.429936] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-13T18:39:07.430147] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-13T18:39:07.430732] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-13T18:39:07.430797] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-13T18:39:07.619481] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-13T18:39:07.725214] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T18:39:07.849402] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:08.417981] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-13T18:39:08.460457] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T18:39:08.899024] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T18:39:08.902362] [INFO ] [REMOTE ] EGP: Full fetch complete (45278 records). [2025-10-13T18:39:08.902496] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-13T18:39:09.225564] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-13T18:39:09.331852] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-13T18:39:09.331995] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-13T18:39:09.333037] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-13T18:39:09.333103] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-13T18:39:09.334409] [DEBUG] [LOCAL ] EGP: Trimmed 45278 records to 30338 (keeping 200 days of data) [2025-10-13T18:39:09.548626] [DEBUG] [LOCAL ] EGP: Primary data saved (30338 records). [2025-10-13T18:39:09.548854] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-13T18:39:09.548960] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EGP took 37.1s. Estimated remaining: 3h 51m 23s. Rate: 7.2 symbols/min [2025-10-13T18:39:09.748230] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:09.762556] [DEBUG] [LOCAL ] EHI: Loaded 10815 existing records from primary storage. [2025-10-13T18:39:09.762852] [INFO ] [MAIN ] EHI: Loaded 10815 existing records. [2025-10-13T18:39:09.970734] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:39:09.971274] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-13T18:39:09.971336] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-13T18:39:09.983127] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-13T18:39:09.988504] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-13T18:39:10.023246] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-13T18:39:10.080581] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:39:10.380946] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:10.823030] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-13T18:39:10.837308] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T18:39:11.454265] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T18:39:11.617935] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-13T18:39:12.039526] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T18:39:12.417939] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-13T18:39:12.778571] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T18:39:13.217912] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-13T18:39:13.425872] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T18:39:14.018025] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-13T18:39:14.817918] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-13T18:39:14.843225] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T18:39:14.971024] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T18:39:14.973689] [INFO ] [REMOTE ] EHAB: Full fetch complete (40916 records). [2025-10-13T18:39:14.973765] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-13T18:39:15.337304] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-13T18:39:15.337383] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-13T18:39:15.337998] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-13T18:39:15.338062] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-13T18:39:15.338992] [DEBUG] [LOCAL ] EHAB: Trimmed 40916 records to 29307 (keeping 200 days of data) [2025-10-13T18:39:15.502809] [DEBUG] [LOCAL ] EHAB: Primary data saved (29307 records). [2025-10-13T18:39:15.502970] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-13T18:39:15.503058] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHAB took 26.8s. Estimated remaining: 3h 51m 9s. Rate: 7.2 symbols/min [2025-10-13T18:39:15.623279] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-13T18:39:15.674522] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:15.695572] [DEBUG] [LOCAL ] EIC: Loaded 23309 existing records from primary storage. [2025-10-13T18:39:15.695832] [INFO ] [MAIN ] EIC: Loaded 23309 existing records. [2025-10-13T18:39:15.809764] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T18:39:15.890749] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:39:15.891073] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-13T18:39:15.891139] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-13T18:39:15.891495] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-13T18:39:15.891551] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-13T18:39:16.261445] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:16.417990] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-13T18:39:17.217968] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-13T18:39:17.310506] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T18:39:17.697440] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-13T18:39:18.018011] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-13T18:39:18.713225] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T18:39:18.817928] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-13T18:39:19.586822] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T18:39:19.590803] [INFO ] [REMOTE ] EGY: Full fetch complete (60727 records). [2025-10-13T18:39:19.590890] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-13T18:39:19.591571] [FATAL] [VALIDATOR ] EGY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:39:19.591696] [FATAL] [MAIN ] EGY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:39:19.591768] [WARN ] [MAIN ] EGY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:39:19.591854] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-13T18:39:19.591921] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-13T18:39:19.591964] [INFO ] [LOCAL ] EGY: Starting deletion of derivative data. [2025-10-13T18:39:19.592157] [DEBUG] [LOCAL ] EGY: Deleted derivative data file. [2025-10-13T18:39:19.592918] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EGY took 38.9s. Estimated remaining: 3h 50m 50s. Rate: 7.2 symbols/min [2025-10-13T18:39:19.623119] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-13T18:39:19.763764] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:19.763977] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-13T18:39:19.764017] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-13T18:39:19.764129] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-13T18:39:19.764193] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-13T18:39:19.764235] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-13T18:39:19.764268] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-13T18:39:20.120716] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:20.219189] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T18:39:20.256232] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T18:39:20.417924] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-13T18:39:21.217970] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-13T18:39:21.588322] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:39:21.904014] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T18:39:22.017989] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-13T18:39:22.817923] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-13T18:39:23.521162] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:39:23.607009] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T18:39:23.617888] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-13T18:39:24.417900] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-13T18:39:24.664150] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T18:39:25.217919] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-13T18:39:25.828707] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:39:26.017990] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-13T18:39:26.255104] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T18:39:26.474703] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-13T18:39:26.817912] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-13T18:39:27.230133] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-13T18:39:27.617928] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-13T18:39:28.417929] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-13T18:39:29.201116] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T18:39:29.217876] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-13T18:39:29.767144] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T18:39:30.018008] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-13T18:39:30.666176] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T18:39:30.817927] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-13T18:39:31.129126] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:39:31.617971] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-13T18:39:32.198628] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T18:39:32.411944] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T18:39:32.417880] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-13T18:39:33.217902] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-13T18:39:33.230002] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T18:39:33.473101] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-13T18:39:34.017934] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-13T18:39:34.341398] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-13T18:39:34.817918] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-13T18:39:35.617922] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-13T18:39:35.998925] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T18:39:36.417970] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-13T18:39:37.138765] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T18:39:37.142819] [INFO ] [REMOTE ] EHC: Full fetch complete (58649 records). [2025-10-13T18:39:37.142913] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-13T18:39:37.223117] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-13T18:39:37.540394] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-13T18:39:37.540506] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-13T18:39:37.541370] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-13T18:39:37.541436] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-13T18:39:37.542620] [DEBUG] [LOCAL ] EHC: Trimmed 58649 records to 41048 (keeping 200 days of data) [2025-10-13T18:39:37.657712] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T18:39:37.788328] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T18:39:37.828022] [DEBUG] [LOCAL ] EHC: Primary data saved (41048 records). [2025-10-13T18:39:37.828163] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-13T18:39:37.828238] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EHC took 30.8s. Estimated remaining: 3h 51m 5s. Rate: 7.2 symbols/min [2025-10-13T18:39:37.993016] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:37.993226] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-13T18:39:37.993268] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-13T18:39:37.993376] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-13T18:39:37.993418] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-13T18:39:37.993458] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-13T18:39:37.993490] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-13T18:39:38.023127] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-13T18:39:38.348518] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:38.358622] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-13T18:39:38.817910] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-13T18:39:39.617927] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-13T18:39:39.935249] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-13T18:39:40.198515] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T18:39:40.417935] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-13T18:39:41.217926] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-13T18:39:41.400475] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T18:39:41.733890] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T18:39:42.017918] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-13T18:39:42.627182] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T18:39:42.817914] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-13T18:39:43.253808] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-13T18:39:43.617934] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-13T18:39:43.975214] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-13T18:39:44.417929] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-13T18:39:44.747609] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-13T18:39:45.217925] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-13T18:39:45.632284] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-13T18:39:46.018058] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-13T18:39:46.453215] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-13T18:39:46.818013] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-13T18:39:47.617983] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-13T18:39:47.738356] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T18:39:48.030126] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-13T18:39:48.417930] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-13T18:39:48.830314] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-13T18:39:48.831025] [INFO ] [REMOTE ] EICA: Full fetch complete (1279 records). [2025-10-13T18:39:48.831091] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-13T18:39:49.003638] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-13T18:39:49.003889] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:39:49.003971] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:39:49.004019] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-13T18:39:49.004076] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-13T18:39:49.004109] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-13T18:39:49.004148] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-13T18:39:49.004203] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EICA took 29.4s. Estimated remaining: 3h 51m 3s. Rate: 7.2 symbols/min [2025-10-13T18:39:49.169720] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:49.169932] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-13T18:39:49.169969] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-13T18:39:49.170076] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-13T18:39:49.170115] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-13T18:39:49.170154] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-13T18:39:49.170184] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-13T18:39:49.223389] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-13T18:39:49.526568] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:50.017924] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-13T18:39:50.041379] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T18:39:50.043920] [INFO ] [REMOTE ] EHI: Full fetch complete (16164 records). [2025-10-13T18:39:50.044030] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-13T18:39:50.434267] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-13T18:39:50.434937] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-13T18:39:50.435007] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-13T18:39:50.436848] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-13T18:39:50.436915] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-13T18:39:50.437477] [DEBUG] [LOCAL ] EHI: Trimmed 16164 records to 10658 (keeping 200 days of data) [2025-10-13T18:39:50.499457] [DEBUG] [LOCAL ] EHI: Primary data saved (10658 records). [2025-10-13T18:39:50.499602] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-13T18:39:50.499701] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EHI took 41.0s. Estimated remaining: 3h 50m 39s. Rate: 7.2 symbols/min [2025-10-13T18:39:50.669962] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:39:50.689019] [DEBUG] [LOCAL ] EIG: Loaded 20468 existing records from primary storage. [2025-10-13T18:39:50.689264] [INFO ] [MAIN ] EIG: Loaded 20468 existing records. [2025-10-13T18:39:50.830214] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-13T18:39:50.871862] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:39:50.872072] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-13T18:39:50.872117] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-13T18:39:50.872389] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-13T18:39:50.872427] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-13T18:39:51.221673] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:39:51.617939] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-13T18:39:51.949744] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T18:39:51.982797] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-13T18:39:52.417989] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-13T18:39:52.930364] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-13T18:39:53.217970] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-13T18:39:54.017900] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-13T18:39:54.166079] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-13T18:39:54.817912] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-13T18:39:54.836825] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T18:39:54.839071] [INFO ] [REMOTE ] EIC: Full fetch complete (34430 records). [2025-10-13T18:39:54.839143] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-13T18:39:55.213754] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-13T18:39:55.213845] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-13T18:39:55.214372] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-13T18:39:55.214413] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-13T18:39:55.215183] [DEBUG] [LOCAL ] EIC: Trimmed 34430 records to 22931 (keeping 200 days of data) [2025-10-13T18:39:55.354676] [DEBUG] [LOCAL ] EIC: Primary data saved (22931 records). [2025-10-13T18:39:55.354812] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-13T18:39:55.354890] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EIC took 39.9s. Estimated remaining: 3h 50m 22s. Rate: 7.2 symbols/min [2025-10-13T18:39:55.390551] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T18:39:55.617934] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-13T18:39:56.179906] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T18:39:56.417991] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-13T18:39:56.977801] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T18:39:57.217937] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-13T18:39:57.838701] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T18:39:58.017930] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-13T18:39:58.579335] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T18:39:58.817922] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-13T18:39:59.405697] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T18:39:59.617986] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-13T18:40:00.201174] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T18:40:00.417992] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-13T18:40:01.088362] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T18:40:01.218029] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-13T18:40:01.868349] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T18:40:02.018005] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-13T18:40:02.817933] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-13T18:40:03.072409] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T18:40:03.279310] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T18:40:03.618030] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-13T18:40:04.417978] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-13T18:40:04.840574] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T18:40:04.881888] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T18:40:05.217917] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-13T18:40:06.018053] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-13T18:40:06.296091] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T18:40:06.700066] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T18:40:06.817897] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-13T18:40:07.576577] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T18:40:07.617904] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-13T18:40:08.172938] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T18:40:08.174149] [INFO ] [REMOTE ] EICC: Full fetch complete (8402 records). [2025-10-13T18:40:08.174242] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-13T18:40:08.174615] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:40:08.174713] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:40:08.174756] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:40:08.174793] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-13T18:40:08.174846] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-13T18:40:08.174879] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-13T18:40:08.174918] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-13T18:40:08.175054] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICC took 19.2s. Estimated remaining: 3h 50m 24s. Rate: 7.2 symbols/min [2025-10-13T18:40:08.417991] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-13T18:40:09.013770] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T18:40:09.014559] [INFO ] [REMOTE ] EICB: Full fetch complete (2707 records). [2025-10-13T18:40:09.014626] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-13T18:40:09.188445] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T18:40:09.188691] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:40:09.188760] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:40:09.188829] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-13T18:40:09.188898] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-13T18:40:09.188933] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-13T18:40:09.188971] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-13T18:40:09.189045] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EICB took 31.4s. Estimated remaining: 3h 49m 59s. Rate: 7.2 symbols/min [2025-10-13T18:40:09.217912] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-13T18:40:10.193818] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T18:40:10.198502] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-13T18:40:11.359495] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T18:40:11.364687] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-13T18:40:12.230874] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T18:40:12.235513] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-13T18:40:13.370283] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T18:40:13.375311] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-13T18:40:14.494416] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T18:40:14.500698] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-13T18:40:15.466510] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:40:15.471192] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-13T18:40:16.413739] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T18:40:16.416021] [INFO ] [REMOTE ] EIG: Full fetch complete (26987 records). [2025-10-13T18:40:16.416103] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-13T18:40:16.797884] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-13T18:40:16.798257] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-13T18:40:16.799008] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-13T18:40:16.799074] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-13T18:40:16.801345] [DEBUG] [LOCAL ] EIG: Trimmed 26987 records to 20178 (keeping 200 days of data) [2025-10-13T18:40:16.943940] [DEBUG] [LOCAL ] EIG: Primary data saved (20178 records). [2025-10-13T18:40:16.944091] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-13T18:40:16.944212] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIG took 26.4s. Estimated remaining: 3h 49m 49s. Rate: 7.2 symbols/min [2025-10-13T18:40:17.605676] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:17.740014] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:17.722542] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:17.743110] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:17.756219] [DEBUG] [LOCAL ] ELC: Loaded 3552 existing records from primary storage. [2025-10-13T18:40:17.756530] [INFO ] [MAIN ] ELC: Loaded 3552 existing records. [2025-10-13T18:40:17.990543] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:18.024145] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-13T18:40:18.024264] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-13T18:40:18.025281] [DEBUG] [LOCAL ] EL: Loaded 54147 existing records from primary storage. [2025-10-13T18:40:18.026215] [INFO ] [MAIN ] EL: Loaded 54147 existing records. [2025-10-13T18:40:18.049093] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-13T18:40:18.063395] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-13T18:40:18.232430] [DEBUG] [LOCAL ] ELAN: Loaded 54069 existing records from primary storage. [2025-10-13T18:40:18.258353] [INFO ] [MAIN ] ELAN: Loaded 54069 existing records. [2025-10-13T18:40:18.320999] [DEBUG] [LOCAL ] EIX: Loaded 54125 existing records from primary storage. [2025-10-13T18:40:18.379081] [INFO ] [MAIN ] EIX: Loaded 54125 existing records. [2025-10-13T18:40:18.403721] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:18.489718] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-13T18:40:18.525280] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-13T18:40:18.688105] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-13T18:40:18.791026] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-13T18:40:18.936733] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:19.040968] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:19.094193] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-13T18:40:19.056050] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-13T18:40:19.123177] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-13T18:40:19.123047] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-13T18:40:19.155716] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-13T18:40:19.162442] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-13T18:40:19.162302] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:19.163418] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-13T18:40:19.202023] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-13T18:40:19.221481] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-13T18:40:19.960939] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:20.006510] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-13T18:40:20.168921] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:20.207636] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-13T18:40:20.230730] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:20.231123] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-13T18:40:20.337113] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T18:40:20.338973] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-13T18:40:20.903296] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T18:40:20.904920] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-13T18:40:21.438428] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-13T18:40:21.439947] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-13T18:40:21.864948] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T18:40:21.876571] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-13T18:40:21.928673] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:40:21.940616] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-13T18:40:22.024783] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T18:40:22.029945] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-13T18:40:22.033179] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-13T18:40:22.610703] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T18:40:22.817997] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-13T18:40:23.333338] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-13T18:40:23.608785] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T18:40:23.619059] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-13T18:40:23.812861] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-13T18:40:23.970624] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-13T18:40:24.418015] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-13T18:40:25.000124] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T18:40:25.217925] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-13T18:40:26.017939] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-13T18:40:26.817972] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-13T18:40:26.900334] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T18:40:27.294415] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T18:40:27.617906] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-13T18:40:27.653302] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:40:28.124196] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-13T18:40:28.417930] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-13T18:40:29.217977] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-13T18:40:29.735321] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T18:40:29.736483] [INFO ] [REMOTE ] ELC: Full fetch complete (5043 records). [2025-10-13T18:40:29.736556] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-13T18:40:30.019737] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-13T18:40:30.120635] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-13T18:40:30.120786] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-13T18:40:30.121093] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-13T18:40:30.121136] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-13T18:40:30.121568] [DEBUG] [LOCAL ] ELC: Trimmed 5043 records to 3505 (keeping 200 days of data) [2025-10-13T18:40:30.144809] [DEBUG] [LOCAL ] ELC: Primary data saved (3505 records). [2025-10-13T18:40:30.144928] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-13T18:40:30.145040] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 13.2s. Estimated remaining: 3h 49m 52s. Rate: 7.2 symbols/min [2025-10-13T18:40:30.327615] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:30.361944] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T18:40:30.428326] [DEBUG] [LOCAL ] ELF: Loaded 52787 existing records from primary storage. [2025-10-13T18:40:30.428787] [INFO ] [MAIN ] ELF: Loaded 52787 existing records. [2025-10-13T18:40:30.610173] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:30.610481] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-13T18:40:30.610534] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-13T18:40:30.611118] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-13T18:40:30.611176] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-13T18:40:30.823159] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-13T18:40:30.979563] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:31.617918] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-13T18:40:31.763659] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T18:40:32.418002] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-13T18:40:32.917991] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-13T18:40:33.217896] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-13T18:40:33.543639] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-13T18:40:34.017937] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-13T18:40:34.232871] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T18:40:34.817935] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-13T18:40:34.874118] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T18:40:35.617923] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-13T18:40:35.865967] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-13T18:40:36.417894] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-13T18:40:36.798320] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-13T18:40:37.217915] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-13T18:40:37.531723] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T18:40:38.017981] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-13T18:40:38.107717] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T18:40:38.817905] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-13T18:40:39.203889] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T18:40:39.618016] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-13T18:40:40.057758] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-13T18:40:40.425412] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-13T18:40:40.454318] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T18:40:41.217990] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-13T18:40:41.953689] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-13T18:40:42.017967] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-13T18:40:42.403360] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T18:40:42.817968] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-13T18:40:43.403249] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-13T18:40:43.617933] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-13T18:40:44.164031] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-13T18:40:44.418002] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-13T18:40:45.002627] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-13T18:40:45.217918] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-13T18:40:45.736231] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-13T18:40:46.018005] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-13T18:40:46.450227] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-13T18:40:46.783816] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T18:40:46.817991] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-13T18:40:47.617990] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-13T18:40:48.177303] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-13T18:40:48.418000] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-13T18:40:48.914915] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-13T18:40:49.217921] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-13T18:40:49.537408] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T18:40:49.889167] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T18:40:50.017959] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-13T18:40:50.817940] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-13T18:40:51.312562] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-13T18:40:51.617978] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-13T18:40:51.841882] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T18:40:52.410559] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T18:40:52.416036] [INFO ] [REMOTE ] EIX: Full fetch complete (77149 records). [2025-10-13T18:40:52.416163] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-13T18:40:52.428175] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-13T18:40:52.815528] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-13T18:40:52.815764] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-13T18:40:52.816801] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-13T18:40:52.816885] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-13T18:40:52.818578] [DEBUG] [LOCAL ] EIX: Trimmed 77149 records to 53364 (keeping 200 days of data) [2025-10-13T18:40:52.953102] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-13T18:40:53.190796] [DEBUG] [LOCAL ] EIX: Primary data saved (53364 records). [2025-10-13T18:40:53.190936] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-13T18:40:53.191011] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. EIX took 36.2s. Estimated remaining: 3h 50m 17s. Rate: 7.2 symbols/min [2025-10-13T18:40:53.223018] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-13T18:40:53.358471] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:53.358673] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-10-13T18:40:53.358727] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-10-13T18:40:53.358832] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-13T18:40:53.358873] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-13T18:40:53.358928] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-13T18:40:53.358961] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-13T18:40:53.704906] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:54.017969] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-13T18:40:54.141934] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T18:40:54.147783] [INFO ] [REMOTE ] ELAN: Full fetch complete (76873 records). [2025-10-13T18:40:54.147978] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-13T18:40:54.547270] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-13T18:40:54.547387] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-13T18:40:54.548330] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-13T18:40:54.548394] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-13T18:40:54.549864] [DEBUG] [LOCAL ] ELAN: Trimmed 76873 records to 53299 (keeping 200 days of data) [2025-10-13T18:40:54.822602] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-13T18:40:54.864525] [DEBUG] [LOCAL ] ELAN: Primary data saved (53299 records). [2025-10-13T18:40:54.864633] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-13T18:40:54.864760] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELAN took 37.9s. Estimated remaining: 3h 49m 53s. Rate: 7.2 symbols/min [2025-10-13T18:40:55.036635] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:55.060151] [DEBUG] [LOCAL ] ELP: Loaded 25987 existing records from primary storage. [2025-10-13T18:40:55.060414] [INFO ] [MAIN ] ELP: Loaded 25987 existing records. [2025-10-13T18:40:55.246290] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:40:55.246688] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-13T18:40:55.246848] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-13T18:40:55.247815] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-13T18:40:55.247878] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-13T18:40:55.553450] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-13T18:40:55.626148] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-13T18:40:55.669837] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:55.918526] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T18:40:56.375701] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T18:40:56.381582] [INFO ] [REMOTE ] EL: Full fetch complete (77270 records). [2025-10-13T18:40:56.381753] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-13T18:40:56.423561] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-13T18:40:56.450008] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T18:40:56.804528] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-13T18:40:56.804630] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-13T18:40:56.805515] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-13T18:40:56.805562] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-13T18:40:56.807020] [DEBUG] [LOCAL ] EL: Trimmed 77270 records to 53376 (keeping 200 days of data) [2025-10-13T18:40:57.133941] [DEBUG] [LOCAL ] EL: Primary data saved (53376 records). [2025-10-13T18:40:57.134098] [INFO ] [MAIN ] EL: Full history saved. [2025-10-13T18:40:57.134925] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. EL took 40.2s. Estimated remaining: 3h 49m 31s. Rate: 7.2 symbols/min [2025-10-13T18:40:57.223109] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-13T18:40:57.326367] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:40:57.326546] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-13T18:40:57.326582] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-13T18:40:57.326720] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-13T18:40:57.326767] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-13T18:40:57.326808] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-13T18:40:57.326841] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-13T18:40:57.675317] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:40:57.807365] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T18:40:58.021689] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-13T18:40:58.192117] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T18:40:58.817979] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-13T18:40:59.186839] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:40:59.617982] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-13T18:41:00.418011] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-13T18:41:00.894487] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-13T18:41:01.094217] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T18:41:01.219755] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-13T18:41:01.223353] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T18:41:02.018002] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-13T18:41:02.383381] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T18:41:02.817973] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-13T18:41:03.526767] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T18:41:03.559510] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T18:41:03.617901] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-13T18:41:03.951788] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-13T18:41:04.417924] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-13T18:41:05.218000] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-13T18:41:06.017919] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-13T18:41:06.323681] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T18:41:06.334910] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-13T18:41:06.568259] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-13T18:41:06.817907] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-13T18:41:07.290732] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-13T18:41:07.617930] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-13T18:41:08.417926] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-13T18:41:09.217940] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-13T18:41:09.473979] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T18:41:09.615969] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T18:41:10.017978] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-13T18:41:10.639152] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T18:41:10.817910] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-13T18:41:11.303369] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T18:41:11.617925] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-13T18:41:12.230604] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T18:41:12.417894] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-13T18:41:12.763967] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T18:41:12.797536] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-13T18:41:13.217926] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-13T18:41:14.018014] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-13T18:41:14.817909] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-13T18:41:15.125533] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-13T18:41:15.257482] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-13T18:41:15.263325] [INFO ] [REMOTE ] ELF: Full fetch complete (75300 records). [2025-10-13T18:41:15.263491] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-13T18:41:15.611473] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T18:41:15.624477] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-13T18:41:15.724926] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-13T18:41:15.725029] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-13T18:41:15.726015] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-13T18:41:15.726082] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-13T18:41:15.727708] [DEBUG] [LOCAL ] ELF: Trimmed 75300 records to 52038 (keeping 200 days of data) [2025-10-13T18:41:16.037807] [DEBUG] [LOCAL ] ELF: Primary data saved (52038 records). [2025-10-13T18:41:16.038002] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-13T18:41:16.038122] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELF took 45.9s. Estimated remaining: 3h 49m 47s. Rate: 7.2 symbols/min [2025-10-13T18:41:16.130288] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T18:41:16.210100] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:16.254282] [DEBUG] [LOCAL ] ELS: Loaded 50519 existing records from primary storage. [2025-10-13T18:41:16.254615] [INFO ] [MAIN ] ELS: Loaded 50519 existing records. [2025-10-13T18:41:16.423595] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-13T18:41:16.428113] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:41:16.428313] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-13T18:41:16.428383] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-13T18:41:16.429459] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-13T18:41:16.429515] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-13T18:41:16.796565] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:16.843909] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-13T18:41:17.217940] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-13T18:41:18.017923] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-13T18:41:18.693458] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T18:41:18.817936] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-13T18:41:19.339939] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T18:41:19.617926] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-13T18:41:20.417904] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-13T18:41:20.504356] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T18:41:20.853937] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T18:41:21.217935] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-13T18:41:21.477594] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-13T18:41:21.936520] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T18:41:22.017887] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-13T18:41:22.817921] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-13T18:41:23.564735] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:41:23.617884] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-13T18:41:24.267144] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T18:41:24.417899] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-13T18:41:25.142839] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T18:41:25.147118] [INFO ] [REMOTE ] ELME: Full fetch complete (55962 records). [2025-10-13T18:41:25.147259] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-13T18:41:25.223140] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-13T18:41:25.562279] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-13T18:41:25.562382] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-13T18:41:25.563231] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-13T18:41:25.563298] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-13T18:41:25.564773] [DEBUG] [LOCAL ] ELME: Trimmed 55962 records to 39410 (keeping 200 days of data) [2025-10-13T18:41:25.805029] [DEBUG] [LOCAL ] ELME: Primary data saved (39410 records). [2025-10-13T18:41:25.805174] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-13T18:41:25.805266] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELME took 32.6s. Estimated remaining: 3h 49m 42s. Rate: 7.2 symbols/min [2025-10-13T18:41:25.976793] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:26.011166] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:41:26.024214] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-13T18:41:26.034820] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T18:41:26.085603] [DEBUG] [LOCAL ] ELV: Loaded 51348 existing records from primary storage. [2025-10-13T18:41:26.085983] [INFO ] [MAIN ] ELV: Loaded 51348 existing records. [2025-10-13T18:41:26.258500] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:41:26.258822] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-13T18:41:26.258877] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-13T18:41:26.259563] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-13T18:41:26.259621] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-13T18:41:26.608827] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T18:41:26.613225] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:26.613959] [INFO ] [REMOTE ] ELPC: Full fetch complete (1412 records). [2025-10-13T18:41:26.614236] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-13T18:41:26.789145] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-13T18:41:26.789344] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:41:26.789388] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:41:26.789427] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-13T18:41:26.789482] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-13T18:41:26.789517] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-13T18:41:26.789555] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-13T18:41:26.789609] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. ELPC took 29.7s. Estimated remaining: 3h 49m 16s. Rate: 7.2 symbols/min [2025-10-13T18:41:26.823151] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-13T18:41:26.961265] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:26.961483] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-13T18:41:26.961518] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-13T18:41:26.961661] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-13T18:41:26.961718] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-13T18:41:26.961762] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-13T18:41:26.961795] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-13T18:41:27.351253] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:27.617923] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-13T18:41:28.417909] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-13T18:41:28.496111] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T18:41:29.217903] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-13T18:41:29.466863] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:41:29.467248] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-13T18:41:29.467361] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:41:29.467438] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-13T18:41:29.467513] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:41:29.467614] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-13T18:41:29.467744] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-13T18:41:29.467817] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-13T18:41:29.467924] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-13T18:41:29.468044] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. EMA took 2.7s. Estimated remaining: 3h 48m 55s. Rate: 7.2 symbols/min [2025-10-13T18:41:29.654826] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:29.701117] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-13T18:41:29.719133] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T18:41:29.723355] [INFO ] [REMOTE ] ELP: Full fetch complete (36692 records). [2025-10-13T18:41:29.723475] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-13T18:41:29.780010] [DEBUG] [LOCAL ] EMD: Loaded 21449 existing records from primary storage. [2025-10-13T18:41:29.800029] [INFO ] [MAIN ] EMD: Loaded 21449 existing records. [2025-10-13T18:41:30.043263] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-13T18:41:30.139370] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:41:30.164705] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-13T18:41:30.203819] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-13T18:41:30.230476] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-13T18:41:30.240613] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-13T18:41:30.484500] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-13T18:41:30.494739] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-13T18:41:30.495407] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-13T18:41:30.509430] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-13T18:41:30.528100] [DEBUG] [LOCAL ] ELP: Trimmed 36692 records to 25644 (keeping 200 days of data) [2025-10-13T18:41:30.796437] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:30.818077] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-13T18:41:30.859326] [DEBUG] [LOCAL ] ELP: Primary data saved (25644 records). [2025-10-13T18:41:30.859481] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-13T18:41:30.859573] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. ELP took 36.0s. Estimated remaining: 3h 48m 31s. Rate: 7.2 symbols/min [2025-10-13T18:41:31.024675] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:31.024889] [DEBUG] [LOCAL ] EME: No existing data file found in primary storage. [2025-10-13T18:41:31.024932] [WARN ] [MAIN ] EME: No existing data found, performing full refresh instead. [2025-10-13T18:41:31.025041] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-13T18:41:31.025083] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-13T18:41:31.025123] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-10-13T18:41:31.025155] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-13T18:41:31.370450] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:31.617896] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-13T18:41:32.053409] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T18:41:32.348449] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T18:41:32.417918] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-13T18:41:32.715976] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T18:41:33.217916] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-13T18:41:33.447193] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T18:41:34.017924] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-13T18:41:34.606820] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T18:41:34.817925] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-13T18:41:35.096977] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:41:35.617929] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-13T18:41:36.331065] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T18:41:36.417922] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-13T18:41:37.217928] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-13T18:41:37.387245] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T18:41:38.019071] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-13T18:41:38.020815] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T18:41:38.817984] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-13T18:41:38.916083] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:41:39.054183] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T18:41:39.617937] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-13T18:41:40.227519] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:41:40.417927] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-13T18:41:40.709009] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T18:41:41.218014] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-13T18:41:41.899865] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T18:41:42.017918] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-13T18:41:42.739142] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T18:41:42.817978] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-13T18:41:43.542131] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T18:41:43.617929] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-13T18:41:44.386671] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T18:41:44.417888] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-13T18:41:44.626363] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T18:41:45.217984] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-13T18:41:45.831083] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T18:41:46.018054] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-13T18:41:46.197287] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-13T18:41:46.817991] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-13T18:41:47.617973] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-13T18:41:47.775076] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T18:41:47.966786] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T18:41:48.417983] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-13T18:41:48.865610] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T18:41:49.218023] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-13T18:41:49.467593] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T18:41:50.018031] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-13T18:41:50.817905] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-13T18:41:50.872778] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T18:41:50.878290] [INFO ] [REMOTE ] ELS: Full fetch complete (71009 records). [2025-10-13T18:41:50.878430] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-13T18:41:51.262545] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-13T18:41:51.262624] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-13T18:41:51.263541] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-13T18:41:51.263599] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-13T18:41:51.265120] [DEBUG] [LOCAL ] ELS: Trimmed 71009 records to 49898 (keeping 200 days of data) [2025-10-13T18:41:51.602201] [DEBUG] [LOCAL ] ELS: Primary data saved (49898 records). [2025-10-13T18:41:51.604165] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T18:41:51.603103] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-13T18:41:51.613935] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. ELS took 35.6s. Estimated remaining: 3h 48m 51s. Rate: 7.2 symbols/min [2025-10-13T18:41:51.625554] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-13T18:41:51.810612] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:51.815544] [DEBUG] [LOCAL ] EMF: Loaded 3314 existing records from primary storage. [2025-10-13T18:41:51.815775] [INFO ] [MAIN ] EMF: Loaded 3314 existing records. [2025-10-13T18:41:51.993997] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:41:51.994410] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-13T18:41:51.994568] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-13T18:41:51.994781] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-13T18:41:51.994850] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-13T18:41:52.372920] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:52.375481] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T18:41:52.417888] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-13T18:41:52.537441] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T18:41:53.217938] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-13T18:41:53.509115] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T18:41:54.018018] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-13T18:41:54.263244] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T18:41:54.265715] [INFO ] [REMOTE ] EMD: Full fetch complete (32048 records). [2025-10-13T18:41:54.265794] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-13T18:41:54.266317] [FATAL] [VALIDATOR ] EMD: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:41:54.266406] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:41:54.266484] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:41:54.266574] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-13T18:41:54.266687] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-13T18:41:54.266798] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-10-13T18:41:54.266969] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-10-13T18:41:54.267058] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMD took 24.8s. Estimated remaining: 3h 48m 30s. Rate: 7.2 symbols/min [2025-10-13T18:41:54.438639] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:41:54.491366] [DEBUG] [LOCAL ] EMN: Loaded 51344 existing records from primary storage. [2025-10-13T18:41:54.491776] [INFO ] [MAIN ] EMN: Loaded 51344 existing records. [2025-10-13T18:41:54.670515] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:41:54.670751] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-13T18:41:54.670813] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-13T18:41:54.671462] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-13T18:41:54.671522] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-13T18:41:54.823078] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-13T18:41:55.081207] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:41:55.617899] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-13T18:41:55.671753] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T18:41:56.418030] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-13T18:41:56.451176] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T18:41:56.967481] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T18:41:57.217987] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-13T18:41:57.441903] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T18:41:58.017925] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-13T18:41:58.817920] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-13T18:41:59.132222] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T18:41:59.295124] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T18:41:59.313320] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-13T18:41:59.617925] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-13T18:42:00.418040] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-13T18:42:01.054153] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T18:42:01.057452] [INFO ] [REMOTE ] EME: Full fetch complete (46874 records). [2025-10-13T18:42:01.057555] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-13T18:42:01.226162] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-13T18:42:01.440914] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-13T18:42:01.440988] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-13T18:42:01.441564] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-13T18:42:01.441603] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-13T18:42:01.442523] [DEBUG] [LOCAL ] EME: Trimmed 46874 records to 31109 (keeping 200 days of data) [2025-10-13T18:42:01.636767] [DEBUG] [LOCAL ] EME: Primary data saved (31109 records). [2025-10-13T18:42:01.636898] [INFO ] [MAIN ] EME: Full history saved. [2025-10-13T18:42:01.636967] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EME took 30.8s. Estimated remaining: 3h 48m 19s. Rate: 7.2 symbols/min [2025-10-13T18:42:01.806523] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:01.821199] [DEBUG] [LOCAL ] EMO: Loaded 13185 existing records from primary storage. [2025-10-13T18:42:01.821382] [INFO ] [MAIN ] EMO: Loaded 13185 existing records. [2025-10-13T18:42:01.996379] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:01.996575] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-13T18:42:01.996620] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-13T18:42:01.996825] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-13T18:42:01.996871] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-13T18:42:02.026809] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-13T18:42:02.358349] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:02.388091] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-13T18:42:02.620513] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T18:42:02.817903] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-13T18:42:03.316822] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-13T18:42:03.388370] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T18:42:03.617943] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-13T18:42:04.417995] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-13T18:42:04.550173] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T18:42:05.217923] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-13T18:42:05.910138] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T18:42:06.018133] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-13T18:42:06.095017] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T18:42:06.817909] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-13T18:42:07.540027] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T18:42:07.617899] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-13T18:42:08.417977] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-13T18:42:08.821269] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T18:42:08.914580] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T18:42:09.217922] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-13T18:42:09.885043] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-13T18:42:10.017917] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-13T18:42:10.817901] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-13T18:42:10.830285] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T18:42:10.925306] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T18:42:11.618007] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-13T18:42:12.417907] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-13T18:42:12.665859] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T18:42:12.910452] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T18:42:13.024568] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T18:42:13.217935] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-13T18:42:14.017936] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-13T18:42:14.029037] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-13T18:42:14.490805] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T18:42:14.817927] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-13T18:42:15.617923] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-13T18:42:16.418036] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-13T18:42:16.899471] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-13T18:42:17.217943] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-13T18:42:17.369972] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T18:42:17.776764] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T18:42:18.017975] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-13T18:42:18.817969] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-13T18:42:18.892012] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T18:42:18.897934] [INFO ] [REMOTE ] ELV: Full fetch complete (73050 records). [2025-10-13T18:42:18.898126] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-13T18:42:19.161936] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T18:42:19.322073] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-13T18:42:19.322163] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-13T18:42:19.323206] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-13T18:42:19.323272] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-13T18:42:19.324770] [DEBUG] [LOCAL ] ELV: Trimmed 73050 records to 50650 (keeping 200 days of data) [2025-10-13T18:42:19.421291] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T18:42:19.630164] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-13T18:42:19.650771] [DEBUG] [LOCAL ] ELV: Primary data saved (50650 records). [2025-10-13T18:42:19.650922] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-13T18:42:19.651009] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. ELV took 53.8s. Estimated remaining: 3h 48m 32s. Rate: 7.2 symbols/min [2025-10-13T18:42:19.850246] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:19.856393] [DEBUG] [LOCAL ] EMP: Loaded 3112 existing records from primary storage. [2025-10-13T18:42:19.856778] [INFO ] [MAIN ] EMP: Loaded 3112 existing records. [2025-10-13T18:42:20.038514] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:20.038799] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-13T18:42:20.038848] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-13T18:42:20.039034] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-13T18:42:20.039089] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-13T18:42:20.396724] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T18:42:20.402108] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:20.417880] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-13T18:42:21.217899] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-13T18:42:21.519878] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T18:42:21.831054] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T18:42:22.017931] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-13T18:42:22.817965] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-13T18:42:23.073129] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-13T18:42:23.075413] [INFO ] [REMOTE ] EMO: Full fetch complete (17674 records). [2025-10-13T18:42:23.075495] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-13T18:42:23.444885] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-13T18:42:23.445006] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-13T18:42:23.445475] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-13T18:42:23.445547] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-13T18:42:23.447110] [DEBUG] [LOCAL ] EMO: Trimmed 17674 records to 13184 (keeping 200 days of data) [2025-10-13T18:42:23.528535] [DEBUG] [LOCAL ] EMO: Primary data saved (13184 records). [2025-10-13T18:42:23.528711] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-13T18:42:23.528946] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMO took 21.9s. Estimated remaining: 3h 48m 14s. Rate: 7.2 symbols/min [2025-10-13T18:42:23.625100] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-13T18:42:23.702183] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:23.757033] [DEBUG] [LOCAL ] EMR: Loaded 53997 existing records from primary storage. [2025-10-13T18:42:23.757373] [INFO ] [MAIN ] EMR: Loaded 53997 existing records. [2025-10-13T18:42:23.933670] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:23.933915] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-13T18:42:23.933963] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-13T18:42:23.934554] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-13T18:42:23.934621] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-13T18:42:24.309523] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:24.317891] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T18:42:24.417900] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-13T18:42:24.604536] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:42:24.882369] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T18:42:25.217938] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-13T18:42:26.017941] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-13T18:42:26.453549] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-13T18:42:26.817896] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-13T18:42:27.153730] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-13T18:42:27.617918] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-13T18:42:28.417941] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-13T18:42:28.565443] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T18:42:28.957120] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-13T18:42:29.217936] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-13T18:42:29.681890] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-13T18:42:29.713319] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-13T18:42:30.017917] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-13T18:42:30.650438] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-13T18:42:30.817903] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-13T18:42:31.617983] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-13T18:42:32.162300] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-13T18:42:32.417928] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-13T18:42:32.639126] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T18:42:33.173311] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T18:42:33.217887] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-13T18:42:33.674135] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-13T18:42:34.017927] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-13T18:42:34.817920] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-13T18:42:35.435152] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T18:42:35.619105] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T18:42:35.617994] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-13T18:42:36.417922] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-13T18:42:36.939473] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T18:42:37.217924] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-13T18:42:37.334551] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T18:42:37.342165] [INFO ] [REMOTE ] EMN: Full fetch complete (72120 records). [2025-10-13T18:42:37.342289] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-13T18:42:37.721550] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-13T18:42:37.721634] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-13T18:42:37.722497] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-13T18:42:37.722562] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-13T18:42:37.724165] [DEBUG] [LOCAL ] EMN: Trimmed 72120 records to 50714 (keeping 200 days of data) [2025-10-13T18:42:38.018489] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-13T18:42:38.033563] [DEBUG] [LOCAL ] EMN: Primary data saved (50714 records). [2025-10-13T18:42:38.033713] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-13T18:42:38.034541] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMN took 43.8s. Estimated remaining: 3h 48m 19s. Rate: 7.2 symbols/min [2025-10-13T18:42:38.202332] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:38.259455] [DEBUG] [LOCAL ] ENB: Loaded 54289 existing records from primary storage. [2025-10-13T18:42:38.259890] [INFO ] [MAIN ] ENB: Loaded 54289 existing records. [2025-10-13T18:42:38.452934] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:38.453210] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-13T18:42:38.453259] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-13T18:42:38.453865] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-13T18:42:38.453922] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-13T18:42:38.812587] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:38.817920] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-13T18:42:39.049351] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T18:42:39.050888] [INFO ] [REMOTE ] EMF: Full fetch complete (6717 records). [2025-10-13T18:42:39.050995] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-13T18:42:39.195499] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T18:42:39.414938] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T18:42:39.509177] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-13T18:42:39.509282] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-13T18:42:39.509573] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-13T18:42:39.509617] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-13T18:42:39.510082] [DEBUG] [LOCAL ] EMF: Trimmed 6717 records to 3279 (keeping 200 days of data) [2025-10-13T18:42:39.533079] [DEBUG] [LOCAL ] EMF: Primary data saved (3279 records). [2025-10-13T18:42:39.533287] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-13T18:42:39.533428] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMF took 47.9s. Estimated remaining: 3h 47m 55s. Rate: 7.2 symbols/min [2025-10-13T18:42:39.623138] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-13T18:42:39.719489] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:39.726402] [DEBUG] [LOCAL ] ENFY: Loaded 3344 existing records from primary storage. [2025-10-13T18:42:39.726684] [INFO ] [MAIN ] ENFY: Loaded 3344 existing records. [2025-10-13T18:42:39.912018] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:39.912321] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-13T18:42:39.912371] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-13T18:42:39.912575] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-13T18:42:39.912627] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-13T18:42:40.304045] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:40.417926] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-13T18:42:40.948343] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T18:42:40.949224] [INFO ] [REMOTE ] EMP: Full fetch complete (4259 records). [2025-10-13T18:42:40.949295] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-13T18:42:41.223101] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-13T18:42:41.316971] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-13T18:42:41.317051] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-13T18:42:41.317226] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-13T18:42:41.317288] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-13T18:42:41.317698] [DEBUG] [LOCAL ] EMP: Trimmed 4259 records to 3063 (keeping 200 days of data) [2025-10-13T18:42:41.337338] [DEBUG] [LOCAL ] EMP: Primary data saved (3063 records). [2025-10-13T18:42:41.337479] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-13T18:42:41.337580] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. EMP took 21.7s. Estimated remaining: 3h 47m 33s. Rate: 7.2 symbols/min [2025-10-13T18:42:41.522426] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:42:41.571800] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T18:42:41.627576] [DEBUG] [LOCAL ] ENIC: Loaded 36820 existing records from primary storage. [2025-10-13T18:42:41.628166] [INFO ] [MAIN ] ENIC: Loaded 36820 existing records. [2025-10-13T18:42:41.839916] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:42:41.840208] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-13T18:42:41.840256] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-13T18:42:41.840890] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-13T18:42:41.840951] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-13T18:42:42.018423] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-13T18:42:42.255615] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T18:42:42.307583] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:42:42.817996] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-13T18:42:43.595439] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T18:42:43.617877] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-13T18:42:43.805341] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T18:42:44.012202] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-13T18:42:44.417927] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-13T18:42:45.217943] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-13T18:42:45.756594] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T18:42:46.017895] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-13T18:42:46.817986] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-13T18:42:47.293989] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T18:42:47.296853] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-13T18:42:47.410151] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T18:42:47.617899] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-13T18:42:48.417938] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-13T18:42:49.217917] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-13T18:42:49.372700] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T18:42:50.017916] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-13T18:42:50.214243] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T18:42:50.239715] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T18:42:50.817919] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-13T18:42:51.617979] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-13T18:42:51.817556] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:42:52.417978] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-13T18:42:52.909442] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-13T18:42:52.935436] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-13T18:42:53.223095] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-13T18:42:53.235597] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T18:42:53.786772] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T18:42:54.017913] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-13T18:42:54.818006] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-13T18:42:55.617997] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-13T18:42:55.857435] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:42:56.303584] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T18:42:56.418041] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-13T18:42:57.217928] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-13T18:42:57.574788] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T18:42:57.597253] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-13T18:42:57.819529] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T18:42:58.017909] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-13T18:42:58.817998] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-13T18:42:59.617997] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-13T18:42:59.845979] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T18:43:00.405996] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:43:00.417889] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-13T18:43:01.160795] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T18:43:01.217926] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-13T18:43:01.882169] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T18:43:02.017984] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-13T18:43:02.078000] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T18:43:02.082918] [INFO ] [REMOTE ] EMR: Full fetch complete (76699 records). [2025-10-13T18:43:02.083045] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-13T18:43:02.083806] [FATAL] [VALIDATOR ] EMR: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:43:02.083895] [FATAL] [MAIN ] EMR: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:43:02.083937] [WARN ] [MAIN ] EMR: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:43:02.083975] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-13T18:43:02.084029] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-13T18:43:02.084064] [INFO ] [LOCAL ] EMR: Starting deletion of derivative data. [2025-10-13T18:43:02.084268] [DEBUG] [LOCAL ] EMR: Deleted derivative data file. [2025-10-13T18:43:02.084380] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. EMR took 38.6s. Estimated remaining: 3h 47m 52s. Rate: 7.2 symbols/min [2025-10-13T18:43:02.252603] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:02.256252] [DEBUG] [LOCAL ] ENO: Loaded 1913 existing records from primary storage. [2025-10-13T18:43:02.256404] [INFO ] [MAIN ] ENO: Loaded 1913 existing records. [2025-10-13T18:43:02.431225] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:02.431468] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-13T18:43:02.431514] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-13T18:43:02.431688] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-13T18:43:02.431744] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-13T18:43:02.792908] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:02.817892] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-13T18:43:03.620009] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-13T18:43:03.620211] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T18:43:04.044920] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T18:43:04.417941] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-13T18:43:05.020215] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-13T18:43:05.041134] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T18:43:05.217979] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-13T18:43:05.692779] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T18:43:06.017901] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-13T18:43:06.519330] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-13T18:43:06.818002] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-13T18:43:07.617935] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-13T18:43:08.197202] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T18:43:08.417937] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-13T18:43:08.704311] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T18:43:08.857234] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T18:43:09.218006] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-13T18:43:09.834117] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T18:43:10.017911] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-13T18:43:10.462496] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T18:43:10.817899] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-13T18:43:11.426874] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T18:43:11.617896] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-13T18:43:12.418012] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-13T18:43:13.169782] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T18:43:13.217894] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-13T18:43:14.017929] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-13T18:43:14.409688] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-13T18:43:14.411362] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-13T18:43:14.553096] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T18:43:14.817924] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-13T18:43:15.617985] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-13T18:43:16.207827] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T18:43:16.295747] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T18:43:16.297189] [INFO ] [REMOTE ] ENFY: Full fetch complete (5886 records). [2025-10-13T18:43:16.297261] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-13T18:43:16.433162] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-13T18:43:16.647529] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-13T18:43:16.647612] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-13T18:43:16.647815] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-13T18:43:16.647874] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-13T18:43:16.648264] [DEBUG] [LOCAL ] ENFY: Trimmed 5886 records to 3596 (keeping 200 days of data) [2025-10-13T18:43:16.668522] [DEBUG] [LOCAL ] ENFY: Primary data saved (3596 records). [2025-10-13T18:43:16.668591] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-13T18:43:16.668687] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENFY took 37.1s. Estimated remaining: 3h 47m 57s. Rate: 7.2 symbols/min [2025-10-13T18:43:16.838091] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:16.882523] [DEBUG] [LOCAL ] ENOV: Loaded 45382 existing records from primary storage. [2025-10-13T18:43:16.882894] [INFO ] [MAIN ] ENOV: Loaded 45382 existing records. [2025-10-13T18:43:17.062945] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:17.063156] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-13T18:43:17.063201] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-13T18:43:17.063775] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-13T18:43:17.063831] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-13T18:43:17.222715] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-13T18:43:17.437447] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:18.017902] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-13T18:43:18.143164] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T18:43:18.148211] [INFO ] [REMOTE ] ENB: Full fetch complete (77099 records). [2025-10-13T18:43:18.148357] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-13T18:43:18.149206] [FATAL] [VALIDATOR ] ENB: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:43:18.149297] [FATAL] [MAIN ] ENB: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:43:18.149338] [WARN ] [MAIN ] ENB: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:43:18.149377] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-13T18:43:18.149432] [DEBUG] [LOCAL ] ENB: No primary data file found to delete. [2025-10-13T18:43:18.149466] [INFO ] [LOCAL ] ENB: Starting deletion of derivative data. [2025-10-13T18:43:18.149677] [DEBUG] [LOCAL ] ENB: Deleted derivative data file. [2025-10-13T18:43:18.150462] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENB took 40.1s. Estimated remaining: 3h 47m 33s. Rate: 7.2 symbols/min [2025-10-13T18:43:18.316924] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:18.319772] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-13T18:43:18.362858] [DEBUG] [LOCAL ] ENR: Loaded 43873 existing records from primary storage. [2025-10-13T18:43:18.363141] [INFO ] [MAIN ] ENR: Loaded 43873 existing records. [2025-10-13T18:43:18.541428] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:18.549001] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-13T18:43:18.549816] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T18:43:18.549518] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-13T18:43:18.550929] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-13T18:43:18.553105] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-13T18:43:18.584423] [INFO ] [REMOTE ] ENIC: Full fetch complete (51405 records). [2025-10-13T18:43:18.616212] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-13T18:43:18.833467] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-13T18:43:19.280791] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:19.294108] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-13T18:43:19.294222] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-13T18:43:19.294989] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-13T18:43:19.295052] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-13T18:43:19.296253] [DEBUG] [LOCAL ] ENIC: Trimmed 51405 records to 36489 (keeping 200 days of data) [2025-10-13T18:43:19.386148] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-13T18:43:19.501841] [DEBUG] [LOCAL ] ENIC: Primary data saved (36489 records). [2025-10-13T18:43:19.501978] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-13T18:43:19.502054] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENIC took 38.2s. Estimated remaining: 3h 47m 10s. Rate: 7.2 symbols/min [2025-10-13T18:43:19.623190] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-13T18:43:19.670197] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:19.701222] [DEBUG] [LOCAL ] ENS: Loaded 29670 existing records from primary storage. [2025-10-13T18:43:19.701484] [INFO ] [MAIN ] ENS: Loaded 29670 existing records. [2025-10-13T18:43:19.875860] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:19.876097] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-13T18:43:19.876143] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-13T18:43:19.876538] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-13T18:43:19.876594] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-13T18:43:20.224398] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:20.417888] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-13T18:43:21.192718] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T18:43:21.217915] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-13T18:43:21.590816] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T18:43:22.017971] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-13T18:43:22.679581] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:43:22.817920] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-13T18:43:23.092309] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T18:43:23.275326] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T18:43:23.276101] [INFO ] [REMOTE ] ENO: Full fetch complete (3079 records). [2025-10-13T18:43:23.276166] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-13T18:43:23.621303] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-13T18:43:23.621890] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-13T18:43:23.622032] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-13T18:43:23.622182] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-13T18:43:23.622258] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-13T18:43:23.623955] [DEBUG] [LOCAL ] ENO: Trimmed 3079 records to 1870 (keeping 200 days of data) [2025-10-13T18:43:23.636034] [DEBUG] [LOCAL ] ENO: Primary data saved (1870 records). [2025-10-13T18:43:23.636117] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-13T18:43:23.636194] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENO took 21.6s. Estimated remaining: 3h 46m 52s. Rate: 7.2 symbols/min [2025-10-13T18:43:23.803510] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:23.831638] [DEBUG] [LOCAL ] ENVA: Loaded 25677 existing records from primary storage. [2025-10-13T18:43:23.831949] [INFO ] [MAIN ] ENVA: Loaded 25677 existing records. [2025-10-13T18:43:24.015029] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:24.015327] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-13T18:43:24.015384] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-13T18:43:24.015749] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-13T18:43:24.015806] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-13T18:43:24.363329] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:24.417928] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-13T18:43:24.787985] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:43:25.217932] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-13T18:43:25.751478] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T18:43:26.017924] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-13T18:43:26.328189] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T18:43:26.817924] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-13T18:43:27.416870] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T18:43:27.617917] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-13T18:43:28.094356] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:43:28.417886] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-13T18:43:28.809898] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T18:43:29.217928] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-13T18:43:29.689314] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T18:43:30.017910] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-13T18:43:30.303100] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T18:43:30.817944] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-13T18:43:31.617925] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-13T18:43:31.659865] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:43:32.003093] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T18:43:32.417911] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-13T18:43:33.001139] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T18:43:33.217979] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-13T18:43:33.736470] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T18:43:34.017942] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-13T18:43:34.226564] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T18:43:34.817941] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-13T18:43:35.459707] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:43:35.617889] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-13T18:43:36.198062] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T18:43:36.417980] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-13T18:43:36.751580] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T18:43:37.218004] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-13T18:43:37.556322] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T18:43:38.018015] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-13T18:43:38.819508] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-13T18:43:38.822355] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T18:43:39.627677] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-13T18:43:39.633907] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T18:43:40.220113] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T18:43:40.417919] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-13T18:43:40.724032] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T18:43:41.217924] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-13T18:43:41.724511] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T18:43:42.017996] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-13T18:43:42.817906] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-13T18:43:42.858196] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T18:43:43.424087] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T18:43:43.617901] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-13T18:43:44.417916] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-13T18:43:44.509323] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:43:44.794685] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T18:43:44.798193] [INFO ] [REMOTE ] ENS: Full fetch complete (42142 records). [2025-10-13T18:43:44.798276] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-13T18:43:45.174950] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-13T18:43:45.175108] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-13T18:43:45.175764] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-13T18:43:45.175826] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-13T18:43:45.176767] [DEBUG] [LOCAL ] ENS: Trimmed 42142 records to 29433 (keeping 200 days of data) [2025-10-13T18:43:45.231107] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-13T18:43:45.379565] [DEBUG] [LOCAL ] ENS: Primary data saved (29433 records). [2025-10-13T18:43:45.379889] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-13T18:43:45.379998] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENS took 25.9s. Estimated remaining: 3h 47m 13s. Rate: 7.2 symbols/min [2025-10-13T18:43:45.578665] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:45.599860] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T18:43:45.617747] [DEBUG] [LOCAL ] EOD: Loaded 15098 existing records from primary storage. [2025-10-13T18:43:45.618019] [INFO ] [MAIN ] EOD: Loaded 15098 existing records. [2025-10-13T18:43:45.822104] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:45.822372] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-13T18:43:45.822420] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-13T18:43:45.822760] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-13T18:43:45.822820] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-13T18:43:46.021174] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-13T18:43:46.228955] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:46.817993] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-13T18:43:46.973529] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:43:47.326990] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T18:43:47.617944] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-13T18:43:48.312452] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T18:43:48.417907] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-13T18:43:48.971063] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T18:43:49.217919] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-13T18:43:49.648127] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T18:43:50.017940] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-13T18:43:50.315773] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T18:43:50.817993] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-13T18:43:51.605724] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T18:43:51.617886] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-13T18:43:51.936012] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T18:43:52.417982] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-13T18:43:53.157308] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T18:43:53.162259] [INFO ] [REMOTE ] ENOV: Full fetch complete (63293 records). [2025-10-13T18:43:53.162418] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-13T18:43:53.227193] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-13T18:43:53.499848] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T18:43:53.593862] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-13T18:43:53.593978] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-13T18:43:53.595368] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-13T18:43:53.595446] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-13T18:43:53.597314] [DEBUG] [LOCAL ] ENOV: Trimmed 63293 records to 44876 (keeping 200 days of data) [2025-10-13T18:43:53.883277] [DEBUG] [LOCAL ] ENOV: Primary data saved (44876 records). [2025-10-13T18:43:53.883469] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-13T18:43:53.883578] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENOV took 37.2s. Estimated remaining: 3h 47m 5s. Rate: 7.2 symbols/min [2025-10-13T18:43:54.023184] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-13T18:43:54.072736] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:54.132368] [DEBUG] [LOCAL ] EOG: Loaded 54124 existing records from primary storage. [2025-10-13T18:43:54.132872] [INFO ] [MAIN ] EOG: Loaded 54124 existing records. [2025-10-13T18:43:54.332439] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:54.332789] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-13T18:43:54.332848] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-13T18:43:54.333522] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-13T18:43:54.333602] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-13T18:43:54.478258] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T18:43:54.516025] [INFO ] [REMOTE ] ENVA: Full fetch complete (36651 records). [2025-10-13T18:43:54.526447] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-13T18:43:54.849406] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-13T18:43:55.053856] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:55.081630] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T18:43:55.179993] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-13T18:43:55.180073] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-13T18:43:55.180722] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-13T18:43:55.180785] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-13T18:43:55.181636] [DEBUG] [LOCAL ] ENVA: Trimmed 36651 records to 25436 (keeping 200 days of data) [2025-10-13T18:43:55.329711] [DEBUG] [LOCAL ] ENVA: Primary data saved (25436 records). [2025-10-13T18:43:55.329841] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-13T18:43:55.329917] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENVA took 31.7s. Estimated remaining: 3h 46m 41s. Rate: 7.2 symbols/min [2025-10-13T18:43:55.493097] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:43:55.504159] [DEBUG] [LOCAL ] EOI: Loaded 10972 existing records from primary storage. [2025-10-13T18:43:55.504335] [INFO ] [MAIN ] EOI: Loaded 10972 existing records. [2025-10-13T18:43:55.623059] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-13T18:43:55.683474] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:43:55.683707] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-13T18:43:55.683765] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-13T18:43:55.683946] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-13T18:43:55.683985] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-13T18:43:56.030220] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:43:56.415374] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T18:43:56.424621] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-13T18:43:57.217915] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-13T18:43:57.228577] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T18:43:57.698989] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-13T18:43:58.017968] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-13T18:43:58.526431] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:43:58.817916] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-13T18:43:59.071028] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T18:43:59.617969] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-13T18:44:00.342597] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T18:44:00.417990] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-13T18:44:00.641511] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-13T18:44:01.062901] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-13T18:44:01.218034] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-13T18:44:02.018021] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-13T18:44:02.209442] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T18:44:02.817999] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-13T18:44:03.617978] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-13T18:44:03.805821] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T18:44:04.153004] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T18:44:04.157345] [INFO ] [REMOTE ] ENR: Full fetch complete (59085 records). [2025-10-13T18:44:04.157454] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-13T18:44:04.423091] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-13T18:44:04.548459] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-13T18:44:04.548554] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-13T18:44:04.549583] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-13T18:44:04.549697] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-13T18:44:04.551200] [DEBUG] [LOCAL ] ENR: Trimmed 59085 records to 43561 (keeping 200 days of data) [2025-10-13T18:44:04.662855] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T18:44:04.861006] [DEBUG] [LOCAL ] ENR: Primary data saved (43561 records). [2025-10-13T18:44:04.861147] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-13T18:44:04.861970] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. ENR took 46.7s. Estimated remaining: 3h 46m 35s. Rate: 7.2 symbols/min [2025-10-13T18:44:05.034799] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:05.051536] [DEBUG] [LOCAL ] EOS: Loaded 15639 existing records from primary storage. [2025-10-13T18:44:05.051811] [INFO ] [MAIN ] EOS: Loaded 15639 existing records. [2025-10-13T18:44:05.226465] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-13T18:44:05.229446] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:05.238847] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-13T18:44:05.238940] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-13T18:44:05.239796] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T18:44:05.239516] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-13T18:44:05.242920] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-13T18:44:05.648175] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:06.017930] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-13T18:44:06.817890] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-13T18:44:06.947816] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T18:44:07.392624] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T18:44:07.603665] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T18:44:07.617892] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-13T18:44:08.417976] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-13T18:44:09.217938] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-13T18:44:09.360031] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T18:44:09.547487] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T18:44:10.017927] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-13T18:44:10.347785] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T18:44:10.817906] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-13T18:44:11.617923] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-13T18:44:11.936706] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T18:44:12.417936] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-13T18:44:13.217895] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-13T18:44:13.420970] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-13T18:44:13.870188] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T18:44:14.017911] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-13T18:44:14.374449] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-13T18:44:14.397081] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-13T18:44:14.817896] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-13T18:44:14.921763] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T18:44:15.617916] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-13T18:44:16.418053] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-13T18:44:16.705268] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T18:44:17.198085] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T18:44:17.218012] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-13T18:44:17.308088] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T18:44:18.017927] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-13T18:44:18.694269] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-13T18:44:18.817974] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-13T18:44:19.103634] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T18:44:19.617895] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-13T18:44:19.809265] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T18:44:20.263343] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T18:44:20.417920] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-13T18:44:21.217925] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-13T18:44:21.678631] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T18:44:21.823002] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T18:44:22.017915] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-13T18:44:22.817891] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-13T18:44:22.907399] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T18:44:22.910172] [INFO ] [REMOTE ] EOD: Full fetch complete (20931 records). [2025-10-13T18:44:22.910250] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-13T18:44:23.301697] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-13T18:44:23.301821] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-13T18:44:23.302544] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-13T18:44:23.302590] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-13T18:44:23.303430] [DEBUG] [LOCAL ] EOD: Trimmed 20931 records to 14986 (keeping 200 days of data) [2025-10-13T18:44:23.388812] [DEBUG] [LOCAL ] EOD: Primary data saved (14986 records). [2025-10-13T18:44:23.388975] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-13T18:44:23.389086] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOD took 38.0s. Estimated remaining: 3h 46m 49s. Rate: 7.2 symbols/min [2025-10-13T18:44:23.556693] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:23.564552] [DEBUG] [LOCAL ] EOT: Loaded 6907 existing records from primary storage. [2025-10-13T18:44:23.564730] [INFO ] [MAIN ] EOT: Loaded 6907 existing records. [2025-10-13T18:44:23.625482] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-13T18:44:23.740446] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:23.740691] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-13T18:44:23.740747] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-13T18:44:23.740917] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-13T18:44:23.740973] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-13T18:44:24.105467] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:24.417937] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-13T18:44:24.796695] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T18:44:24.837976] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T18:44:25.217913] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-13T18:44:25.348269] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:44:25.935544] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T18:44:25.937515] [INFO ] [REMOTE ] EOI: Full fetch complete (16217 records). [2025-10-13T18:44:25.937592] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-13T18:44:26.023174] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-13T18:44:26.358366] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-13T18:44:26.358469] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-13T18:44:26.359271] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-13T18:44:26.359337] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-13T18:44:26.359969] [DEBUG] [LOCAL ] EOI: Trimmed 16217 records to 10791 (keeping 200 days of data) [2025-10-13T18:44:26.432595] [DEBUG] [LOCAL ] EOI: Primary data saved (10791 records). [2025-10-13T18:44:26.432822] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-13T18:44:26.432930] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOI took 31.1s. Estimated remaining: 3h 46m 29s. Rate: 7.2 symbols/min [2025-10-13T18:44:26.612394] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:26.639560] [DEBUG] [LOCAL ] EPAC: Loaded 27074 existing records from primary storage. [2025-10-13T18:44:26.639859] [INFO ] [MAIN ] EPAC: Loaded 27074 existing records. [2025-10-13T18:44:26.782981] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T18:44:26.824150] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-13T18:44:26.872342] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:26.873014] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-13T18:44:26.873090] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-13T18:44:26.873639] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-13T18:44:26.873748] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-13T18:44:27.359748] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:27.617988] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-13T18:44:27.708117] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T18:44:28.367320] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-13T18:44:28.373134] [INFO ] [REMOTE ] EOG: Full fetch complete (77282 records). [2025-10-13T18:44:28.373269] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-13T18:44:28.427041] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-13T18:44:28.763578] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-13T18:44:28.763678] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-13T18:44:28.764501] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-13T18:44:28.764543] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-13T18:44:28.765908] [DEBUG] [LOCAL ] EOG: Trimmed 77282 records to 53349 (keeping 200 days of data) [2025-10-13T18:44:29.106066] [DEBUG] [LOCAL ] EOG: Primary data saved (53349 records). [2025-10-13T18:44:29.106208] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-13T18:44:29.106309] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOG took 35.2s. Estimated remaining: 3h 46m 9s. Rate: 7.2 symbols/min [2025-10-13T18:44:29.222096] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-13T18:44:29.245024] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T18:44:29.293921] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:29.331391] [DEBUG] [LOCAL ] EPAM: Loaded 39938 existing records from primary storage. [2025-10-13T18:44:29.331724] [INFO ] [MAIN ] EPAM: Loaded 39938 existing records. [2025-10-13T18:44:29.508812] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:29.509060] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-13T18:44:29.509107] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-13T18:44:29.509588] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-13T18:44:29.509683] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-13T18:44:29.865529] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:30.018082] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-13T18:44:30.247662] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T18:44:30.739726] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T18:44:30.817919] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-13T18:44:31.617915] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-13T18:44:32.137095] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T18:44:32.424380] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-13T18:44:32.426075] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-13T18:44:33.126597] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-13T18:44:33.217986] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-13T18:44:33.892759] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T18:44:34.017932] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-13T18:44:34.817983] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-13T18:44:35.316438] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:44:35.516254] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-13T18:44:35.617922] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-13T18:44:36.417930] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-13T18:44:36.716021] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T18:44:37.217947] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-13T18:44:37.344067] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T18:44:38.017928] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-13T18:44:38.573486] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T18:44:38.817939] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-13T18:44:38.997486] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T18:44:39.000375] [INFO ] [REMOTE ] EOS: Full fetch complete (23207 records). [2025-10-13T18:44:39.000770] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-13T18:44:39.373491] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-13T18:44:39.373567] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-13T18:44:39.374017] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-13T18:44:39.374079] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-13T18:44:39.374698] [DEBUG] [LOCAL ] EOS: Trimmed 23207 records to 15359 (keeping 200 days of data) [2025-10-13T18:44:39.468906] [DEBUG] [LOCAL ] EOS: Primary data saved (15359 records). [2025-10-13T18:44:39.469046] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-13T18:44:39.469189] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOS took 34.6s. Estimated remaining: 3h 46m 4s. Rate: 7.2 symbols/min [2025-10-13T18:44:39.618457] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-13T18:44:39.636541] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:39.677147] [DEBUG] [LOCAL ] EPC: Loaded 40337 existing records from primary storage. [2025-10-13T18:44:39.677431] [INFO ] [MAIN ] EPC: Loaded 40337 existing records. [2025-10-13T18:44:39.851914] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:39.852110] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-13T18:44:39.852154] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-13T18:44:39.852686] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-13T18:44:39.852803] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-13T18:44:40.229192] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:40.224631] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T18:44:40.421068] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-13T18:44:40.421988] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T18:44:41.217911] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-13T18:44:41.654480] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T18:44:41.956013] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T18:44:42.017991] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-13T18:44:42.818005] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-13T18:44:43.617908] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-13T18:44:43.667566] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T18:44:44.225812] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:44:44.342847] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T18:44:44.417880] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-13T18:44:45.217918] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-13T18:44:46.017942] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-13T18:44:46.098912] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T18:44:46.344178] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T18:44:46.817939] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-13T18:44:46.918126] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T18:44:47.617924] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-13T18:44:47.740988] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T18:44:48.406515] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T18:44:48.407910] [INFO ] [REMOTE ] EOT: Full fetch complete (10716 records). [2025-10-13T18:44:48.408010] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-13T18:44:48.423087] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-13T18:44:48.772142] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-13T18:44:48.772219] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-13T18:44:48.772482] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-13T18:44:48.772519] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-13T18:44:48.772958] [DEBUG] [LOCAL ] EOT: Trimmed 10716 records to 6803 (keeping 200 days of data) [2025-10-13T18:44:48.821036] [DEBUG] [LOCAL ] EOT: Primary data saved (6803 records). [2025-10-13T18:44:48.821155] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-13T18:44:48.821239] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EOT took 25.4s. Estimated remaining: 3h 45m 58s. Rate: 7.2 symbols/min [2025-10-13T18:44:48.988889] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:48.989069] [DEBUG] [LOCAL ] EPD: No existing data file found in primary storage. [2025-10-13T18:44:48.989113] [WARN ] [MAIN ] EPD: No existing data found, performing full refresh instead. [2025-10-13T18:44:48.989241] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-13T18:44:48.989282] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-13T18:44:48.989322] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-10-13T18:44:48.989353] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-13T18:44:49.229789] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-13T18:44:49.361956] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:50.007041] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T18:44:50.017910] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-13T18:44:50.368295] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T18:44:50.817936] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-13T18:44:51.617932] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-13T18:44:51.919442] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T18:44:52.051720] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T18:44:52.417899] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-13T18:44:53.217911] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-13T18:44:53.288119] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T18:44:53.600774] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T18:44:54.017926] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-13T18:44:54.790169] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T18:44:54.817895] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-13T18:44:55.618615] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-13T18:44:55.623294] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T18:44:56.395222] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T18:44:56.417894] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-13T18:44:57.217918] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-13T18:44:57.624796] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T18:44:57.624525] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-13T18:44:57.643321] [INFO ] [REMOTE ] EPAC: Full fetch complete (38593 records). [2025-10-13T18:44:57.643494] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-13T18:44:58.022340] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-13T18:44:58.023747] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-13T18:44:58.023844] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-13T18:44:58.024531] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-13T18:44:58.024685] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-13T18:44:58.025726] [DEBUG] [LOCAL ] EPAC: Trimmed 38593 records to 26461 (keeping 200 days of data) [2025-10-13T18:44:58.200881] [DEBUG] [LOCAL ] EPAC: Primary data saved (26461 records). [2025-10-13T18:44:58.201071] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-13T18:44:58.201189] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPAC took 31.8s. Estimated remaining: 3h 45m 52s. Rate: 7.2 symbols/min [2025-10-13T18:44:58.371090] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:44:58.412109] [DEBUG] [LOCAL ] EPR: Loaded 44579 existing records from primary storage. [2025-10-13T18:44:58.412441] [INFO ] [MAIN ] EPR: Loaded 44579 existing records. [2025-10-13T18:44:58.586838] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:44:58.587175] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-13T18:44:58.587232] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-13T18:44:58.587721] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-13T18:44:58.587778] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-13T18:44:58.826357] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-13T18:44:58.940984] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T18:44:58.978797] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:44:59.617935] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-13T18:44:59.781008] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T18:45:00.417986] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-13T18:45:00.537742] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T18:45:01.217907] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-13T18:45:01.617670] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-13T18:45:01.774887] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T18:45:02.017931] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-13T18:45:02.583398] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T18:45:02.817984] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-13T18:45:03.617884] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-13T18:45:03.805585] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T18:45:04.417936] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-13T18:45:04.482278] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T18:45:05.217910] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-13T18:45:05.453534] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T18:45:05.560584] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T18:45:06.017977] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-13T18:45:06.817945] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-13T18:45:07.214561] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T18:45:07.578284] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T18:45:07.617889] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-13T18:45:08.168373] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-13T18:45:08.417933] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-13T18:45:09.217982] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-13T18:45:09.496065] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T18:45:09.661260] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T18:45:10.017904] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-13T18:45:10.701347] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T18:45:10.817978] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-13T18:45:11.617907] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-13T18:45:11.785279] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T18:45:12.374480] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T18:45:12.417926] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-13T18:45:13.151261] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T18:45:13.217913] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-13T18:45:14.018042] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-13T18:45:14.454522] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T18:45:14.484597] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T18:45:14.490969] [INFO ] [REMOTE ] EPC: Full fetch complete (57077 records). [2025-10-13T18:45:14.491199] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-13T18:45:14.825782] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-13T18:45:14.880613] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-13T18:45:14.880746] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-13T18:45:14.881578] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-13T18:45:14.881622] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-13T18:45:14.883026] [DEBUG] [LOCAL ] EPC: Trimmed 57077 records to 39804 (keeping 200 days of data) [2025-10-13T18:45:15.124664] [DEBUG] [LOCAL ] EPC: Primary data saved (39804 records). [2025-10-13T18:45:15.124822] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-13T18:45:15.125581] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPC took 35.7s. Estimated remaining: 3h 46m 2s. Rate: 7.2 symbols/min [2025-10-13T18:45:15.305314] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:45:15.353053] [DEBUG] [LOCAL ] EPRT: Loaded 49155 existing records from primary storage. [2025-10-13T18:45:15.353363] [INFO ] [MAIN ] EPRT: Loaded 49155 existing records. [2025-10-13T18:45:15.537709] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:45:15.538246] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-13T18:45:15.538306] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-13T18:45:15.538857] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-13T18:45:15.538914] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-13T18:45:15.628224] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-13T18:45:15.918553] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T18:45:15.924418] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:45:16.429763] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-13T18:45:16.432121] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:45:17.217896] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-13T18:45:17.596520] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-13T18:45:18.018040] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-13T18:45:18.173283] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T18:45:18.818042] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-13T18:45:18.890700] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:45:19.618047] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-13T18:45:19.672548] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T18:45:20.417909] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-13T18:45:20.893081] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-13T18:45:21.136530] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T18:45:21.217890] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-13T18:45:22.017983] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-13T18:45:22.204950] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T18:45:22.503090] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T18:45:22.817920] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-13T18:45:23.617911] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-13T18:45:23.810869] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T18:45:23.818750] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-10-13T18:45:23.818981] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-13T18:45:24.224241] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-13T18:45:24.224346] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-13T18:45:24.225322] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-13T18:45:24.225406] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-13T18:45:24.250364] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 53611 (keeping 200 days of data) [2025-10-13T18:45:24.252210] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T18:45:24.435435] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-13T18:45:24.595234] [DEBUG] [LOCAL ] EPD: Primary data saved (53611 records). [2025-10-13T18:45:24.595414] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-13T18:45:24.595510] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 35.8s. Estimated remaining: 3h 45m 56s. Rate: 7.2 symbols/min [2025-10-13T18:45:24.775779] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:45:24.775955] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-13T18:45:24.776004] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-13T18:45:24.776113] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-13T18:45:24.776156] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-13T18:45:24.776246] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-13T18:45:24.776300] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-13T18:45:25.095039] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T18:45:25.126222] [INFO ] [REMOTE ] EPAM: Full fetch complete (56085 records). [2025-10-13T18:45:25.137869] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-13T18:45:25.181529] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:45:25.231844] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-13T18:45:25.554575] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-13T18:45:25.554690] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-13T18:45:25.555446] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-13T18:45:25.555489] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-13T18:45:25.560319] [DEBUG] [LOCAL ] EPAM: Trimmed 56085 records to 39518 (keeping 200 days of data) [2025-10-13T18:45:25.806260] [DEBUG] [LOCAL ] EPAM: Primary data saved (39518 records). [2025-10-13T18:45:25.806424] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-13T18:45:25.806521] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPAM took 56.7s. Estimated remaining: 3h 45m 32s. Rate: 7.2 symbols/min [2025-10-13T18:45:25.979103] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:45:26.030036] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-13T18:45:26.033718] [DEBUG] [LOCAL ] EQH: Loaded 53424 existing records from primary storage. [2025-10-13T18:45:26.034096] [INFO ] [MAIN ] EQH: Loaded 53424 existing records. [2025-10-13T18:45:26.215347] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:45:26.215720] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-13T18:45:26.215821] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-13T18:45:26.216384] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-13T18:45:26.216451] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-13T18:45:26.500153] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-13T18:45:26.629865] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:45:26.803985] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-13T18:45:26.817878] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-13T18:45:26.858098] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T18:45:27.617901] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-13T18:45:27.676979] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T18:45:28.417920] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-13T18:45:29.217909] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-13T18:45:29.381733] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T18:45:29.961034] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T18:45:30.017933] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-13T18:45:30.049397] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T18:45:30.055454] [INFO ] [REMOTE ] EPR: Full fetch complete (63034 records). [2025-10-13T18:45:30.055605] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-13T18:45:30.433756] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-13T18:45:30.433847] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-13T18:45:30.434620] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-13T18:45:30.434694] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-13T18:45:30.436020] [DEBUG] [LOCAL ] EPR: Trimmed 63034 records to 43903 (keeping 200 days of data) [2025-10-13T18:45:30.703054] [DEBUG] [LOCAL ] EPR: Primary data saved (43903 records). [2025-10-13T18:45:30.703191] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-13T18:45:30.703329] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EPR took 32.5s. Estimated remaining: 3h 45m 16s. Rate: 7.2 symbols/min [2025-10-13T18:45:30.823169] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-13T18:45:30.873962] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:45:30.874155] [DEBUG] [LOCAL ] EQNR: No existing data file found in primary storage. [2025-10-13T18:45:30.874198] [WARN ] [MAIN ] EQNR: No existing data found, performing full refresh instead. [2025-10-13T18:45:30.874333] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-13T18:45:30.874375] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-13T18:45:30.874414] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-10-13T18:45:30.874448] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-13T18:45:31.219732] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:45:31.561548] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T18:45:31.617883] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-13T18:45:32.417919] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-13T18:45:32.631130] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T18:45:33.199486] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T18:45:33.217878] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-13T18:45:34.017927] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-13T18:45:34.140697] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T18:45:34.583880] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T18:45:34.827180] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-13T18:45:34.846254] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T18:45:35.617926] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-13T18:45:36.417989] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-13T18:45:36.641364] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T18:45:37.140310] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T18:45:37.210560] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T18:45:37.220002] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-13T18:45:37.950512] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-13T18:45:38.018025] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-13T18:45:38.818038] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-13T18:45:38.863942] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T18:45:39.618011] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-13T18:45:40.428219] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-13T18:45:40.451741] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T18:45:40.599667] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T18:45:41.218028] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-13T18:45:42.018102] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-13T18:45:42.021072] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T18:45:42.402126] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-13T18:45:42.818011] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-13T18:45:43.617903] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-13T18:45:43.769238] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T18:45:44.239453] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T18:45:44.417897] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-13T18:45:44.744490] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T18:45:45.217945] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-13T18:45:46.017903] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-13T18:45:46.103093] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T18:45:46.712662] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T18:45:46.717515] [INFO ] [REMOTE ] EPRT: Full fetch complete (68665 records). [2025-10-13T18:45:46.717621] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-13T18:45:46.718378] [FATAL] [VALIDATOR ] EPRT: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T18:45:46.718464] [FATAL] [MAIN ] EPRT: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:45:46.718508] [WARN ] [MAIN ] EPRT: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:45:46.718581] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-13T18:45:46.718687] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-10-13T18:45:46.718807] [INFO ] [LOCAL ] EPRT: Starting deletion of derivative data. [2025-10-13T18:45:46.719053] [DEBUG] [LOCAL ] EPRT: Deleted derivative data file. [2025-10-13T18:45:46.719956] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EPRT took 31.6s. Estimated remaining: 3h 45m 24s. Rate: 7.2 symbols/min [2025-10-13T18:45:46.817894] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-13T18:45:47.617904] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-13T18:45:47.698479] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T18:45:47.700186] [INFO ] [REMOTE ] EQBK: Full fetch complete (15411 records). [2025-10-13T18:45:47.700260] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-13T18:45:48.071193] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-13T18:45:48.071320] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-13T18:45:48.071797] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-13T18:45:48.071880] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-13T18:45:48.072825] [DEBUG] [LOCAL ] EQBK: Trimmed 15411 records to 11061 (keeping 200 days of data) [2025-10-13T18:45:48.158579] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-13T18:45:48.186342] [DEBUG] [LOCAL ] EQBK: Primary data saved (11061 records). [2025-10-13T18:45:48.186492] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-13T18:45:48.186570] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQBK took 23.6s. Estimated remaining: 3h 45m 1s. Rate: 7.2 symbols/min [2025-10-13T18:45:48.417912] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-13T18:45:49.340160] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T18:45:49.351334] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-13T18:45:50.248386] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T18:45:50.259617] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-13T18:45:51.106140] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T18:45:51.117124] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-13T18:45:52.254419] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-13T18:45:52.265275] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-13T18:45:53.066724] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-13T18:45:53.077703] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-13T18:45:54.291661] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T18:45:54.303620] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-13T18:45:54.887288] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T18:45:54.897990] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-13T18:45:56.109356] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T18:45:56.120944] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-13T18:45:56.667058] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T18:45:56.678488] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-13T18:45:58.022939] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T18:45:58.036129] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-13T18:45:58.544694] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T18:45:58.556142] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-13T18:45:59.641316] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T18:45:59.647269] [INFO ] [REMOTE ] EQNR: Full fetch complete (76815 records). [2025-10-13T18:45:59.647467] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-13T18:46:00.056035] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-13T18:46:00.056145] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-13T18:46:00.057304] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-13T18:46:00.057372] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-13T18:46:00.059914] [DEBUG] [LOCAL ] EQNR: Trimmed 76815 records to 53028 (keeping 200 days of data) [2025-10-13T18:46:00.398431] [DEBUG] [LOCAL ] EQNR: Primary data saved (53028 records). [2025-10-13T18:46:00.398809] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-13T18:46:00.398920] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 29.7s. Estimated remaining: 3h 45m 1s. Rate: 7.2 symbols/min [2025-10-13T18:46:00.509281] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T18:46:00.524545] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-13T18:46:02.248506] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T18:46:02.254239] [INFO ] [REMOTE ] EQH: Full fetch complete (76393 records). [2025-10-13T18:46:02.254429] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-13T18:46:02.667181] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-13T18:46:02.667301] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-13T18:46:02.668846] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-13T18:46:02.668919] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-13T18:46:02.670934] [DEBUG] [LOCAL ] EQH: Trimmed 76393 records to 52685 (keeping 200 days of data) [2025-10-13T18:46:03.029570] [DEBUG] [LOCAL ] EQH: Primary data saved (52685 records). [2025-10-13T18:46:03.029911] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-13T18:46:03.030097] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQH took 37.2s. Estimated remaining: 3h 44m 41s. Rate: 7.2 symbols/min [2025-10-13T18:46:03.629632] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:03.663137] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:03.711812] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:03.720496] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-13T18:46:03.739713] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:03.740442] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-13T18:46:03.741696] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-13T18:46:03.741932] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-13T18:46:03.741992] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-13T18:46:03.742028] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-13T18:46:03.813921] [DEBUG] [LOCAL ] EQV: Loaded 2727 existing records from primary storage. [2025-10-13T18:46:03.841349] [INFO ] [MAIN ] EQV: Loaded 2727 existing records. [2025-10-13T18:46:04.191598] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-10-13T18:46:04.240611] [INFO ] [MAIN ] EQT: Loaded 54462 existing records. [2025-10-13T18:46:04.317148] [DEBUG] [LOCAL ] EQR: Loaded 52374 existing records from primary storage. [2025-10-13T18:46:04.354436] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:04.461127] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-13T18:46:04.472318] [INFO ] [MAIN ] EQR: Loaded 52374 existing records. [2025-10-13T18:46:04.504902] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-13T18:46:04.550000] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:04.565500] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-13T18:46:04.570998] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-13T18:46:04.628735] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-13T18:46:04.730287] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:04.791178] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-13T18:46:04.817678] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-13T18:46:04.884605] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-13T18:46:04.899083] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-13T18:46:04.888542] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:05.070503] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-13T18:46:05.108399] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-13T18:46:05.184885] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-13T18:46:05.228728] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-13T18:46:05.520563] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:05.514445] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-13T18:46:05.560525] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-13T18:46:05.566300] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-13T18:46:05.758948] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:05.808710] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-13T18:46:05.921392] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:05.921736] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-13T18:46:06.142856] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T18:46:06.143958] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-13T18:46:06.237990] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T18:46:06.240022] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-13T18:46:06.514040] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-13T18:46:06.514920] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-13T18:46:06.995096] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T18:46:06.997438] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-13T18:46:07.129712] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T18:46:07.130619] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-13T18:46:07.344882] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T18:46:07.355384] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-13T18:46:07.435141] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-13T18:46:07.605635] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T18:46:07.617878] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-13T18:46:07.774907] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T18:46:08.161029] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T18:46:08.417910] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-13T18:46:08.829736] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-13T18:46:09.040222] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T18:46:09.217926] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-13T18:46:09.656946] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T18:46:10.018001] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-13T18:46:10.818002] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-13T18:46:11.598474] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:46:11.617878] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-13T18:46:12.417905] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-13T18:46:12.756774] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T18:46:12.853301] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-13T18:46:13.217890] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-13T18:46:13.323690] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T18:46:13.789336] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T18:46:14.017924] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-13T18:46:14.470131] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-13T18:46:14.817924] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-13T18:46:15.617924] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-13T18:46:16.272001] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T18:46:16.320610] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T18:46:16.417894] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-13T18:46:16.975340] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T18:46:17.217932] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-13T18:46:18.017938] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-13T18:46:18.817994] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-13T18:46:19.030615] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T18:46:19.378046] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-13T18:46:19.618010] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-13T18:46:19.914378] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T18:46:20.075736] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T18:46:20.076479] [INFO ] [REMOTE ] EQS: Full fetch complete (2479 records). [2025-10-13T18:46:20.076544] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-13T18:46:20.251542] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-13T18:46:20.251788] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:46:20.251837] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:46:20.251876] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-13T18:46:20.251937] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-13T18:46:20.251970] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-13T18:46:20.252007] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-13T18:46:20.252061] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQS took 17.2s. Estimated remaining: 3h 44m 51s. Rate: 7.2 symbols/min [2025-10-13T18:46:20.420673] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-13T18:46:20.420606] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:20.471302] [DEBUG] [LOCAL ] ERJ: Loaded 51129 existing records from primary storage. [2025-10-13T18:46:20.471709] [INFO ] [MAIN ] ERJ: Loaded 51129 existing records. [2025-10-13T18:46:20.664483] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:20.664674] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-13T18:46:20.664735] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-13T18:46:20.665023] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-13T18:46:20.665080] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-13T18:46:20.943895] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T18:46:21.020996] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:21.217926] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-13T18:46:22.017908] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-13T18:46:22.806106] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T18:46:22.817885] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-13T18:46:23.626318] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-13T18:46:23.633411] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T18:46:24.321092] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T18:46:24.417935] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-13T18:46:25.217973] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-13T18:46:25.302639] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T18:46:26.017890] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-13T18:46:26.423970] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T18:46:26.473794] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T18:46:26.817916] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-13T18:46:27.617943] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-13T18:46:27.757534] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:46:28.036019] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-13T18:46:28.417898] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-13T18:46:28.732304] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T18:46:28.936622] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T18:46:29.217910] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-13T18:46:29.659196] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-13T18:46:29.660504] [INFO ] [REMOTE ] EQV: Full fetch complete (5721 records). [2025-10-13T18:46:29.660601] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-13T18:46:30.029890] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-13T18:46:30.085152] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-13T18:46:30.085257] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-13T18:46:30.085577] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-13T18:46:30.085686] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-13T18:46:30.086408] [DEBUG] [LOCAL ] EQV: Trimmed 5721 records to 2666 (keeping 200 days of data) [2025-10-13T18:46:30.114444] [DEBUG] [LOCAL ] EQV: Primary data saved (2666 records). [2025-10-13T18:46:30.114631] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-13T18:46:30.114809] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. EQV took 27.1s. Estimated remaining: 3h 44m 46s. Rate: 7.2 symbols/min [2025-10-13T18:46:30.404561] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:30.465980] [DEBUG] [LOCAL ] ERO: Loaded 42268 existing records from primary storage. [2025-10-13T18:46:30.466366] [INFO ] [MAIN ] ERO: Loaded 42268 existing records. [2025-10-13T18:46:30.713711] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:30.714000] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-13T18:46:30.714074] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-13T18:46:30.714626] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-13T18:46:30.714778] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-13T18:46:30.823146] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-13T18:46:31.134947] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:31.617917] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-13T18:46:31.812362] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T18:46:32.417980] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-13T18:46:32.865123] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-13T18:46:33.217921] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-13T18:46:33.257378] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T18:46:34.017932] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-13T18:46:34.189951] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T18:46:34.817932] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-13T18:46:35.175402] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T18:46:35.233246] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-13T18:46:35.617987] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-13T18:46:36.418008] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-13T18:46:36.886918] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-13T18:46:36.892369] [INFO ] [REMOTE ] EQR: Full fetch complete (74156 records). [2025-10-13T18:46:36.892484] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-13T18:46:37.227293] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-13T18:46:37.285040] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-13T18:46:37.285114] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-13T18:46:37.286000] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-13T18:46:37.286061] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-13T18:46:37.287441] [DEBUG] [LOCAL ] EQR: Trimmed 74156 records to 51677 (keeping 200 days of data) [2025-10-13T18:46:37.615289] [DEBUG] [LOCAL ] EQR: Primary data saved (51677 records). [2025-10-13T18:46:37.615435] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-13T18:46:37.616221] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. EQR took 34.6s. Estimated remaining: 3h 44m 35s. Rate: 7.2 symbols/min [2025-10-13T18:46:37.790686] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:37.823195] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-13T18:46:37.881408] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:46:37.908053] [DEBUG] [LOCAL ] ES: Loaded 53386 existing records from primary storage. [2025-10-13T18:46:37.908425] [INFO ] [MAIN ] ES: Loaded 53386 existing records. [2025-10-13T18:46:38.023083] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-13T18:46:38.084475] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:38.084739] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-13T18:46:38.084791] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-13T18:46:38.085379] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-13T18:46:38.085434] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-13T18:46:38.428723] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:38.817913] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-13T18:46:39.116522] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T18:46:39.599623] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:46:39.617876] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-13T18:46:40.417897] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-13T18:46:40.524832] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T18:46:40.853898] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T18:46:41.217931] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-13T18:46:41.816984] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T18:46:42.017938] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-13T18:46:42.577704] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T18:46:42.817946] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-13T18:46:43.617948] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-13T18:46:43.950932] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-13T18:46:43.957482] [INFO ] [REMOTE ] EQT: Full fetch complete (77694 records). [2025-10-13T18:46:43.957607] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-13T18:46:44.355730] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-13T18:46:44.355913] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-13T18:46:44.356821] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-13T18:46:44.356936] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-13T18:46:44.358580] [DEBUG] [LOCAL ] EQT: Trimmed 77694 records to 53685 (keeping 200 days of data) [2025-10-13T18:46:44.419300] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-13T18:46:44.597202] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-13T18:46:44.715365] [DEBUG] [LOCAL ] EQT: Primary data saved (53685 records). [2025-10-13T18:46:44.715480] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-13T18:46:44.715604] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. EQT took 41.7s. Estimated remaining: 3h 44m 24s. Rate: 7.2 symbols/min [2025-10-13T18:46:44.883699] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:44.909953] [DEBUG] [LOCAL ] ESAB: Loaded 26416 existing records from primary storage. [2025-10-13T18:46:44.910200] [INFO ] [MAIN ] ESAB: Loaded 26416 existing records. [2025-10-13T18:46:45.091237] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:45.092192] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-13T18:46:45.092250] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-13T18:46:45.092924] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-13T18:46:45.092991] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-13T18:46:45.218241] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-13T18:46:45.382401] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T18:46:45.488299] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:45.823453] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T18:46:46.017918] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-13T18:46:46.817901] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-13T18:46:46.880139] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T18:46:47.241796] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T18:46:47.617921] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-13T18:46:48.417901] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-13T18:46:48.600031] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T18:46:49.217939] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-13T18:46:49.417531] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:46:49.471242] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-13T18:46:50.017947] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-13T18:46:50.817980] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-13T18:46:50.901790] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T18:46:51.617900] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-13T18:46:51.832358] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T18:46:51.859384] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T18:46:52.418022] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-13T18:46:53.217932] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-13T18:46:53.493895] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T18:46:53.795577] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T18:46:53.800694] [INFO ] [REMOTE ] ERJ: Full fetch complete (72443 records). [2025-10-13T18:46:53.800814] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-13T18:46:54.023076] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-13T18:46:54.185361] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-13T18:46:54.185452] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-13T18:46:54.186677] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-13T18:46:54.186825] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-13T18:46:54.190409] [DEBUG] [LOCAL ] ERJ: Trimmed 72443 records to 50324 (keeping 200 days of data) [2025-10-13T18:46:54.330506] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T18:46:54.510855] [DEBUG] [LOCAL ] ERJ: Primary data saved (50324 records). [2025-10-13T18:46:54.511015] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-13T18:46:54.511144] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ERJ took 34.3s. Estimated remaining: 3h 44m 19s. Rate: 7.2 symbols/min [2025-10-13T18:46:54.675439] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:46:54.691831] [DEBUG] [LOCAL ] ESE: Loaded 16766 existing records from primary storage. [2025-10-13T18:46:54.692037] [INFO ] [MAIN ] ESE: Loaded 16766 existing records. [2025-10-13T18:46:54.834315] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-13T18:46:54.885983] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:46:54.886225] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-13T18:46:54.886271] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-13T18:46:54.886546] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-13T18:46:54.886601] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-13T18:46:55.233995] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:46:55.575286] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T18:46:55.617902] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-13T18:46:56.315718] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-13T18:46:56.417898] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-13T18:46:56.596489] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T18:46:57.217892] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-13T18:46:57.648471] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T18:46:58.018007] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-13T18:46:58.817914] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-13T18:46:58.865034] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T18:46:58.993873] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T18:46:59.617948] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-13T18:46:59.770797] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-13T18:47:00.417930] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-13T18:47:00.647895] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T18:47:01.217941] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-13T18:47:02.018052] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-13T18:47:02.154841] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:47:02.308792] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T18:47:02.817928] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-13T18:47:03.116335] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T18:47:03.617899] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-13T18:47:04.011566] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T18:47:04.417940] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-13T18:47:05.217917] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-13T18:47:05.299606] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T18:47:05.461390] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T18:47:06.017922] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-13T18:47:06.478485] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T18:47:06.679693] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-13T18:47:06.817898] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-13T18:47:07.617914] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-13T18:47:07.856250] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T18:47:08.417943] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-13T18:47:09.217899] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-13T18:47:09.462489] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-13T18:47:09.715985] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T18:47:10.017889] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-13T18:47:10.283096] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T18:47:10.817887] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-13T18:47:11.617902] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-13T18:47:11.751914] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T18:47:11.774916] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T18:47:12.418039] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-13T18:47:13.217898] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-13T18:47:13.328315] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-13T18:47:14.017998] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-13T18:47:14.189937] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T18:47:14.496269] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T18:47:14.817938] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-13T18:47:15.527243] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T18:47:15.532754] [INFO ] [REMOTE ] ES: Full fetch complete (76259 records). [2025-10-13T18:47:15.532871] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-13T18:47:15.623126] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-13T18:47:15.722553] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:47:15.816416] [INFO ] [REMOTE ] ERO: Full fetch complete (59925 records). [2025-10-13T18:47:15.837740] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-13T18:47:16.102078] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-13T18:47:16.111378] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-13T18:47:16.128302] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-13T18:47:16.130624] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-13T18:47:16.230116] [DEBUG] [LOCAL ] ES: Trimmed 76259 records to 52672 (keeping 200 days of data) [2025-10-13T18:47:16.433366] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-13T18:47:16.439845] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-13T18:47:16.441685] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-13T18:47:16.442777] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-13T18:47:16.446229] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-13T18:47:16.460782] [DEBUG] [LOCAL ] ERO: Trimmed 59925 records to 41700 (keeping 200 days of data) [2025-10-13T18:47:16.809310] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T18:47:16.916984] [DEBUG] [LOCAL ] ES: Primary data saved (52672 records). [2025-10-13T18:47:16.917895] [INFO ] [MAIN ] ES: Full history saved. [2025-10-13T18:47:16.919241] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ES took 39.3s. Estimated remaining: 3h 44m 40s. Rate: 7.1 symbols/min [2025-10-13T18:47:17.107491] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:17.109538] [DEBUG] [LOCAL ] ERO: Primary data saved (41700 records). [2025-10-13T18:47:17.110036] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-13T18:47:17.110145] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ERO took 47.0s. Estimated remaining: 3h 44m 14s. Rate: 7.2 symbols/min [2025-10-13T18:47:17.222281] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-13T18:47:17.283470] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:17.321984] [DEBUG] [LOCAL ] ESI: Loaded 51434 existing records from primary storage. [2025-10-13T18:47:17.322322] [INFO ] [MAIN ] ESI: Loaded 51434 existing records. [2025-10-13T18:47:17.542357] [DEBUG] [LOCAL ] ESNT: Loaded 38858 existing records from primary storage. [2025-10-13T18:47:17.547102] [INFO ] [MAIN ] ESNT: Loaded 38858 existing records. [2025-10-13T18:47:17.546498] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:17.584551] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-13T18:47:17.615904] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-13T18:47:17.656184] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-13T18:47:17.656487] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-13T18:47:17.802586] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T18:47:17.830610] [INFO ] [REMOTE ] ESAB: Full fetch complete (35775 records). [2025-10-13T18:47:17.871265] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-13T18:47:17.865985] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:17.901739] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-13T18:47:17.901834] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-13T18:47:17.931009] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-13T18:47:17.941525] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-13T18:47:18.609805] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T18:47:18.623001] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:18.653177] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-13T18:47:18.697758] [INFO ] [REMOTE ] ESE: Full fetch complete (22500 records). [2025-10-13T18:47:18.737385] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-13T18:47:18.964142] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-13T18:47:18.980562] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-13T18:47:19.034587] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:19.035326] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-13T18:47:19.039319] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-13T18:47:19.039462] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-13T18:47:19.115296] [DEBUG] [LOCAL ] ESAB: Trimmed 35775 records to 26029 (keeping 200 days of data) [2025-10-13T18:47:19.412494] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-13T18:47:19.416401] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-13T18:47:19.420807] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-13T18:47:19.420887] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-13T18:47:19.429130] [DEBUG] [LOCAL ] ESE: Trimmed 22500 records to 16500 (keeping 200 days of data) [2025-10-13T18:47:19.569749] [DEBUG] [LOCAL ] ESE: Primary data saved (16500 records). [2025-10-13T18:47:19.570436] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-13T18:47:19.570821] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESE took 25.1s. Estimated remaining: 3h 43m 54s. Rate: 7.2 symbols/min [2025-10-13T18:47:19.688674] [DEBUG] [LOCAL ] ESAB: Primary data saved (26029 records). [2025-10-13T18:47:19.699046] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-13T18:47:19.704278] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESAB took 35.0s. Estimated remaining: 3h 43m 28s. Rate: 7.2 symbols/min [2025-10-13T18:47:19.817238] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:19.925573] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:19.966546] [DEBUG] [LOCAL ] ESRT: Loaded 46989 existing records from primary storage. [2025-10-13T18:47:19.966932] [INFO ] [MAIN ] ESRT: Loaded 46989 existing records. [2025-10-13T18:47:20.077932] [DEBUG] [LOCAL ] ESS: Loaded 30192 existing records from primary storage. [2025-10-13T18:47:20.093831] [INFO ] [MAIN ] ESS: Loaded 30192 existing records. [2025-10-13T18:47:20.214704] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:20.245450] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-13T18:47:20.264758] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-13T18:47:20.271180] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-13T18:47:20.276505] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-13T18:47:20.420719] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:20.436853] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-13T18:47:20.458000] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-13T18:47:20.484673] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-13T18:47:20.517694] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-13T18:47:20.704524] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-13T18:47:20.770167] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-13T18:47:20.965778] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T18:47:21.006962] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-13T18:47:21.087142] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:21.227019] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-13T18:47:21.232255] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:22.017994] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-13T18:47:22.373883] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T18:47:22.524186] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-13T18:47:22.766107] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T18:47:22.817879] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-13T18:47:23.252129] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T18:47:23.618050] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-13T18:47:24.390075] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:47:24.417990] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-13T18:47:25.217916] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-13T18:47:25.299614] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T18:47:25.917304] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T18:47:26.017926] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-13T18:47:26.817998] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:47:26.818080] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-13T18:47:27.157521] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T18:47:27.617978] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-13T18:47:28.140471] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T18:47:28.417985] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-13T18:47:29.180417] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T18:47:29.217890] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-13T18:47:29.606128] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T18:47:30.017918] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-13T18:47:30.730371] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T18:47:30.817920] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-13T18:47:31.526085] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T18:47:31.617949] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-13T18:47:32.313917] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:47:32.418004] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-13T18:47:32.936309] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T18:47:33.218059] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-13T18:47:33.386792] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:47:34.018007] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-13T18:47:34.786034] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T18:47:34.817882] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-13T18:47:35.623037] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-13T18:47:35.646922] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T18:47:36.417906] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-13T18:47:36.556593] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T18:47:36.626575] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:47:37.217938] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-13T18:47:38.017918] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-13T18:47:38.161832] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T18:47:38.632241] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T18:47:38.818053] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-13T18:47:39.564996] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T18:47:39.617932] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-13T18:47:40.418919] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-13T18:47:40.424738] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-13T18:47:41.217979] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-13T18:47:41.267222] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T18:47:41.783036] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T18:47:42.017919] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-13T18:47:42.798596] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T18:47:42.817887] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-13T18:47:43.144971] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T18:47:43.617970] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-13T18:47:44.266003] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T18:47:44.417939] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-13T18:47:44.787706] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T18:47:44.790930] [INFO ] [REMOTE ] ESS: Full fetch complete (43271 records). [2025-10-13T18:47:44.791012] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-13T18:47:45.157765] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-13T18:47:45.157844] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-13T18:47:45.158503] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-13T18:47:45.158566] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-13T18:47:45.159461] [DEBUG] [LOCAL ] ESS: Trimmed 43271 records to 29854 (keeping 200 days of data) [2025-10-13T18:47:45.222987] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-13T18:47:45.350630] [DEBUG] [LOCAL ] ESS: Primary data saved (29854 records). [2025-10-13T18:47:45.350795] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-13T18:47:45.350878] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESS took 25.6s. Estimated remaining: 3h 43m 56s. Rate: 7.1 symbols/min [2025-10-13T18:47:45.513724] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:45.559676] [DEBUG] [LOCAL ] ESTC: Loaded 50869 existing records from primary storage. [2025-10-13T18:47:45.559980] [INFO ] [MAIN ] ESTC: Loaded 50869 existing records. [2025-10-13T18:47:45.731239] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:45.731793] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-13T18:47:45.731843] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-13T18:47:45.732831] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-13T18:47:45.732887] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-13T18:47:46.022998] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-13T18:47:46.084361] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:46.213519] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:47:46.348964] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T18:47:46.818018] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-13T18:47:47.486047] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T18:47:47.617918] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-13T18:47:48.353268] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T18:47:48.417895] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-13T18:47:49.218015] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-13T18:47:49.353605] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:47:49.920582] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T18:47:50.017949] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-13T18:47:50.605177] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T18:47:50.611258] [INFO ] [REMOTE ] ESNT: Full fetch complete (57103 records). [2025-10-13T18:47:50.611429] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-13T18:47:50.824108] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-13T18:47:51.006355] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-13T18:47:51.006445] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-13T18:47:51.007242] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-13T18:47:51.007305] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-13T18:47:51.009880] [DEBUG] [LOCAL ] ESNT: Trimmed 57103 records to 38336 (keeping 200 days of data) [2025-10-13T18:47:51.249843] [DEBUG] [LOCAL ] ESNT: Primary data saved (38336 records). [2025-10-13T18:47:51.249998] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-13T18:47:51.250094] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESNT took 34.1s. Estimated remaining: 3h 43m 42s. Rate: 7.2 symbols/min [2025-10-13T18:47:51.423355] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:51.490487] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:47:51.491895] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-10-13T18:47:51.497060] [INFO ] [MAIN ] ET: Loaded 54569 existing records. [2025-10-13T18:47:51.528793] [INFO ] [REMOTE ] ESRT: Full fetch complete (66442 records). [2025-10-13T18:47:51.572260] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-13T18:47:51.623060] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-13T18:47:51.795274] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:51.817801] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-13T18:47:51.823050] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-13T18:47:51.850157] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-13T18:47:51.857567] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-13T18:47:52.311164] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-13T18:47:52.320913] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-13T18:47:52.344119] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-13T18:47:52.344434] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-13T18:47:52.389063] [DEBUG] [LOCAL ] ESRT: Trimmed 66442 records to 46391 (keeping 200 days of data) [2025-10-13T18:47:52.539420] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:52.549254] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-13T18:47:52.628056] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:47:52.828966] [DEBUG] [LOCAL ] ESRT: Primary data saved (46391 records). [2025-10-13T18:47:52.829169] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-13T18:47:52.829273] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESRT took 33.3s. Estimated remaining: 3h 43m 20s. Rate: 7.2 symbols/min [2025-10-13T18:47:53.006457] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:53.023084] [DEBUG] [LOCAL ] ETB: Loaded 12334 existing records from primary storage. [2025-10-13T18:47:53.023384] [INFO ] [MAIN ] ETB: Loaded 12334 existing records. [2025-10-13T18:47:53.215235] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:53.215622] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-13T18:47:53.215773] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-13T18:47:53.216189] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-13T18:47:53.216254] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-13T18:47:53.229087] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-13T18:47:53.610147] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-13T18:47:53.643775] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:54.018025] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-13T18:47:54.553975] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-13T18:47:54.817947] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-13T18:47:55.069254] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T18:47:55.618000] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-13T18:47:55.804949] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T18:47:56.417922] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-13T18:47:56.994012] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-13T18:47:57.198980] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T18:47:57.204243] [INFO ] [REMOTE ] ESI: Full fetch complete (72890 records). [2025-10-13T18:47:57.204371] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-13T18:47:57.225523] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-13T18:47:57.598938] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-13T18:47:57.599125] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-13T18:47:57.600139] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-13T18:47:57.600223] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-13T18:47:57.601947] [DEBUG] [LOCAL ] ESI: Trimmed 72890 records to 50681 (keeping 200 days of data) [2025-10-13T18:47:57.730194] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T18:47:57.950846] [DEBUG] [LOCAL ] ESI: Primary data saved (50681 records). [2025-10-13T18:47:57.951003] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-13T18:47:57.951091] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ESI took 41.0s. Estimated remaining: 3h 43m 4s. Rate: 7.2 symbols/min [2025-10-13T18:47:58.024168] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-13T18:47:58.121189] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:47:58.146709] [DEBUG] [LOCAL ] ETD: Loaded 27732 existing records from primary storage. [2025-10-13T18:47:58.147001] [INFO ] [MAIN ] ETD: Loaded 27732 existing records. [2025-10-13T18:47:58.319937] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:47:58.320181] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-13T18:47:58.320226] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-13T18:47:58.320485] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-13T18:47:58.320540] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-13T18:47:58.677432] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:47:58.817998] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-13T18:47:58.921858] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T18:47:59.172369] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-13T18:47:59.617926] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-13T18:48:00.386345] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T18:48:00.417926] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-13T18:48:01.217949] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-13T18:48:01.785630] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-13T18:48:01.810452] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T18:48:02.021556] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-13T18:48:02.817990] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-13T18:48:03.057581] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T18:48:03.557285] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T18:48:03.617880] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-13T18:48:04.103548] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-13T18:48:04.273968] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T18:48:04.417877] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-13T18:48:05.217898] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-13T18:48:05.422506] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T18:48:06.017948] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-13T18:48:06.665440] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T18:48:06.818011] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-13T18:48:07.034292] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T18:48:07.617913] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-13T18:48:07.803289] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:48:08.417898] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-13T18:48:08.803769] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T18:48:09.217943] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-13T18:48:10.017915] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-13T18:48:10.130895] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T18:48:10.772401] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T18:48:10.817883] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-13T18:48:11.333557] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-13T18:48:11.446990] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T18:48:11.617934] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-13T18:48:12.417904] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-13T18:48:13.217928] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-13T18:48:13.354668] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T18:48:13.703285] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T18:48:13.995793] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-13T18:48:14.017918] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-13T18:48:14.818013] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-13T18:48:14.841894] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-13T18:48:15.617930] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-13T18:48:16.418016] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-13T18:48:17.026906] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-13T18:48:17.217935] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-13T18:48:17.484441] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T18:48:17.688625] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T18:48:18.017985] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-13T18:48:18.817994] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-13T18:48:19.388964] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T18:48:19.497364] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-13T18:48:19.617983] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-13T18:48:19.644741] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T18:48:19.646708] [INFO ] [REMOTE ] ETB: Full fetch complete (18294 records). [2025-10-13T18:48:19.646777] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-13T18:48:20.014503] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-13T18:48:20.014627] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-13T18:48:20.015068] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-13T18:48:20.015114] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-13T18:48:20.015638] [DEBUG] [LOCAL ] ETB: Trimmed 18294 records to 12121 (keeping 200 days of data) [2025-10-13T18:48:20.089020] [DEBUG] [LOCAL ] ETB: Primary data saved (12121 records). [2025-10-13T18:48:20.089156] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-13T18:48:20.089251] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ETB took 27.3s. Estimated remaining: 3h 43m 24s. Rate: 7.1 symbols/min [2025-10-13T18:48:20.258507] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:20.276067] [DEBUG] [LOCAL ] ETG: Loaded 16762 existing records from primary storage. [2025-10-13T18:48:20.276290] [INFO ] [MAIN ] ETG: Loaded 16762 existing records. [2025-10-13T18:48:20.424964] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-13T18:48:20.458745] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:48:20.459033] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-13T18:48:20.459082] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-13T18:48:20.459337] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-13T18:48:20.459394] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-13T18:48:20.820471] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:20.911137] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T18:48:21.218003] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-13T18:48:22.017932] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-13T18:48:22.153777] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T18:48:22.321102] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T18:48:22.817939] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-13T18:48:22.930337] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T18:48:23.617930] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-13T18:48:24.417927] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-13T18:48:24.838075] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-13T18:48:24.860793] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T18:48:25.218005] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-13T18:48:26.017940] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-13T18:48:26.055616] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:48:26.060904] [INFO ] [REMOTE ] ESTC: Full fetch complete (72146 records). [2025-10-13T18:48:26.061022] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-13T18:48:26.448955] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-13T18:48:26.449026] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-13T18:48:26.449920] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-13T18:48:26.449984] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-13T18:48:26.451387] [DEBUG] [LOCAL ] ESTC: Trimmed 72146 records to 50268 (keeping 200 days of data) [2025-10-13T18:48:26.753615] [DEBUG] [LOCAL ] ESTC: Primary data saved (50268 records). [2025-10-13T18:48:26.753780] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-13T18:48:26.753863] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ESTC took 41.4s. Estimated remaining: 3h 43m 13s. Rate: 7.2 symbols/min [2025-10-13T18:48:26.826126] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-13T18:48:26.976460] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:26.993680] [DEBUG] [LOCAL ] ETJ: Loaded 17190 existing records from primary storage. [2025-10-13T18:48:26.993939] [INFO ] [MAIN ] ETJ: Loaded 17190 existing records. [2025-10-13T18:48:27.138623] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:48:27.202158] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:48:27.202757] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-13T18:48:27.202882] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-13T18:48:27.203344] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-13T18:48:27.203484] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-13T18:48:27.516732] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-13T18:48:27.619011] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-13T18:48:27.631822] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:28.116298] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T18:48:28.417984] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-13T18:48:28.613265] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T18:48:29.218005] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-13T18:48:29.575320] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T18:48:30.017937] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-13T18:48:30.103851] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T18:48:30.818009] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-13T18:48:31.617893] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-13T18:48:31.921029] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T18:48:32.121808] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-13T18:48:32.128996] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-13T18:48:32.129145] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-13T18:48:32.419486] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-13T18:48:32.520359] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-13T18:48:32.520437] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-13T18:48:32.521321] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-13T18:48:32.521386] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-13T18:48:32.522908] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-10-13T18:48:32.834398] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T18:48:32.839291] [INFO ] [REMOTE ] ETD: Full fetch complete (38472 records). [2025-10-13T18:48:32.840468] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-13T18:48:32.965903] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-13T18:48:32.981358] [INFO ] [MAIN ] ET: Full history saved. [2025-10-13T18:48:32.986587] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ET took 41.7s. Estimated remaining: 3h 42m 60s. Rate: 7.2 symbols/min [2025-10-13T18:48:33.221244] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-13T18:48:33.331992] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:33.438760] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-13T18:48:33.439049] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-13T18:48:33.439855] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-13T18:48:33.439973] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-13T18:48:33.440930] [DEBUG] [LOCAL ] ETD: Trimmed 38472 records to 27310 (keeping 200 days of data) [2025-10-13T18:48:33.542752] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:48:33.612828] [DEBUG] [LOCAL ] ETN: Loaded 53462 existing records from primary storage. [2025-10-13T18:48:33.613187] [INFO ] [MAIN ] ETN: Loaded 53462 existing records. [2025-10-13T18:48:33.773043] [DEBUG] [LOCAL ] ETD: Primary data saved (27310 records). [2025-10-13T18:48:33.783422] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-13T18:48:33.796037] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETD took 35.8s. Estimated remaining: 3h 42m 36s. Rate: 7.2 symbols/min [2025-10-13T18:48:33.920690] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:48:33.944589] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-13T18:48:33.946728] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-13T18:48:33.952455] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-13T18:48:33.957637] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-13T18:48:34.039497] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-13T18:48:34.114919] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:34.291161] [DEBUG] [LOCAL ] ETO: Loaded 6988 existing records from primary storage. [2025-10-13T18:48:34.329808] [INFO ] [MAIN ] ETO: Loaded 6988 existing records. [2025-10-13T18:48:34.343347] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T18:48:34.518033] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:34.593157] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:48:34.593378] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-13T18:48:34.593424] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-13T18:48:34.593627] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-13T18:48:34.593717] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-13T18:48:34.830846] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-13T18:48:34.947419] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:35.089851] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T18:48:35.617927] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-13T18:48:35.884052] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T18:48:36.243135] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-13T18:48:36.417895] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-13T18:48:37.089433] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T18:48:37.218013] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-13T18:48:38.017993] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-13T18:48:38.299531] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T18:48:38.818008] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-13T18:48:39.617912] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-13T18:48:39.962117] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-13T18:48:39.983978] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T18:48:40.417897] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-13T18:48:40.659617] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T18:48:40.999508] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T18:48:41.218027] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-13T18:48:42.017893] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-13T18:48:42.321034] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T18:48:42.817915] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-13T18:48:43.593677] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T18:48:43.617884] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-13T18:48:44.052559] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-13T18:48:44.161060] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T18:48:44.417928] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-13T18:48:45.217921] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-13T18:48:45.953941] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T18:48:46.017900] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-13T18:48:46.358933] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-13T18:48:46.783343] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T18:48:46.817928] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-13T18:48:47.542317] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T18:48:47.617911] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-13T18:48:48.417989] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-13T18:48:48.579911] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T18:48:49.074619] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T18:48:49.217930] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-13T18:48:49.846056] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T18:48:50.018013] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-13T18:48:50.626914] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T18:48:50.817934] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-13T18:48:51.617926] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-13T18:48:51.853434] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-13T18:48:52.417979] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-13T18:48:53.209755] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T18:48:53.217875] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-13T18:48:53.609666] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T18:48:54.017937] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-13T18:48:54.047801] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:48:54.817891] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-13T18:48:54.998501] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T18:48:55.617921] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-13T18:48:56.417983] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-13T18:48:56.660597] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T18:48:56.662597] [INFO ] [REMOTE ] ETG: Full fetch complete (24733 records). [2025-10-13T18:48:56.662704] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-13T18:48:56.986610] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T18:48:57.018476] [INFO ] [REMOTE ] ETO: Full fetch complete (9691 records). [2025-10-13T18:48:57.020699] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-13T18:48:57.091926] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-13T18:48:57.103723] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-13T18:48:57.134538] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-13T18:48:57.175547] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-13T18:48:57.230479] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-13T18:48:57.240540] [DEBUG] [LOCAL ] ETG: Trimmed 24733 records to 16585 (keeping 200 days of data) [2025-10-13T18:48:57.197247] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-13T18:48:57.539559] [DEBUG] [LOCAL ] ETG: Primary data saved (16585 records). [2025-10-13T18:48:57.556202] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-13T18:48:57.557167] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETG took 37.5s. Estimated remaining: 3h 42m 59s. Rate: 7.1 symbols/min [2025-10-13T18:48:57.596393] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-13T18:48:57.608113] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-13T18:48:57.629477] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-13T18:48:57.635199] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-13T18:48:57.658002] [DEBUG] [LOCAL ] ETO: Trimmed 9691 records to 6923 (keeping 200 days of data) [2025-10-13T18:48:57.780158] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:57.786680] [DEBUG] [LOCAL ] ETO: Primary data saved (6923 records). [2025-10-13T18:48:57.786768] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-13T18:48:57.786951] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETO took 24.0s. Estimated remaining: 3h 42m 34s. Rate: 7.2 symbols/min [2025-10-13T18:48:57.959681] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:48:57.973119] [DEBUG] [LOCAL ] ETSY: No existing data file found in primary storage. [2025-10-13T18:48:57.973212] [WARN ] [MAIN ] ETSY: No existing data found, performing full refresh instead. [2025-10-13T18:48:57.973337] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-13T18:48:57.973380] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-13T18:48:57.973422] [DEBUG] [LOCAL ] ETSY: No primary data file found to delete. [2025-10-13T18:48:57.973453] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-13T18:48:58.028899] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-13T18:48:58.101912] [DEBUG] [LOCAL ] ETR: Loaded 53997 existing records from primary storage. [2025-10-13T18:48:58.140525] [INFO ] [MAIN ] ETR: Loaded 53997 existing records. [2025-10-13T18:48:58.498212] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:58.540444] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:48:58.537190] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:48:58.540697] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-13T18:48:58.540837] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-13T18:48:58.546211] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-13T18:48:58.546277] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-13T18:48:58.826222] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-13T18:48:58.918711] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:48:59.617991] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-13T18:48:59.822753] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T18:48:59.825059] [INFO ] [REMOTE ] ETJ: Full fetch complete (25535 records). [2025-10-13T18:48:59.825128] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-13T18:49:00.196285] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-13T18:49:00.196522] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-13T18:49:00.197114] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-13T18:49:00.197195] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-13T18:49:00.229861] [DEBUG] [LOCAL ] ETJ: Trimmed 25535 records to 16965 (keeping 200 days of data) [2025-10-13T18:49:00.235818] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-13T18:49:00.349689] [DEBUG] [LOCAL ] ETJ: Primary data saved (16965 records). [2025-10-13T18:49:00.349832] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-13T18:49:00.349916] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETJ took 33.6s. Estimated remaining: 3h 42m 14s. Rate: 7.2 symbols/min [2025-10-13T18:49:00.423539] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-13T18:49:00.519831] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:00.541370] [DEBUG] [LOCAL ] ETV: Loaded 22566 existing records from primary storage. [2025-10-13T18:49:00.541690] [INFO ] [MAIN ] ETV: Loaded 22566 existing records. [2025-10-13T18:49:00.721501] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:00.721765] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-13T18:49:00.721814] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-13T18:49:00.722126] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-13T18:49:00.722182] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-13T18:49:01.086281] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:01.217907] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-13T18:49:01.537557] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-13T18:49:02.017912] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2024-12. [2025-10-13T18:49:02.310397] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T18:49:02.311592] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T18:49:02.817936] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-13T18:49:03.617898] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-13T18:49:03.708912] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T18:49:04.417989] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-13T18:49:04.803911] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T18:49:04.992567] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-13T18:49:05.217920] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-13T18:49:06.018005] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-13T18:49:06.215199] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T18:49:06.434778] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T18:49:06.817906] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-13T18:49:06.858087] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T18:49:07.617935] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-13T18:49:08.417917] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-13T18:49:08.715123] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T18:49:08.910828] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-13T18:49:09.218014] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-13T18:49:10.017951] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-13T18:49:10.065349] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T18:49:10.503763] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T18:49:10.817945] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-13T18:49:11.617901] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-13T18:49:11.680316] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T18:49:12.274776] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T18:49:12.417890] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-13T18:49:12.493173] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T18:49:13.217933] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-13T18:49:14.017993] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-13T18:49:14.344366] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T18:49:14.603361] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-13T18:49:14.817942] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-13T18:49:15.617894] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-13T18:49:15.830604] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T18:49:15.940796] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-13T18:49:16.417922] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-13T18:49:17.217946] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-13T18:49:17.515758] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-13T18:49:17.523792] [INFO ] [REMOTE ] ETN: Full fetch complete (76516 records). [2025-10-13T18:49:17.524011] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-13T18:49:17.917053] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-13T18:49:17.917137] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-13T18:49:17.918096] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-13T18:49:17.918162] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-13T18:49:17.919615] [DEBUG] [LOCAL ] ETN: Trimmed 76516 records to 52670 (keeping 200 days of data) [2025-10-13T18:49:18.021680] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-13T18:49:18.284273] [DEBUG] [LOCAL ] ETN: Primary data saved (52670 records). [2025-10-13T18:49:18.285058] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-13T18:49:18.286379] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETN took 45.3s. Estimated remaining: 3h 42m 25s. Rate: 7.1 symbols/min [2025-10-13T18:49:18.286165] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T18:49:18.483696] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:18.507676] [DEBUG] [LOCAL ] ETW: Loaded 25898 existing records from primary storage. [2025-10-13T18:49:18.507951] [INFO ] [MAIN ] ETW: Loaded 25898 existing records. [2025-10-13T18:49:18.705186] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:18.705613] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-13T18:49:18.705722] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-13T18:49:18.706853] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-13T18:49:18.706929] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-13T18:49:18.818795] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-13T18:49:19.051152] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T18:49:19.123112] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:19.137291] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T18:49:19.617917] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-13T18:49:20.418018] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-13T18:49:20.760409] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T18:49:20.774270] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T18:49:21.218010] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-13T18:49:22.017915] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-13T18:49:22.332106] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T18:49:22.364000] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T18:49:22.817919] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-13T18:49:22.975148] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T18:49:23.617928] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-13T18:49:24.417938] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-13T18:49:24.684103] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T18:49:24.849851] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T18:49:24.853305] [INFO ] [REMOTE ] ETV: Full fetch complete (32408 records). [2025-10-13T18:49:24.853384] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-13T18:49:25.223051] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-13T18:49:25.283289] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-13T18:49:25.283473] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-13T18:49:25.284376] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-13T18:49:25.284461] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-13T18:49:25.285762] [DEBUG] [LOCAL ] ETV: Trimmed 32408 records to 22265 (keeping 200 days of data) [2025-10-13T18:49:25.483279] [DEBUG] [LOCAL ] ETV: Primary data saved (22265 records). [2025-10-13T18:49:25.483469] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-13T18:49:25.483594] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETV took 25.1s. Estimated remaining: 3h 42m 14s. Rate: 7.2 symbols/min [2025-10-13T18:49:25.755904] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:25.757609] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T18:49:25.770005] [DEBUG] [LOCAL ] ETX: Loaded 5251 existing records from primary storage. [2025-10-13T18:49:25.770276] [INFO ] [MAIN ] ETX: Loaded 5251 existing records. [2025-10-13T18:49:25.999745] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:26.000027] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-13T18:49:26.000078] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-13T18:49:26.000315] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-13T18:49:26.000406] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-13T18:49:26.023090] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-13T18:49:26.407300] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:26.817915] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-13T18:49:27.350817] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-13T18:49:27.617903] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-13T18:49:27.937605] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-13T18:49:27.982434] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T18:49:28.417923] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-13T18:49:29.217894] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-13T18:49:29.284408] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:49:30.015057] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T18:49:30.017879] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-13T18:49:30.237466] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T18:49:30.339015] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-13T18:49:30.817923] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-13T18:49:31.617978] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-13T18:49:32.206525] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-13T18:49:32.225969] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:49:32.417896] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-13T18:49:32.832284] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-13T18:49:33.217924] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-13T18:49:34.017904] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-13T18:49:34.818027] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-13T18:49:35.091214] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-13T18:49:35.197363] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-13T18:49:35.203300] [INFO ] [REMOTE ] ETSY: Full fetch complete (77534 records). [2025-10-13T18:49:35.203455] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-13T18:49:35.605090] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-13T18:49:35.605181] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-13T18:49:35.606133] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-13T18:49:35.606203] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-13T18:49:35.607622] [DEBUG] [LOCAL ] ETSY: Trimmed 77534 records to 53582 (keeping 200 days of data) [2025-10-13T18:49:35.660115] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-13T18:49:35.924419] [DEBUG] [LOCAL ] ETSY: Primary data saved (53582 records). [2025-10-13T18:49:35.924558] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-13T18:49:35.924631] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETSY took 38.1s. Estimated remaining: 3h 42m 10s. Rate: 7.1 symbols/min [2025-10-13T18:49:36.091460] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:36.112918] [DEBUG] [LOCAL ] ETY: Loaded 23411 existing records from primary storage. [2025-10-13T18:49:36.113172] [INFO ] [MAIN ] ETY: Loaded 23411 existing records. [2025-10-13T18:49:36.244732] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T18:49:36.306434] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:36.306873] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-13T18:49:36.306930] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-13T18:49:36.307693] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-13T18:49:36.307755] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-13T18:49:36.423093] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-13T18:49:36.720052] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:36.768330] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T18:49:37.217923] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-13T18:49:37.587597] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T18:49:37.910686] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T18:49:38.017931] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-13T18:49:38.817984] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-13T18:49:39.535153] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T18:49:39.617896] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-13T18:49:39.691854] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T18:49:40.020468] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-13T18:49:40.417930] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-13T18:49:41.217903] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-13T18:49:41.627192] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T18:49:42.017946] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-13T18:49:42.292096] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T18:49:42.817915] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-13T18:49:43.617936] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-13T18:49:43.665399] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T18:49:43.989314] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-13T18:49:44.417912] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-13T18:49:44.720049] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T18:49:45.217950] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-13T18:49:45.397390] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T18:49:46.017904] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-13T18:49:46.377797] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T18:49:46.817933] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-13T18:49:47.090143] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T18:49:47.617986] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-13T18:49:47.916504] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T18:49:47.919715] [INFO ] [REMOTE ] ETW: Full fetch complete (36788 records). [2025-10-13T18:49:47.919787] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-13T18:49:48.297587] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-13T18:49:48.297686] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-13T18:49:48.298273] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-13T18:49:48.298332] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-13T18:49:48.299181] [DEBUG] [LOCAL ] ETW: Trimmed 36788 records to 25671 (keeping 200 days of data) [2025-10-13T18:49:48.430984] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-13T18:49:48.450916] [DEBUG] [LOCAL ] ETW: Primary data saved (25671 records). [2025-10-13T18:49:48.451059] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-13T18:49:48.451142] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETW took 30.2s. Estimated remaining: 3h 42m 10s. Rate: 7.1 symbols/min [2025-10-13T18:49:48.618443] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:48.636073] [DEBUG] [LOCAL ] EVC: Loaded 18400 existing records from primary storage. [2025-10-13T18:49:48.636314] [INFO ] [MAIN ] EVC: Loaded 18400 existing records. [2025-10-13T18:49:48.814237] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:48.814477] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-13T18:49:48.814523] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-13T18:49:48.815209] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-13T18:49:48.815266] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-13T18:49:49.170924] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:49.217886] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-13T18:49:49.228252] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T18:49:49.378753] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T18:49:49.384938] [INFO ] [REMOTE ] ETR: Full fetch complete (77084 records). [2025-10-13T18:49:49.385149] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-13T18:49:49.812265] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-13T18:49:49.812366] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-13T18:49:49.813393] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-13T18:49:49.813459] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-13T18:49:49.815179] [DEBUG] [LOCAL ] ETR: Trimmed 77084 records to 53213 (keeping 200 days of data) [2025-10-13T18:49:50.032593] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-13T18:49:50.149192] [DEBUG] [LOCAL ] ETR: Primary data saved (53213 records). [2025-10-13T18:49:50.149336] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-13T18:49:50.149429] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. ETR took 52.6s. Estimated remaining: 3h 41m 48s. Rate: 7.2 symbols/min [2025-10-13T18:49:50.313567] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:50.345502] [DEBUG] [LOCAL ] EVEX: Loaded 32070 existing records from primary storage. [2025-10-13T18:49:50.345815] [INFO ] [MAIN ] EVEX: Loaded 32070 existing records. [2025-10-13T18:49:50.522500] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:50.522767] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-13T18:49:50.522817] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-13T18:49:50.523144] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-13T18:49:50.523202] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-13T18:49:50.746592] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T18:49:50.823302] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-13T18:49:50.868246] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T18:49:50.933267] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:51.505415] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T18:49:51.506516] [INFO ] [REMOTE ] ETX: Full fetch complete (6968 records). [2025-10-13T18:49:51.506584] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-13T18:49:51.623284] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-13T18:49:51.882615] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-13T18:49:51.882721] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-13T18:49:51.882913] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-13T18:49:51.882973] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-13T18:49:51.883349] [DEBUG] [LOCAL ] ETX: Trimmed 6968 records to 5243 (keeping 200 days of data) [2025-10-13T18:49:51.914702] [DEBUG] [LOCAL ] ETX: Primary data saved (5243 records). [2025-10-13T18:49:51.914838] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-13T18:49:51.914964] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. ETX took 26.4s. Estimated remaining: 3h 41m 26s. Rate: 7.2 symbols/min [2025-10-13T18:49:52.081056] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:49:52.091247] [DEBUG] [LOCAL ] EVF: Loaded 10057 existing records from primary storage. [2025-10-13T18:49:52.091436] [INFO ] [MAIN ] EVF: Loaded 10057 existing records. [2025-10-13T18:49:52.264661] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:49:52.264886] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-13T18:49:52.264935] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-13T18:49:52.265136] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-13T18:49:52.265174] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-13T18:49:52.424351] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-13T18:49:52.623296] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:49:53.094850] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T18:49:53.217923] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-13T18:49:53.656519] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T18:49:54.017918] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-13T18:49:54.335297] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:49:54.818022] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-13T18:49:55.055840] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T18:49:55.617953] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-13T18:49:55.727799] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T18:49:56.417987] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-13T18:49:56.728962] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T18:49:57.217937] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-13T18:49:57.649254] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T18:49:57.763807] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T18:49:58.017925] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-13T18:49:58.817947] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-13T18:49:58.983019] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T18:49:59.423083] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T18:49:59.617923] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-13T18:50:00.417992] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-13T18:50:00.680720] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T18:50:01.217919] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-13T18:50:01.737113] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T18:50:02.017896] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-13T18:50:02.267430] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T18:50:02.640497] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T18:50:02.818007] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-13T18:50:03.618023] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-13T18:50:03.745105] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T18:50:04.418046] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-13T18:50:04.822318] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T18:50:05.217940] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-13T18:50:05.394350] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T18:50:06.017881] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-13T18:50:06.332032] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T18:50:06.817916] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-13T18:50:06.953698] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T18:50:06.956485] [INFO ] [REMOTE ] ETY: Full fetch complete (34276 records). [2025-10-13T18:50:06.956557] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-13T18:50:07.362119] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-13T18:50:07.362223] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-13T18:50:07.362874] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-13T18:50:07.362940] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-13T18:50:07.363933] [DEBUG] [LOCAL ] ETY: Trimmed 34276 records to 23106 (keeping 200 days of data) [2025-10-13T18:50:07.464094] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-13T18:50:07.517096] [DEBUG] [LOCAL ] ETY: Primary data saved (23106 records). [2025-10-13T18:50:07.517244] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-13T18:50:07.517327] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. ETY took 31.6s. Estimated remaining: 3h 41m 32s. Rate: 7.2 symbols/min [2025-10-13T18:50:07.621377] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-13T18:50:07.693974] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:07.701830] [DEBUG] [LOCAL ] EVG: Loaded 6047 existing records from primary storage. [2025-10-13T18:50:07.702034] [INFO ] [MAIN ] EVG: Loaded 6047 existing records. [2025-10-13T18:50:07.877162] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:07.877388] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-13T18:50:07.877435] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-13T18:50:07.877635] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-13T18:50:07.877728] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-13T18:50:08.224259] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:08.378877] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T18:50:08.417927] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-13T18:50:09.128866] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-13T18:50:09.217925] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-13T18:50:09.825971] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T18:50:10.017904] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-13T18:50:10.584872] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T18:50:10.817924] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-13T18:50:11.617993] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-13T18:50:11.759049] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T18:50:12.417915] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-13T18:50:12.671755] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T18:50:13.217897] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-13T18:50:13.595843] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T18:50:14.017944] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-13T18:50:14.466301] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-13T18:50:14.644084] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T18:50:14.817942] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-13T18:50:15.302527] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T18:50:15.617927] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-13T18:50:16.332921] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T18:50:16.417909] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-13T18:50:17.187563] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T18:50:17.217887] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-13T18:50:17.963677] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T18:50:18.017887] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-13T18:50:18.794330] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-13T18:50:18.817918] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-13T18:50:19.617949] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-13T18:50:19.905849] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T18:50:20.417906] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-13T18:50:20.659848] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T18:50:20.661877] [INFO ] [REMOTE ] EVF: Full fetch complete (12841 records). [2025-10-13T18:50:20.661944] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-13T18:50:21.010849] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-13T18:50:21.010926] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-13T18:50:21.011204] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-13T18:50:21.011241] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-13T18:50:21.011744] [DEBUG] [LOCAL ] EVF: Trimmed 12841 records to 9881 (keeping 200 days of data) [2025-10-13T18:50:21.066979] [DEBUG] [LOCAL ] EVF: Primary data saved (9881 records). [2025-10-13T18:50:21.067100] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-13T18:50:21.067176] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVF took 29.2s. Estimated remaining: 3h 41m 34s. Rate: 7.1 symbols/min [2025-10-13T18:50:21.218062] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-13T18:50:21.235077] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:21.284365] [DEBUG] [LOCAL ] EVH: Loaded 50292 existing records from primary storage. [2025-10-13T18:50:21.284692] [INFO ] [MAIN ] EVH: Loaded 50292 existing records. [2025-10-13T18:50:21.398985] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T18:50:21.479237] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:21.479441] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-13T18:50:21.479489] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-13T18:50:21.479965] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-13T18:50:21.480044] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-13T18:50:21.827113] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:22.017908] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-13T18:50:22.170927] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T18:50:22.660324] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-13T18:50:22.817913] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-13T18:50:23.340206] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-13T18:50:23.617938] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-13T18:50:24.417904] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-13T18:50:24.754945] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T18:50:25.217904] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-13T18:50:25.258307] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T18:50:25.260822] [INFO ] [REMOTE ] EVC: Full fetch complete (29117 records). [2025-10-13T18:50:25.260915] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-13T18:50:25.642797] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-13T18:50:25.642882] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-13T18:50:25.643459] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-13T18:50:25.643534] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-13T18:50:25.644297] [DEBUG] [LOCAL ] EVC: Trimmed 29117 records to 18112 (keeping 200 days of data) [2025-10-13T18:50:25.749295] [DEBUG] [LOCAL ] EVC: Primary data saved (18112 records). [2025-10-13T18:50:25.749443] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-13T18:50:25.749528] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVC took 37.3s. Estimated remaining: 3h 41m 18s. Rate: 7.1 symbols/min [2025-10-13T18:50:25.915240] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:25.927209] [DEBUG] [LOCAL ] EVN: Loaded 11233 existing records from primary storage. [2025-10-13T18:50:25.927425] [INFO ] [MAIN ] EVN: Loaded 11233 existing records. [2025-10-13T18:50:26.023300] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-13T18:50:26.104165] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:26.104390] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-13T18:50:26.104436] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-13T18:50:26.104667] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-13T18:50:26.104726] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-13T18:50:26.458570] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:26.675917] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T18:50:26.704790] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T18:50:26.817871] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-13T18:50:27.339847] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T18:50:27.618016] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-13T18:50:28.417901] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-13T18:50:29.063475] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T18:50:29.102572] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T18:50:29.217887] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-13T18:50:30.017951] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-13T18:50:30.787274] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T18:50:30.817883] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-13T18:50:31.620952] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-13T18:50:31.623519] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T18:50:32.396494] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:50:32.416335] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T18:50:32.419631] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-13T18:50:33.217928] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-13T18:50:33.999820] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T18:50:34.017884] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-13T18:50:34.369447] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T18:50:34.817928] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-13T18:50:35.608751] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T18:50:35.610156] [INFO ] [REMOTE ] EVG: Full fetch complete (8149 records). [2025-10-13T18:50:35.610422] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-13T18:50:35.623177] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-13T18:50:35.689062] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T18:50:35.744265] [INFO ] [REMOTE ] EVEX: Full fetch complete (43024 records). [2025-10-13T18:50:35.760099] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-13T18:50:36.205114] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-13T18:50:36.238676] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-13T18:50:36.265972] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-13T18:50:36.275475] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-13T18:50:36.307899] [DEBUG] [LOCAL ] EVG: Trimmed 8149 records to 5949 (keeping 200 days of data) [2025-10-13T18:50:36.423685] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-13T18:50:36.463752] [DEBUG] [LOCAL ] EVG: Primary data saved (5949 records). [2025-10-13T18:50:36.466286] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-13T18:50:36.466431] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVG took 28.9s. Estimated remaining: 3h 41m 14s. Rate: 7.1 symbols/min [2025-10-13T18:50:36.466687] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-13T18:50:36.467019] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-13T18:50:36.479853] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-13T18:50:36.511792] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-13T18:50:36.576002] [DEBUG] [LOCAL ] EVEX: Trimmed 43024 records to 31962 (keeping 200 days of data) [2025-10-13T18:50:36.690751] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:36.836676] [DEBUG] [LOCAL ] EVR: Loaded 35113 existing records from primary storage. [2025-10-13T18:50:36.838929] [INFO ] [MAIN ] EVR: Loaded 35113 existing records. [2025-10-13T18:50:36.949133] [DEBUG] [LOCAL ] EVEX: Primary data saved (31962 records). [2025-10-13T18:50:36.955017] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-13T18:50:36.960284] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVEX took 46.8s. Estimated remaining: 3h 40m 50s. Rate: 7.2 symbols/min [2025-10-13T18:50:37.065295] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:37.085800] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-13T18:50:37.085967] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-13T18:50:37.111338] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-13T18:50:37.122360] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-13T18:50:37.305476] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:37.428446] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:50:37.480742] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-13T18:50:37.527063] [DEBUG] [LOCAL ] EVT: Loaded 17083 existing records from primary storage. [2025-10-13T18:50:37.565125] [INFO ] [MAIN ] EVT: Loaded 17083 existing records. [2025-10-13T18:50:37.637618] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T18:50:37.672796] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:37.816981] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:37.817174] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-13T18:50:37.817220] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-13T18:50:37.817521] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-13T18:50:37.817577] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-13T18:50:38.023062] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-13T18:50:38.167509] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:38.419439] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T18:50:38.817978] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-13T18:50:39.498607] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T18:50:39.617937] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-13T18:50:40.242377] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-13T18:50:40.388716] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T18:50:40.417893] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-13T18:50:41.217933] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-13T18:50:41.995472] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T18:50:42.017902] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-13T18:50:42.035874] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T18:50:42.817915] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-13T18:50:43.358670] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T18:50:43.617921] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-13T18:50:43.830443] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T18:50:44.322975] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T18:50:44.417898] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-13T18:50:45.217910] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-13T18:50:45.906910] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T18:50:46.017880] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-13T18:50:46.538884] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T18:50:46.817984] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-13T18:50:47.439248] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T18:50:47.460174] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T18:50:47.617889] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-13T18:50:48.417267] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T18:50:48.418337] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-13T18:50:49.217931] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-13T18:50:50.001361] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T18:50:50.017878] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-13T18:50:50.132877] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T18:50:50.817918] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-13T18:50:51.617905] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-13T18:50:51.731041] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T18:50:51.774936] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T18:50:52.417892] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-13T18:50:53.217906] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-13T18:50:53.270625] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T18:50:53.628322] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-13T18:50:54.011706] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T18:50:54.017876] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-13T18:50:54.817981] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-13T18:50:54.847728] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T18:50:54.849461] [INFO ] [REMOTE ] EVN: Full fetch complete (17496 records). [2025-10-13T18:50:54.849528] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-13T18:50:55.204754] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-13T18:50:55.204846] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-13T18:50:55.205343] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-13T18:50:55.205407] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-13T18:50:55.206101] [DEBUG] [LOCAL ] EVN: Trimmed 17496 records to 10781 (keeping 200 days of data) [2025-10-13T18:50:55.281490] [DEBUG] [LOCAL ] EVN: Primary data saved (10781 records). [2025-10-13T18:50:55.281639] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-13T18:50:55.281763] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVN took 29.5s. Estimated remaining: 3h 41m 2s. Rate: 7.1 symbols/min [2025-10-13T18:50:55.475857] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:50:55.500884] [DEBUG] [LOCAL ] EVTC: Loaded 26811 existing records from primary storage. [2025-10-13T18:50:55.501146] [INFO ] [MAIN ] EVTC: Loaded 26811 existing records. [2025-10-13T18:50:55.623038] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-13T18:50:55.679432] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:50:55.679683] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-13T18:50:55.679741] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-13T18:50:55.680137] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-13T18:50:55.680194] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-13T18:50:56.036414] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:50:56.179588] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T18:50:56.255263] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T18:50:56.417936] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-13T18:50:57.218045] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-13T18:50:57.577971] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T18:50:58.017914] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-13T18:50:58.774589] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T18:50:58.822970] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-13T18:50:58.831965] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T18:50:59.617921] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-13T18:51:00.347760] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T18:51:00.352974] [INFO ] [REMOTE ] EVH: Full fetch complete (71718 records). [2025-10-13T18:51:00.353091] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-13T18:51:00.423175] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-13T18:51:00.777685] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T18:51:00.807474] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-13T18:51:00.808082] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-13T18:51:00.809232] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-13T18:51:00.809319] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-13T18:51:00.810964] [DEBUG] [LOCAL ] EVH: Trimmed 71718 records to 49622 (keeping 200 days of data) [2025-10-13T18:51:01.110819] [DEBUG] [LOCAL ] EVH: Primary data saved (49622 records). [2025-10-13T18:51:01.110975] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-13T18:51:01.111056] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVH took 40.0s. Estimated remaining: 3h 40m 48s. Rate: 7.1 symbols/min [2025-10-13T18:51:01.223165] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-13T18:51:01.298925] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:01.336724] [DEBUG] [LOCAL ] EVTL: Loaded 40001 existing records from primary storage. [2025-10-13T18:51:01.337092] [INFO ] [MAIN ] EVTL: Loaded 40001 existing records. [2025-10-13T18:51:01.527531] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:01.527777] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-13T18:51:01.527826] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-13T18:51:01.528219] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-13T18:51:01.528275] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-13T18:51:01.936746] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:02.017897] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-13T18:51:02.244160] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T18:51:02.616827] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T18:51:02.817942] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-13T18:51:03.281339] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T18:51:03.617933] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-13T18:51:04.234573] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T18:51:04.417970] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-13T18:51:05.222529] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-13T18:51:05.238562] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T18:51:05.240296] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T18:51:06.017933] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-13T18:51:06.597324] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T18:51:06.602556] [INFO ] [REMOTE ] EVR: Full fetch complete (50696 records). [2025-10-13T18:51:06.602727] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-13T18:51:06.824064] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-13T18:51:07.018508] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-13T18:51:07.018746] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-13T18:51:07.019711] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-13T18:51:07.019836] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-13T18:51:07.021054] [DEBUG] [LOCAL ] EVR: Trimmed 50696 records to 34612 (keeping 200 days of data) [2025-10-13T18:51:07.245429] [DEBUG] [LOCAL ] EVR: Primary data saved (34612 records). [2025-10-13T18:51:07.245605] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-13T18:51:07.245800] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVR took 30.8s. Estimated remaining: 3h 40m 35s. Rate: 7.1 symbols/min [2025-10-13T18:51:07.381918] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T18:51:07.459809] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:07.485744] [DEBUG] [LOCAL ] EVTR: Loaded 24696 existing records from primary storage. [2025-10-13T18:51:07.486055] [INFO ] [MAIN ] EVTR: Loaded 24696 existing records. [2025-10-13T18:51:07.625624] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-13T18:51:07.668054] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:07.668360] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-13T18:51:07.668429] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-13T18:51:07.668792] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-13T18:51:07.668860] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-13T18:51:07.806425] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T18:51:08.045523] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:08.417937] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-13T18:51:08.728104] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T18:51:09.217920] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-13T18:51:09.319068] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T18:51:10.017890] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-13T18:51:10.160172] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T18:51:10.817900] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-13T18:51:10.879743] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T18:51:11.617991] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-13T18:51:11.837000] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T18:51:12.418155] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-13T18:51:12.889327] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T18:51:13.217926] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-13T18:51:13.530241] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T18:51:14.017931] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-13T18:51:14.328332] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T18:51:14.817933] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-13T18:51:15.019423] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:51:15.617993] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-13T18:51:15.804807] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T18:51:16.417935] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-13T18:51:16.833808] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T18:51:17.217902] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-13T18:51:17.348950] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T18:51:18.017915] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-13T18:51:18.091119] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-13T18:51:18.817986] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-13T18:51:19.617893] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-13T18:51:19.717749] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T18:51:19.784070] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T18:51:20.238541] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T18:51:20.242401] [INFO ] [REMOTE ] EVT: Full fetch complete (25189 records). [2025-10-13T18:51:20.242718] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-13T18:51:20.424697] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-13T18:51:20.624590] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-13T18:51:20.624834] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-13T18:51:20.625382] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-13T18:51:20.625422] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-13T18:51:20.626164] [DEBUG] [LOCAL ] EVT: Trimmed 25189 records to 16812 (keeping 200 days of data) [2025-10-13T18:51:20.728629] [DEBUG] [LOCAL ] EVT: Primary data saved (16812 records). [2025-10-13T18:51:20.728811] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-13T18:51:20.728950] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVT took 43.8s. Estimated remaining: 3h 40m 37s. Rate: 7.1 symbols/min [2025-10-13T18:51:20.896253] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:20.949685] [DEBUG] [LOCAL ] EW: Loaded 54178 existing records from primary storage. [2025-10-13T18:51:20.949996] [INFO ] [MAIN ] EW: Loaded 54178 existing records. [2025-10-13T18:51:21.130059] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:21.130325] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-13T18:51:21.130413] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-13T18:51:21.131078] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-13T18:51:21.131135] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-13T18:51:21.226377] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-13T18:51:21.482686] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:21.960964] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T18:51:22.017880] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-13T18:51:22.817923] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-13T18:51:23.211898] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T18:51:23.390925] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-13T18:51:23.617905] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-13T18:51:23.870360] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T18:51:24.417975] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-13T18:51:25.217900] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-13T18:51:25.282316] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T18:51:26.017915] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-13T18:51:26.188016] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T18:51:26.249828] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T18:51:26.817906] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-13T18:51:26.844822] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T18:51:27.617936] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-13T18:51:27.850507] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T18:51:28.418010] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-13T18:51:29.217922] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-13T18:51:29.365687] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T18:51:29.389498] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T18:51:30.017912] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-13T18:51:30.450121] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T18:51:30.453595] [INFO ] [REMOTE ] EVTC: Full fetch complete (38148 records). [2025-10-13T18:51:30.453698] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-13T18:51:30.823269] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-13T18:51:30.838509] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-13T18:51:30.838591] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-13T18:51:30.839376] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-13T18:51:30.839440] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-13T18:51:30.840368] [DEBUG] [LOCAL ] EVTC: Trimmed 38148 records to 26524 (keeping 200 days of data) [2025-10-13T18:51:31.015197] [DEBUG] [LOCAL ] EVTC: Primary data saved (26524 records). [2025-10-13T18:51:31.015388] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-13T18:51:31.015555] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTC took 35.7s. Estimated remaining: 3h 40m 32s. Rate: 7.1 symbols/min [2025-10-13T18:51:31.155710] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T18:51:31.218514] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:31.254190] [DEBUG] [LOCAL ] EXG: Loaded 34701 existing records from primary storage. [2025-10-13T18:51:31.254472] [INFO ] [MAIN ] EXG: Loaded 34701 existing records. [2025-10-13T18:51:31.425948] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:31.426186] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-13T18:51:31.426233] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-13T18:51:31.426615] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-13T18:51:31.426709] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-13T18:51:31.623220] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-13T18:51:31.777249] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:32.418009] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-13T18:51:32.676169] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T18:51:32.681708] [INFO ] [REMOTE ] EVTL: Full fetch complete (54041 records). [2025-10-13T18:51:32.681842] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-13T18:51:33.058432] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-13T18:51:33.058537] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-13T18:51:33.059491] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-13T18:51:33.059557] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-13T18:51:33.060872] [DEBUG] [LOCAL ] EVTL: Trimmed 54041 records to 39852 (keeping 200 days of data) [2025-10-13T18:51:33.218453] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-13T18:51:33.291156] [DEBUG] [LOCAL ] EVTL: Primary data saved (39852 records). [2025-10-13T18:51:33.291335] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-13T18:51:33.291510] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EVTL took 32.2s. Estimated remaining: 3h 40m 12s. Rate: 7.1 symbols/min [2025-10-13T18:51:33.323505] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T18:51:33.499384] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T18:51:34.017919] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-13T18:51:34.520492] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T18:51:34.818017] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-13T18:51:35.631919] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-13T18:51:35.658687] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:51:36.159098] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T18:51:36.418005] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-13T18:51:36.670943] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T18:51:37.217935] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-13T18:51:37.753935] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T18:51:37.757421] [INFO ] [REMOTE ] EVTR: Full fetch complete (33059 records). [2025-10-13T18:51:37.757496] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-13T18:51:38.026828] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-13T18:51:38.122960] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-13T18:51:38.123044] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-13T18:51:38.123713] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-13T18:51:38.123778] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-13T18:51:38.124539] [DEBUG] [LOCAL ] EVTR: Trimmed 33059 records to 24474 (keeping 200 days of data) [2025-10-13T18:51:38.270723] [DEBUG] [LOCAL ] EVTR: Primary data saved (24474 records). [2025-10-13T18:51:38.270856] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-13T18:51:38.270933] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EVTR took 31.0s. Estimated remaining: 3h 39m 57s. Rate: 7.2 symbols/min [2025-10-13T18:51:38.732088] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:51:38.817912] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-13T18:51:39.381695] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T18:51:39.617974] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-13T18:51:40.258071] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T18:51:40.417895] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-13T18:51:40.729681] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T18:51:41.217914] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-13T18:51:41.978316] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T18:51:42.017881] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-13T18:51:42.313990] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T18:51:42.818035] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-13T18:51:43.803826] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T18:51:43.814960] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-13T18:51:43.872278] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T18:51:44.418008] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-13T18:51:45.586981] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T18:51:45.599219] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-13T18:51:45.926122] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T18:51:46.017900] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-13T18:51:47.158853] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T18:51:47.170238] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-13T18:51:47.220350] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T18:51:47.618004] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-13T18:51:48.590010] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T18:51:48.596884] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-13T18:51:48.907897] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T18:51:49.221707] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-13T18:51:49.520242] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T18:51:49.946050] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T18:51:49.951817] [INFO ] [REMOTE ] EW: Full fetch complete (77349 records). [2025-10-13T18:51:49.951964] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-13T18:51:50.027302] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-13T18:51:50.341219] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-13T18:51:50.341300] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-13T18:51:50.342309] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-13T18:51:50.342372] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-13T18:51:50.343856] [DEBUG] [LOCAL ] EW: Trimmed 77349 records to 53401 (keeping 200 days of data) [2025-10-13T18:51:50.657457] [DEBUG] [LOCAL ] EW: Primary data saved (53401 records). [2025-10-13T18:51:50.657599] [INFO ] [MAIN ] EW: Full history saved. [2025-10-13T18:51:50.657700] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EW took 29.9s. Estimated remaining: 3h 39m 56s. Rate: 7.1 symbols/min [2025-10-13T18:51:51.181030] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T18:51:51.184961] [INFO ] [REMOTE ] EXG: Full fetch complete (49783 records). [2025-10-13T18:51:51.185058] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-13T18:51:51.584230] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-13T18:51:51.584314] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-13T18:51:51.585186] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-13T18:51:51.585249] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-13T18:51:51.586491] [DEBUG] [LOCAL ] EXG: Trimmed 49783 records to 34103 (keeping 200 days of data) [2025-10-13T18:51:51.804881] [DEBUG] [LOCAL ] EXG: Primary data saved (34103 records). [2025-10-13T18:51:51.805033] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-13T18:51:51.805116] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXG took 20.8s. Estimated remaining: 3h 39m 33s. Rate: 7.2 symbols/min [2025-10-13T18:51:52.461958] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:52.519490] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:52.562395] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:52.580925] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:51:52.640744] [DEBUG] [LOCAL ] EXP: Loaded 30076 existing records from primary storage. [2025-10-13T18:51:52.641627] [INFO ] [MAIN ] EXP: Loaded 30076 existing records. [2025-10-13T18:51:52.770624] [DEBUG] [LOCAL ] EXR: Loaded 45888 existing records from primary storage. [2025-10-13T18:51:52.785772] [INFO ] [MAIN ] EXR: Loaded 45888 existing records. [2025-10-13T18:51:52.804787] [DEBUG] [LOCAL ] EXK: Loaded 53922 existing records from primary storage. [2025-10-13T18:51:52.882757] [INFO ] [MAIN ] EXK: Loaded 53922 existing records. [2025-10-13T18:51:52.985458] [DEBUG] [LOCAL ] EXPD: Loaded 48593 existing records from primary storage. [2025-10-13T18:51:53.023048] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:53.034144] [INFO ] [MAIN ] EXPD: Loaded 48593 existing records. [2025-10-13T18:51:53.034364] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-13T18:51:53.045318] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-13T18:51:53.106289] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-13T18:51:53.229710] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-13T18:51:53.266476] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:53.326458] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-13T18:51:53.346832] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-13T18:51:53.501422] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:53.480013] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-13T18:51:53.550257] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-13T18:51:53.550147] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-13T18:51:53.600078] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-13T18:51:53.619772] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:51:53.640866] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-13T18:51:53.634499] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-13T18:51:53.662142] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-13T18:51:53.667436] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-13T18:51:53.817668] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-13T18:51:53.914554] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-13T18:51:54.531211] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:54.578358] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-13T18:51:54.939025] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:54.966974] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-13T18:51:55.089088] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:55.094617] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-13T18:51:55.160908] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:51:55.161220] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-13T18:51:56.119761] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T18:51:56.125754] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-13T18:51:56.581721] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T18:51:56.590859] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-13T18:51:56.785772] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T18:51:56.794799] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-13T18:51:56.833099] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T18:51:56.843633] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-13T18:51:57.502701] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T18:51:57.508829] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-13T18:51:57.887270] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T18:51:58.017896] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-13T18:51:58.124110] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T18:51:58.193068] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T18:51:58.793473] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:51:58.817895] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-13T18:51:59.299540] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T18:51:59.617928] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-13T18:52:00.006752] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-13T18:52:00.418043] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-13T18:52:01.217984] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-13T18:52:01.336599] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T18:52:01.894014] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T18:52:02.017920] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-13T18:52:02.822474] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-13T18:52:02.828458] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T18:52:03.617898] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-13T18:52:03.876803] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-13T18:52:04.164292] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T18:52:04.418010] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-13T18:52:05.031965] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T18:52:05.217939] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-13T18:52:06.017927] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-13T18:52:06.320833] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T18:52:06.614800] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T18:52:06.817978] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-13T18:52:07.314317] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T18:52:07.617940] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-13T18:52:08.313458] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:52:08.417910] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-13T18:52:08.745462] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T18:52:09.217928] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-13T18:52:09.919825] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:52:10.017915] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-13T18:52:10.406537] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-13T18:52:10.817974] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-13T18:52:11.496598] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T18:52:11.617922] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-13T18:52:12.379175] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-13T18:52:12.418000] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-13T18:52:13.219417] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-13T18:52:13.225114] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T18:52:14.017968] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-13T18:52:14.149020] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T18:52:14.240210] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T18:52:14.818014] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-13T18:52:15.617896] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-13T18:52:15.714257] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T18:52:16.418000] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-13T18:52:16.553764] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T18:52:17.217983] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-13T18:52:17.535216] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T18:52:17.554153] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T18:52:17.557152] [INFO ] [REMOTE ] EXP: Full fetch complete (42790 records). [2025-10-13T18:52:17.557227] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-13T18:52:17.925630] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-13T18:52:17.925738] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-13T18:52:17.926376] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-13T18:52:17.926435] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-13T18:52:17.927304] [DEBUG] [LOCAL ] EXP: Trimmed 42790 records to 29534 (keeping 200 days of data) [2025-10-13T18:52:18.021162] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-13T18:52:18.115670] [DEBUG] [LOCAL ] EXP: Primary data saved (29534 records). [2025-10-13T18:52:18.115816] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-13T18:52:18.116625] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. EXP took 26.3s. Estimated remaining: 3h 40m 0s. Rate: 7.1 symbols/min [2025-10-13T18:52:18.283586] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:52:18.337763] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-10-13T18:52:18.338106] [INFO ] [MAIN ] F: Loaded 54600 existing records. [2025-10-13T18:52:18.522959] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:52:18.523254] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-13T18:52:18.523329] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-13T18:52:18.523962] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-13T18:52:18.524024] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-13T18:52:18.819174] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-13T18:52:18.888070] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:52:18.916267] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T18:52:19.567918] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:52:19.617884] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-13T18:52:20.417956] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-13T18:52:20.665119] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T18:52:21.217919] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-13T18:52:21.689923] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T18:52:22.017925] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-13T18:52:22.253915] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-13T18:52:22.817891] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-13T18:52:22.954032] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T18:52:23.325058] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T18:52:23.330480] [INFO ] [REMOTE ] EXR: Full fetch complete (65876 records). [2025-10-13T18:52:23.330602] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-13T18:52:23.623125] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-13T18:52:23.771810] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-13T18:52:23.771934] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-13T18:52:23.773349] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-13T18:52:23.773418] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-13T18:52:23.774999] [DEBUG] [LOCAL ] EXR: Trimmed 65876 records to 45363 (keeping 200 days of data) [2025-10-13T18:52:24.061797] [DEBUG] [LOCAL ] EXR: Primary data saved (45363 records). [2025-10-13T18:52:24.061933] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-13T18:52:24.062015] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXR took 32.2s. Estimated remaining: 3h 39m 47s. Rate: 7.1 symbols/min [2025-10-13T18:52:24.230559] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:52:24.268887] [DEBUG] [LOCAL ] FAF: Loaded 42098 existing records from primary storage. [2025-10-13T18:52:24.269175] [INFO ] [MAIN ] FAF: Loaded 42098 existing records. [2025-10-13T18:52:24.420867] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-13T18:52:24.444424] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:52:24.444788] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-13T18:52:24.444839] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-13T18:52:24.445303] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-13T18:52:24.445359] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-13T18:52:24.801601] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:52:24.971531] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-13T18:52:25.217932] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-13T18:52:25.708929] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-13T18:52:25.714868] [INFO ] [REMOTE ] EXK: Full fetch complete (76608 records). [2025-10-13T18:52:25.715056] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-13T18:52:26.027964] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-13T18:52:26.135623] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-13T18:52:26.135732] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-13T18:52:26.136804] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-13T18:52:26.136868] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-13T18:52:26.138399] [DEBUG] [LOCAL ] EXK: Trimmed 76608 records to 53166 (keeping 200 days of data) [2025-10-13T18:52:26.281298] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T18:52:26.488207] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T18:52:26.512422] [DEBUG] [LOCAL ] EXK: Primary data saved (53166 records). [2025-10-13T18:52:26.512521] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-13T18:52:26.512592] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXK took 34.7s. Estimated remaining: 3h 39m 27s. Rate: 7.1 symbols/min [2025-10-13T18:52:26.678602] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:52:26.725811] [DEBUG] [LOCAL ] FBIN: Loaded 51053 existing records from primary storage. [2025-10-13T18:52:26.726123] [INFO ] [MAIN ] FBIN: Loaded 51053 existing records. [2025-10-13T18:52:26.825443] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-13T18:52:26.914141] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:52:26.914400] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-13T18:52:26.914467] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-13T18:52:26.915046] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-13T18:52:26.915111] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-13T18:52:27.275821] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:52:27.617960] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-13T18:52:28.364788] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-13T18:52:28.417895] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-13T18:52:28.460793] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T18:52:28.736561] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:52:29.217920] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-13T18:52:30.017928] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-13T18:52:30.808519] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T18:52:30.819711] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-13T18:52:30.912231] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-13T18:52:31.619697] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-13T18:52:31.621902] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T18:52:32.188838] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T18:52:32.417926] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-13T18:52:33.217923] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-13T18:52:34.017897] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-13T18:52:34.191304] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T18:52:34.193107] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-13T18:52:34.556547] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T18:52:34.738787] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T18:52:34.743785] [INFO ] [REMOTE ] EXPD: Full fetch complete (69339 records). [2025-10-13T18:52:34.743896] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-13T18:52:34.823182] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-13T18:52:35.157996] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-13T18:52:35.158087] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-13T18:52:35.159144] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-13T18:52:35.159209] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-13T18:52:35.160582] [DEBUG] [LOCAL ] EXPD: Trimmed 69339 records to 47915 (keeping 200 days of data) [2025-10-13T18:52:35.451873] [DEBUG] [LOCAL ] EXPD: Primary data saved (47915 records). [2025-10-13T18:52:35.452014] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-13T18:52:35.452099] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. EXPD took 43.6s. Estimated remaining: 3h 39m 20s. Rate: 7.1 symbols/min [2025-10-13T18:52:35.629867] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-13T18:52:35.634893] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:52:35.666001] [DEBUG] [LOCAL ] FBK: Loaded 27187 existing records from primary storage. [2025-10-13T18:52:35.666348] [INFO ] [MAIN ] FBK: Loaded 27187 existing records. [2025-10-13T18:52:35.849732] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:52:35.850051] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-13T18:52:35.850100] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-13T18:52:35.850438] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-13T18:52:35.850495] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-13T18:52:36.224050] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:52:36.417898] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-13T18:52:36.482487] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T18:52:37.217910] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-13T18:52:37.350366] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T18:52:37.911961] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-13T18:52:38.017896] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-13T18:52:38.762415] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T18:52:38.817974] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-13T18:52:39.534026] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T18:52:39.617967] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-13T18:52:40.411062] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-13T18:52:40.421683] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-13T18:52:41.218023] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-13T18:52:41.261895] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T18:52:41.733877] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T18:52:42.017935] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-13T18:52:42.818008] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-13T18:52:43.623085] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-13T18:52:43.649615] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T18:52:43.773502] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-13T18:52:43.819744] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T18:52:44.418015] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-13T18:52:45.202728] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T18:52:45.217974] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-13T18:52:46.018012] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-13T18:52:46.809191] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T18:52:46.818135] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-13T18:52:46.835457] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T18:52:46.941998] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-13T18:52:47.617969] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-13T18:52:48.423039] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-13T18:52:48.441168] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T18:52:49.217985] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-13T18:52:49.838741] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T18:52:49.947137] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-13T18:52:50.017914] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-13T18:52:50.728097] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T18:52:50.733980] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-13T18:52:50.734125] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-13T18:52:50.822136] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-13T18:52:51.169908] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-13T18:52:51.170074] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-13T18:52:51.171277] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-13T18:52:51.171367] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-13T18:52:51.209418] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-13T18:52:51.220303] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-13T18:52:51.578538] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-13T18:52:51.578772] [INFO ] [MAIN ] F: Full history saved. [2025-10-13T18:52:51.580112] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. F took 33.5s. Estimated remaining: 3h 39m 26s. Rate: 7.1 symbols/min [2025-10-13T18:52:51.623795] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-13T18:52:51.758252] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:52:51.813835] [DEBUG] [LOCAL ] FBP: Loaded 46453 existing records from primary storage. [2025-10-13T18:52:51.814220] [INFO ] [MAIN ] FBP: Loaded 46453 existing records. [2025-10-13T18:52:52.015049] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:52:52.015301] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-13T18:52:52.015349] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-13T18:52:52.015727] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-13T18:52:52.015784] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-13T18:52:52.372809] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:52:52.417884] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-13T18:52:52.491299] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T18:52:52.577438] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T18:52:53.217926] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-13T18:52:53.737136] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T18:52:54.017982] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-13T18:52:54.761479] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T18:52:54.817983] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-13T18:52:55.050321] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-13T18:52:55.617984] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-13T18:52:56.302309] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T18:52:56.417896] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-13T18:52:57.052573] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T18:52:57.217997] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-13T18:52:57.860684] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T18:52:58.018025] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-13T18:52:58.580895] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:52:58.817984] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-13T18:52:59.103365] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T18:52:59.617972] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-13T18:53:00.417979] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-13T18:53:00.463831] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T18:53:01.217986] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-13T18:53:01.343112] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T18:53:02.017916] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-13T18:53:02.216781] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T18:53:02.671136] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T18:53:02.817932] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-13T18:53:03.436452] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T18:53:03.440668] [INFO ] [REMOTE ] FAF: Full fetch complete (57708 records). [2025-10-13T18:53:03.440794] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-13T18:53:03.623234] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-13T18:53:03.891029] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-13T18:53:03.891134] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-13T18:53:03.892322] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-13T18:53:03.892591] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-13T18:53:03.894318] [DEBUG] [LOCAL ] FAF: Trimmed 57708 records to 41545 (keeping 200 days of data) [2025-10-13T18:53:04.165903] [DEBUG] [LOCAL ] FAF: Primary data saved (41545 records). [2025-10-13T18:53:04.166070] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-13T18:53:04.166169] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FAF took 40.1s. Estimated remaining: 3h 39m 26s. Rate: 7.1 symbols/min [2025-10-13T18:53:04.352127] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:04.381325] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T18:53:04.423887] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-13T18:53:04.426960] [DEBUG] [LOCAL ] FBRT: Loaded 35702 existing records from primary storage. [2025-10-13T18:53:04.427240] [INFO ] [MAIN ] FBRT: Loaded 35702 existing records. [2025-10-13T18:53:04.611154] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:04.611442] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-13T18:53:04.611494] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-13T18:53:04.611982] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-13T18:53:04.612071] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-13T18:53:04.984593] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:05.198134] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T18:53:05.204000] [INFO ] [REMOTE ] FBIN: Full fetch complete (72742 records). [2025-10-13T18:53:05.204213] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-13T18:53:05.226886] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-13T18:53:05.635536] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-13T18:53:05.635801] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-13T18:53:05.637176] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-13T18:53:05.637254] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-13T18:53:05.639482] [DEBUG] [LOCAL ] FBIN: Trimmed 72742 records to 50364 (keeping 200 days of data) [2025-10-13T18:53:05.985364] [DEBUG] [LOCAL ] FBIN: Primary data saved (50364 records). [2025-10-13T18:53:05.985582] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-13T18:53:05.985717] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBIN took 39.5s. Estimated remaining: 3h 39m 5s. Rate: 7.1 symbols/min [2025-10-13T18:53:06.021143] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-13T18:53:06.140377] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:53:06.212985] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:06.230772] [DEBUG] [LOCAL ] FC: Loaded 15309 existing records from primary storage. [2025-10-13T18:53:06.231093] [INFO ] [MAIN ] FC: Loaded 15309 existing records. [2025-10-13T18:53:06.411239] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:06.411514] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-13T18:53:06.411588] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-13T18:53:06.412056] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-13T18:53:06.412117] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-13T18:53:06.539366] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:53:06.797067] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:06.817915] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-13T18:53:07.142308] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T18:53:07.428378] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T18:53:07.617986] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-13T18:53:08.417910] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-13T18:53:08.974325] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T18:53:09.217989] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-13T18:53:09.413804] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:53:10.017982] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-13T18:53:10.245492] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T18:53:10.249448] [INFO ] [REMOTE ] FBK: Full fetch complete (34440 records). [2025-10-13T18:53:10.249559] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-13T18:53:10.642102] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-13T18:53:10.642293] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-13T18:53:10.643172] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-13T18:53:10.643241] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-13T18:53:10.646268] [DEBUG] [LOCAL ] FBK: Trimmed 34440 records to 27039 (keeping 200 days of data) [2025-10-13T18:53:10.818362] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-13T18:53:10.831957] [DEBUG] [LOCAL ] FBK: Primary data saved (27039 records). [2025-10-13T18:53:10.832155] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-13T18:53:10.832378] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBK took 35.4s. Estimated remaining: 3h 38m 49s. Rate: 7.1 symbols/min [2025-10-13T18:53:11.009053] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T18:53:11.027433] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:11.081785] [DEBUG] [LOCAL ] FCF: Loaded 39746 existing records from primary storage. [2025-10-13T18:53:11.082208] [INFO ] [MAIN ] FCF: Loaded 39746 existing records. [2025-10-13T18:53:11.263960] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:11.264334] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-13T18:53:11.264409] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-13T18:53:11.265034] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-13T18:53:11.265109] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-13T18:53:11.623082] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-13T18:53:11.688175] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:12.177034] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T18:53:12.418034] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-13T18:53:12.553002] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T18:53:13.218034] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-13T18:53:13.877986] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:53:14.018017] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-13T18:53:14.236290] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T18:53:14.817928] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-13T18:53:15.599501] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-13T18:53:15.617881] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-13T18:53:15.641412] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T18:53:16.417959] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-13T18:53:17.127367] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T18:53:17.217886] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-13T18:53:17.556422] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T18:53:18.017930] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-13T18:53:18.765960] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T18:53:18.817962] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-13T18:53:19.494227] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T18:53:19.617929] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-13T18:53:20.029789] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T18:53:20.034422] [INFO ] [REMOTE ] FBP: Full fetch complete (66388 records). [2025-10-13T18:53:20.034518] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-13T18:53:20.422101] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-13T18:53:20.421933] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-13T18:53:20.423350] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-13T18:53:20.424348] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-13T18:53:20.424437] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-13T18:53:20.428119] [DEBUG] [LOCAL ] FBP: Trimmed 66388 records to 45728 (keeping 200 days of data) [2025-10-13T18:53:20.698516] [DEBUG] [LOCAL ] FBP: Primary data saved (45728 records). [2025-10-13T18:53:20.698677] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-13T18:53:20.699475] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FBP took 29.1s. Estimated remaining: 3h 38m 44s. Rate: 7.1 symbols/min [2025-10-13T18:53:20.867175] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:20.898053] [DEBUG] [LOCAL ] FCN: Loaded 26406 existing records from primary storage. [2025-10-13T18:53:20.898342] [INFO ] [MAIN ] FCN: Loaded 26406 existing records. [2025-10-13T18:53:21.081871] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:21.082177] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-13T18:53:21.082277] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-13T18:53:21.082956] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-13T18:53:21.083022] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-13T18:53:21.224514] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-13T18:53:21.213816] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T18:53:21.479900] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:21.718276] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T18:53:22.017902] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-13T18:53:22.074173] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T18:53:22.817982] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-13T18:53:23.070747] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T18:53:23.617962] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-13T18:53:23.865280] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T18:53:24.417953] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-13T18:53:25.163703] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T18:53:25.217885] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-13T18:53:25.700197] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T18:53:26.017910] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-13T18:53:26.813119] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T18:53:26.822549] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-13T18:53:27.243325] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T18:53:27.617922] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-13T18:53:27.882826] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T18:53:28.301613] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T18:53:28.417968] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-13T18:53:29.218024] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-13T18:53:29.950765] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T18:53:30.017917] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-13T18:53:30.284893] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T18:53:30.628927] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T18:53:30.818008] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-13T18:53:31.617897] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-13T18:53:31.663091] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T18:53:31.664989] [INFO ] [REMOTE ] FC: Full fetch complete (21737 records). [2025-10-13T18:53:31.665057] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-13T18:53:32.028467] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-13T18:53:32.028543] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-13T18:53:32.029102] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-13T18:53:32.029164] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-13T18:53:32.029751] [DEBUG] [LOCAL ] FC: Trimmed 21737 records to 14956 (keeping 200 days of data) [2025-10-13T18:53:32.115326] [DEBUG] [LOCAL ] FC: Primary data saved (14956 records). [2025-10-13T18:53:32.115463] [INFO ] [MAIN ] FC: Full history saved. [2025-10-13T18:53:32.115554] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FC took 26.1s. Estimated remaining: 3h 38m 41s. Rate: 7.1 symbols/min [2025-10-13T18:53:32.281355] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:32.321193] [DEBUG] [LOCAL ] FCPT: Loaded 37878 existing records from primary storage. [2025-10-13T18:53:32.321495] [INFO ] [MAIN ] FCPT: Loaded 37878 existing records. [2025-10-13T18:53:32.420927] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-13T18:53:32.501012] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:32.501240] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-13T18:53:32.501294] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-13T18:53:32.501771] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-13T18:53:32.501828] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-13T18:53:32.859591] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:32.919618] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T18:53:33.218022] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-13T18:53:33.574129] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T18:53:34.017988] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-13T18:53:34.627106] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T18:53:34.817911] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-13T18:53:35.113167] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T18:53:35.617967] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-13T18:53:36.252797] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:53:36.417996] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-13T18:53:36.818496] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T18:53:36.823215] [INFO ] [REMOTE ] FBRT: Full fetch complete (49286 records). [2025-10-13T18:53:36.823340] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-13T18:53:37.215234] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-13T18:53:37.215338] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-13T18:53:37.216242] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-13T18:53:37.216309] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-13T18:53:37.217722] [DEBUG] [LOCAL ] FBRT: Trimmed 49286 records to 35334 (keeping 200 days of data) [2025-10-13T18:53:37.222103] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-13T18:53:37.455265] [DEBUG] [LOCAL ] FBRT: Primary data saved (35334 records). [2025-10-13T18:53:37.455471] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-13T18:53:37.455607] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FBRT took 33.3s. Estimated remaining: 3h 38m 27s. Rate: 7.1 symbols/min [2025-10-13T18:53:37.629301] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:37.629559] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-13T18:53:37.629624] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-13T18:53:37.629774] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-13T18:53:37.629815] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-13T18:53:37.629855] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-13T18:53:37.629888] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-13T18:53:38.010551] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T18:53:38.033945] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:38.029704] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-13T18:53:38.588973] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T18:53:38.818007] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-13T18:53:39.371218] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T18:53:39.617974] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-13T18:53:40.076844] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T18:53:40.418000] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-13T18:53:40.946776] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T18:53:41.217900] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-13T18:53:41.567248] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T18:53:42.017945] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-13T18:53:42.497512] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T18:53:42.818017] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-13T18:53:43.099725] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-13T18:53:43.617921] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-13T18:53:43.958931] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-13T18:53:44.302881] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T18:53:44.417923] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-13T18:53:44.836867] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-13T18:53:45.217959] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-13T18:53:46.017954] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-13T18:53:46.550018] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T18:53:46.817894] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-13T18:53:47.239026] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T18:53:47.274500] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T18:53:47.617962] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-13T18:53:48.417918] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-13T18:53:49.085805] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:53:49.090345] [INFO ] [REMOTE ] FCF: Full fetch complete (58001 records). [2025-10-13T18:53:49.090464] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-13T18:53:49.223098] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-13T18:53:49.481049] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-13T18:53:49.481131] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-13T18:53:49.481957] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-13T18:53:49.482019] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-13T18:53:49.483167] [DEBUG] [LOCAL ] FCF: Trimmed 58001 records to 39256 (keeping 200 days of data) [2025-10-13T18:53:49.723185] [DEBUG] [LOCAL ] FCF: Primary data saved (39256 records). [2025-10-13T18:53:49.723372] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-13T18:53:49.723482] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCF took 38.9s. Estimated remaining: 3h 38m 26s. Rate: 7.1 symbols/min [2025-10-13T18:53:49.893745] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:49.908079] [DEBUG] [LOCAL ] FCT: Loaded 14947 existing records from primary storage. [2025-10-13T18:53:49.908295] [INFO ] [MAIN ] FCT: Loaded 14947 existing records. [2025-10-13T18:53:50.018820] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-13T18:53:50.167263] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:50.168531] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-13T18:53:50.172141] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T18:53:50.169153] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-13T18:53:50.182104] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-13T18:53:50.182471] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-13T18:53:50.320844] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T18:53:50.512765] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-13T18:53:50.596718] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:50.817979] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-13T18:53:51.617953] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-13T18:53:52.261032] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:53:52.417912] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-13T18:53:52.726775] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T18:53:52.988311] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T18:53:53.218002] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-13T18:53:54.017991] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-13T18:53:54.216862] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T18:53:54.817959] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-13T18:53:55.242612] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-13T18:53:55.294618] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T18:53:55.617993] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-13T18:53:56.417946] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-13T18:53:56.447528] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-13T18:53:57.217985] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-13T18:53:57.479499] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-13T18:53:57.509160] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T18:53:57.512144] [INFO ] [REMOTE ] FCN: Full fetch complete (35742 records). [2025-10-13T18:53:57.512226] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-13T18:53:57.880714] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-13T18:53:57.880846] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-13T18:53:57.881460] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-13T18:53:57.881508] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-13T18:53:57.882317] [DEBUG] [LOCAL ] FCN: Trimmed 35742 records to 26021 (keeping 200 days of data) [2025-10-13T18:53:58.024763] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-13T18:53:58.048970] [DEBUG] [LOCAL ] FCN: Primary data saved (26021 records). [2025-10-13T18:53:58.049307] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-13T18:53:58.049535] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCN took 37.3s. Estimated remaining: 3h 38m 17s. Rate: 7.1 symbols/min [2025-10-13T18:53:58.218553] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:53:58.270930] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-10-13T18:53:58.271267] [INFO ] [MAIN ] FCX: Loaded 54480 existing records. [2025-10-13T18:53:58.464274] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:53:58.464487] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-13T18:53:58.464533] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-13T18:53:58.465075] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-13T18:53:58.465132] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-13T18:53:58.546597] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-13T18:53:58.823166] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-13T18:53:58.828813] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:53:59.617951] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-13T18:54:00.304304] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T18:54:00.417983] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-13T18:54:00.576299] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T18:54:00.778202] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-13T18:54:01.217989] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-13T18:54:01.611668] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-13T18:54:02.018036] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-13T18:54:02.817953] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-13T18:54:03.162437] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T18:54:03.617977] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-13T18:54:04.417998] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-13T18:54:04.753326] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-13T18:54:04.855030] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T18:54:04.881109] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T18:54:05.217970] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-13T18:54:06.017995] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-13T18:54:06.365495] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-13T18:54:06.366859] [INFO ] [REMOTE ] FCRX: Full fetch complete (1672 records). [2025-10-13T18:54:06.366952] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-13T18:54:06.639733] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-13T18:54:06.640116] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:54:06.640208] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:54:06.640301] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-13T18:54:06.640421] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-13T18:54:06.640496] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-13T18:54:06.640577] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-13T18:54:06.640694] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCRX took 29.2s. Estimated remaining: 3h 38m 9s. Rate: 7.1 symbols/min [2025-10-13T18:54:06.818972] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-13T18:54:06.933435] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:06.991639] [DEBUG] [LOCAL ] FDP: Loaded 30435 existing records from primary storage. [2025-10-13T18:54:06.992194] [INFO ] [MAIN ] FDP: Loaded 30435 existing records. [2025-10-13T18:54:07.246441] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:07.247111] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-13T18:54:07.247240] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-13T18:54:07.247891] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-13T18:54:07.248189] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-13T18:54:07.502535] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-13T18:54:07.623276] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-13T18:54:07.791417] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:08.387744] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T18:54:08.392135] [INFO ] [REMOTE ] FCPT: Full fetch complete (53715 records). [2025-10-13T18:54:08.392247] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-13T18:54:08.423383] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-13T18:54:08.779137] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-13T18:54:08.779222] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-13T18:54:08.780065] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-13T18:54:08.780130] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-13T18:54:08.781269] [DEBUG] [LOCAL ] FCPT: Trimmed 53715 records to 37317 (keeping 200 days of data) [2025-10-13T18:54:09.012914] [DEBUG] [LOCAL ] FCPT: Primary data saved (37317 records). [2025-10-13T18:54:09.013070] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-13T18:54:09.013154] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FCPT took 36.9s. Estimated remaining: 3h 37m 50s. Rate: 7.1 symbols/min [2025-10-13T18:54:09.185517] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:09.214105] [DEBUG] [LOCAL ] FDS: Loaded 27620 existing records from primary storage. [2025-10-13T18:54:09.214376] [INFO ] [MAIN ] FDS: Loaded 27620 existing records. [2025-10-13T18:54:09.245527] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-13T18:54:09.403321] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:09.403806] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-13T18:54:09.404011] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-13T18:54:09.404513] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-13T18:54:09.404574] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-13T18:54:09.691951] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T18:54:09.801239] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:09.835234] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-13T18:54:10.024216] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-13T18:54:10.030014] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T18:54:10.817969] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-13T18:54:11.156546] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T18:54:11.617980] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-13T18:54:11.644547] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T18:54:12.417922] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-13T18:54:12.875917] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T18:54:13.217918] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-13T18:54:14.017985] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-13T18:54:14.429678] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T18:54:14.626976] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-13T18:54:14.801851] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T18:54:14.817904] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-13T18:54:15.617922] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-13T18:54:16.417978] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-13T18:54:16.563741] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T18:54:16.756479] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T18:54:17.217904] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-13T18:54:17.624144] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-13T18:54:17.747419] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T18:54:18.017922] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-13T18:54:18.817949] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-13T18:54:19.303198] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T18:54:19.617952] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-13T18:54:20.418012] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-13T18:54:20.678849] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T18:54:21.035201] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T18:54:21.217988] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-13T18:54:21.612601] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T18:54:22.017945] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-13T18:54:22.823411] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-13T18:54:22.832811] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T18:54:23.027767] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T18:54:23.617913] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-13T18:54:24.252819] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:54:24.418011] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-13T18:54:24.575968] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T18:54:24.578286] [INFO ] [REMOTE ] FCT: Full fetch complete (21021 records). [2025-10-13T18:54:24.578356] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-13T18:54:24.935883] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-13T18:54:24.935957] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-13T18:54:24.936358] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-13T18:54:24.936396] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-13T18:54:24.936963] [DEBUG] [LOCAL ] FCT: Trimmed 21021 records to 14759 (keeping 200 days of data) [2025-10-13T18:54:25.023153] [DEBUG] [LOCAL ] FCT: Primary data saved (14759 records). [2025-10-13T18:54:25.023288] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-13T18:54:25.023366] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FCT took 35.3s. Estimated remaining: 3h 37m 56s. Rate: 7.1 symbols/min [2025-10-13T18:54:25.198223] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:25.227123] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-13T18:54:25.248595] [DEBUG] [LOCAL ] FDX: Loaded 52203 existing records from primary storage. [2025-10-13T18:54:25.248926] [INFO ] [MAIN ] FDX: Loaded 52203 existing records. [2025-10-13T18:54:25.426670] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:25.426933] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-13T18:54:25.427198] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-13T18:54:25.435518] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-13T18:54:25.446979] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-13T18:54:25.513059] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T18:54:25.801954] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:26.017959] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-13T18:54:26.818005] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-13T18:54:27.529917] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-13T18:54:27.617884] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-13T18:54:27.905314] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T18:54:28.088756] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T18:54:28.417901] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-13T18:54:29.217953] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-13T18:54:29.632072] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-13T18:54:29.735189] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T18:54:30.017960] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-13T18:54:30.258289] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-13T18:54:30.817964] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-13T18:54:31.460059] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T18:54:31.617939] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-13T18:54:31.775388] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-13T18:54:32.417981] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-13T18:54:33.217893] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-13T18:54:33.369970] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T18:54:34.017896] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-13T18:54:34.310139] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T18:54:34.421057] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-13T18:54:34.818030] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-13T18:54:35.277031] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T18:54:35.282362] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-13T18:54:35.282466] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-13T18:54:35.623257] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-13T18:54:35.673106] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-13T18:54:35.673296] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-13T18:54:35.674381] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-13T18:54:35.674502] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-13T18:54:35.676002] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 53700 (keeping 200 days of data) [2025-10-13T18:54:36.010140] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T18:54:36.039979] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-10-13T18:54:36.040084] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-13T18:54:36.040793] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FCX took 38.0s. Estimated remaining: 3h 37m 52s. Rate: 7.1 symbols/min [2025-10-13T18:54:36.205561] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:36.258738] [DEBUG] [LOCAL ] FE: Loaded 54212 existing records from primary storage. [2025-10-13T18:54:36.259045] [INFO ] [MAIN ] FE: Loaded 54212 existing records. [2025-10-13T18:54:36.427310] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-13T18:54:36.432326] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:36.432678] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-13T18:54:36.432805] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-13T18:54:36.434217] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-13T18:54:36.434294] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-13T18:54:36.802844] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:36.816189] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T18:54:37.217984] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-13T18:54:38.017893] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-13T18:54:38.346675] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T18:54:38.490960] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-13T18:54:38.817973] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-13T18:54:39.332472] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T18:54:39.617904] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-13T18:54:40.417901] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-13T18:54:40.527587] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T18:54:40.779749] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T18:54:40.782958] [INFO ] [REMOTE ] FDP: Full fetch complete (42638 records). [2025-10-13T18:54:40.783074] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-13T18:54:41.154733] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-13T18:54:41.154834] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-13T18:54:41.155500] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-13T18:54:41.155669] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-13T18:54:41.156607] [DEBUG] [LOCAL ] FDP: Trimmed 42638 records to 29912 (keeping 200 days of data) [2025-10-13T18:54:41.218430] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-13T18:54:41.324013] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-13T18:54:41.364523] [DEBUG] [LOCAL ] FDP: Primary data saved (29912 records). [2025-10-13T18:54:41.364664] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-13T18:54:41.364758] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FDP took 34.7s. Estimated remaining: 3h 37m 38s. Rate: 7.1 symbols/min [2025-10-13T18:54:41.530283] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:41.530506] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-13T18:54:41.530561] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-13T18:54:41.530696] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-13T18:54:41.530764] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-13T18:54:41.530808] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-13T18:54:41.530841] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-13T18:54:41.877789] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:42.017910] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-13T18:54:42.817986] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-13T18:54:42.909934] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T18:54:42.981156] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T18:54:43.617910] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-13T18:54:44.417903] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-13T18:54:44.800276] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T18:54:44.843070] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T18:54:45.217892] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-13T18:54:46.017895] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-13T18:54:46.236495] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T18:54:46.436303] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-13T18:54:46.817903] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-13T18:54:46.899275] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T18:54:47.244622] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T18:54:47.617952] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-13T18:54:48.417958] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-13T18:54:49.217908] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-13T18:54:49.414516] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-13T18:54:49.418844] [INFO ] [REMOTE ] FDS: Full fetch complete (38193 records). [2025-10-13T18:54:49.418943] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-13T18:54:49.799514] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-13T18:54:49.799614] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-13T18:54:49.800227] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-13T18:54:49.800353] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-13T18:54:49.801558] [DEBUG] [LOCAL ] FDS: Trimmed 38193 records to 27413 (keeping 200 days of data) [2025-10-13T18:54:49.927870] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T18:54:50.017012] [DEBUG] [LOCAL ] FDS: Primary data saved (27413 records). [2025-10-13T18:54:50.017164] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-13T18:54:50.017270] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FDS took 41.0s. Estimated remaining: 3h 37m 30s. Rate: 7.1 symbols/min [2025-10-13T18:54:50.028603] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-13T18:54:50.188184] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:50.236896] [DEBUG] [LOCAL ] FERG: Loaded 49475 existing records from primary storage. [2025-10-13T18:54:50.237225] [INFO ] [MAIN ] FERG: Loaded 49475 existing records. [2025-10-13T18:54:50.412669] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:50.412915] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-13T18:54:50.412963] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-13T18:54:50.413483] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-13T18:54:50.413541] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-13T18:54:50.650440] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T18:54:50.779578] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:50.817918] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-13T18:54:50.979378] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T18:54:51.621001] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-13T18:54:52.044578] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T18:54:52.417906] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-13T18:54:52.514365] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T18:54:53.217948] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-13T18:54:54.017963] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-13T18:54:54.387046] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T18:54:54.495294] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T18:54:54.817977] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-13T18:54:55.051714] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T18:54:55.617950] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-13T18:54:56.417961] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-13T18:54:56.668733] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T18:54:56.675987] [INFO ] [REMOTE ] FDX: Full fetch complete (74323 records). [2025-10-13T18:54:56.676170] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-13T18:54:56.790788] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-13T18:54:57.084753] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-13T18:54:57.084937] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-13T18:54:57.085828] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-13T18:54:57.085889] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-13T18:54:57.087258] [DEBUG] [LOCAL ] FDX: Trimmed 74323 records to 51396 (keeping 200 days of data) [2025-10-13T18:54:57.268495] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-13T18:54:57.414932] [DEBUG] [LOCAL ] FDX: Primary data saved (51396 records). [2025-10-13T18:54:57.415105] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-13T18:54:57.415345] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FDX took 32.4s. Estimated remaining: 3h 37m 20s. Rate: 7.1 symbols/min [2025-10-13T18:54:57.561502] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-13T18:54:57.631423] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:54:57.645080] [DEBUG] [LOCAL ] FET: Loaded 12967 existing records from primary storage. [2025-10-13T18:54:57.645298] [INFO ] [MAIN ] FET: Loaded 12967 existing records. [2025-10-13T18:54:57.823526] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:54:57.823771] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-13T18:54:57.823822] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-13T18:54:57.824149] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-13T18:54:57.824207] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-13T18:54:58.028124] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-13T18:54:58.174561] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:54:58.362905] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-13T18:54:58.817915] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-13T18:54:59.112211] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T18:54:59.617997] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-13T18:54:59.650507] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T18:55:00.417967] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-13T18:55:01.217993] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-13T18:55:01.452993] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T18:55:01.583908] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-13T18:55:02.018018] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-13T18:55:02.105210] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T18:55:02.384806] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-13T18:55:02.817974] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-13T18:55:03.617995] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-13T18:55:04.418710] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-13T18:55:04.419635] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T18:55:04.583362] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T18:55:05.217965] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-13T18:55:06.018005] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-13T18:55:06.368618] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T18:55:06.385891] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-13T18:55:06.817908] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-13T18:55:07.080609] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T18:55:07.279611] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T18:55:07.280411] [INFO ] [REMOTE ] FENG: Full fetch complete (2278 records). [2025-10-13T18:55:07.280477] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-13T18:55:07.454193] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T18:55:07.454412] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-13T18:55:07.454481] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-13T18:55:07.454532] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-13T18:55:07.454620] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-13T18:55:07.454702] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-13T18:55:07.454760] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-13T18:55:07.454822] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FENG took 26.1s. Estimated remaining: 3h 37m 14s. Rate: 7.1 symbols/min [2025-10-13T18:55:07.620209] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:07.619336] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-13T18:55:07.642796] [DEBUG] [LOCAL ] FF: Loaded 24777 existing records from primary storage. [2025-10-13T18:55:07.643049] [INFO ] [MAIN ] FF: Loaded 24777 existing records. [2025-10-13T18:55:07.825673] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:07.825916] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-13T18:55:07.825967] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-13T18:55:07.826559] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-13T18:55:07.826619] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-13T18:55:08.186033] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:08.417943] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-13T18:55:09.217970] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-13T18:55:09.476780] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T18:55:09.522992] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T18:55:09.812880] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-13T18:55:10.017943] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-13T18:55:10.817967] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-13T18:55:11.617971] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-13T18:55:11.823103] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T18:55:11.941148] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T18:55:12.417954] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-13T18:55:12.554252] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-13T18:55:13.217959] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-13T18:55:14.017956] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-13T18:55:14.135948] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T18:55:14.219489] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T18:55:14.817976] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-13T18:55:15.132050] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T18:55:15.618172] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-13T18:55:15.672487] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T18:55:16.417995] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-13T18:55:17.219821] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-13T18:55:17.222245] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T18:55:17.312801] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:55:17.563470] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T18:55:17.569051] [INFO ] [REMOTE ] FE: Full fetch complete (77288 records). [2025-10-13T18:55:17.569193] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-13T18:55:17.978462] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-13T18:55:17.978588] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-13T18:55:17.979824] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-13T18:55:17.979894] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-13T18:55:17.981540] [DEBUG] [LOCAL ] FE: Trimmed 77288 records to 53432 (keeping 200 days of data) [2025-10-13T18:55:18.036707] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-13T18:55:18.340932] [DEBUG] [LOCAL ] FE: Primary data saved (53432 records). [2025-10-13T18:55:18.341089] [INFO ] [MAIN ] FE: Full history saved. [2025-10-13T18:55:18.342043] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FE took 42.3s. Estimated remaining: 3h 37m 11s. Rate: 7.1 symbols/min [2025-10-13T18:55:18.524665] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:18.537075] [DEBUG] [LOCAL ] FFA: Loaded 6187 existing records from primary storage. [2025-10-13T18:55:18.537376] [INFO ] [MAIN ] FFA: Loaded 6187 existing records. [2025-10-13T18:55:18.716255] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:18.716514] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-13T18:55:18.716562] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-13T18:55:18.716891] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-13T18:55:18.716960] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-13T18:55:18.823079] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-13T18:55:19.075029] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:19.617915] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-13T18:55:19.850152] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T18:55:20.253260] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T18:55:20.269879] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-13T18:55:20.417950] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-13T18:55:21.217965] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-13T18:55:21.622087] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T18:55:22.017899] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-13T18:55:22.099886] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T18:55:22.626960] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T18:55:22.817963] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-13T18:55:23.617949] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-13T18:55:23.901335] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-13T18:55:24.413907] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T18:55:24.418053] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-13T18:55:25.217970] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-13T18:55:25.315025] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T18:55:25.316892] [INFO ] [REMOTE ] FET: Full fetch complete (18273 records). [2025-10-13T18:55:25.316965] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-13T18:55:25.674106] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-13T18:55:25.674188] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-13T18:55:25.674742] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-13T18:55:25.674806] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-13T18:55:25.675416] [DEBUG] [LOCAL ] FET: Trimmed 18273 records to 12840 (keeping 200 days of data) [2025-10-13T18:55:25.758389] [DEBUG] [LOCAL ] FET: Primary data saved (12840 records). [2025-10-13T18:55:25.758538] [INFO ] [MAIN ] FET: Full history saved. [2025-10-13T18:55:25.758639] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FET took 28.3s. Estimated remaining: 3h 37m 0s. Rate: 7.1 symbols/min [2025-10-13T18:55:25.931204] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:25.938570] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T18:55:25.956390] [DEBUG] [LOCAL ] FFC: Loaded 17022 existing records from primary storage. [2025-10-13T18:55:25.956622] [INFO ] [MAIN ] FFC: Loaded 17022 existing records. [2025-10-13T18:55:26.023037] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-13T18:55:26.138605] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:26.138861] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-13T18:55:26.138908] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-13T18:55:26.139304] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-13T18:55:26.139363] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-13T18:55:26.490984] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:26.817948] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-13T18:55:27.025777] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:55:27.453603] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-13T18:55:27.617895] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-13T18:55:28.203436] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-13T18:55:28.417963] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-13T18:55:29.218034] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-13T18:55:29.542051] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-13T18:55:29.910987] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T18:55:30.017980] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-13T18:55:30.817944] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-13T18:55:31.137697] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T18:55:31.617977] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-13T18:55:32.249596] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-13T18:55:32.410228] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T18:55:32.419110] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-13T18:55:32.858044] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T18:55:33.217945] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-13T18:55:33.886402] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T18:55:34.018026] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-13T18:55:34.818005] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-13T18:55:35.070402] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T18:55:35.411137] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-13T18:55:35.617911] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-13T18:55:36.223258] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T18:55:36.417910] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-13T18:55:36.913227] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T18:55:37.218006] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-13T18:55:38.017892] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-13T18:55:38.054516] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T18:55:38.817981] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-13T18:55:39.617912] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-13T18:55:39.785285] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T18:55:39.818106] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T18:55:40.417970] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-13T18:55:40.459316] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T18:55:40.460815] [INFO ] [REMOTE ] FFA: Full fetch complete (8779 records). [2025-10-13T18:55:40.460882] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-13T18:55:40.811486] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-13T18:55:40.811559] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-13T18:55:40.811794] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-13T18:55:40.811854] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-13T18:55:40.812244] [DEBUG] [LOCAL ] FFA: Trimmed 8779 records to 6060 (keeping 200 days of data) [2025-10-13T18:55:40.849366] [DEBUG] [LOCAL ] FFA: Primary data saved (6060 records). [2025-10-13T18:55:40.849492] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-13T18:55:40.849608] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FFA took 22.5s. Estimated remaining: 3h 37m 4s. Rate: 7.1 symbols/min [2025-10-13T18:55:41.013843] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:41.052914] [DEBUG] [LOCAL ] FFWM: Loaded 36288 existing records from primary storage. [2025-10-13T18:55:41.053177] [INFO ] [MAIN ] FFWM: Loaded 36288 existing records. [2025-10-13T18:55:41.228686] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:41.223976] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-13T18:55:41.229719] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-13T18:55:41.230086] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-13T18:55:41.230403] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-13T18:55:41.230459] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-13T18:55:41.418091] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T18:55:41.601164] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:42.017944] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-13T18:55:42.265883] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T18:55:42.268250] [INFO ] [REMOTE ] FF: Full fetch complete (36338 records). [2025-10-13T18:55:42.268344] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-13T18:55:42.635497] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-13T18:55:42.635578] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-13T18:55:42.636151] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-13T18:55:42.636215] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-13T18:55:42.637144] [DEBUG] [LOCAL ] FF: Trimmed 36338 records to 24334 (keeping 200 days of data) [2025-10-13T18:55:42.778588] [DEBUG] [LOCAL ] FF: Primary data saved (24334 records). [2025-10-13T18:55:42.778748] [INFO ] [MAIN ] FF: Full history saved. [2025-10-13T18:55:42.778837] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FF took 35.3s. Estimated remaining: 3h 36m 44s. Rate: 7.1 symbols/min [2025-10-13T18:55:42.823088] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-13T18:55:42.955378] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:42.982615] [DEBUG] [LOCAL ] FG: Loaded 23056 existing records from primary storage. [2025-10-13T18:55:42.982948] [INFO ] [MAIN ] FG: Loaded 23056 existing records. [2025-10-13T18:55:43.163189] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:43.163527] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-13T18:55:43.163588] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-13T18:55:43.163984] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-13T18:55:43.164276] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-13T18:55:43.474822] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T18:55:43.560175] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:43.617889] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-13T18:55:44.417942] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-13T18:55:44.438070] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T18:55:44.443382] [INFO ] [REMOTE ] FERG: Full fetch complete (70791 records). [2025-10-13T18:55:44.443542] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-13T18:55:44.866895] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-13T18:55:44.867070] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-13T18:55:44.868456] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-13T18:55:44.868626] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-13T18:55:44.870871] [DEBUG] [LOCAL ] FERG: Trimmed 70791 records to 48791 (keeping 200 days of data) [2025-10-13T18:55:44.961226] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-13T18:55:45.144730] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T18:55:45.218130] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-13T18:55:45.231149] [DEBUG] [LOCAL ] FERG: Primary data saved (48791 records). [2025-10-13T18:55:45.231535] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-13T18:55:45.231633] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FERG took 55.2s. Estimated remaining: 3h 36m 24s. Rate: 7.1 symbols/min [2025-10-13T18:55:45.394852] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:55:45.400007] [DEBUG] [LOCAL ] FGN: Loaded 3821 existing records from primary storage. [2025-10-13T18:55:45.400167] [INFO ] [MAIN ] FGN: Loaded 3821 existing records. [2025-10-13T18:55:45.570062] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:55:45.570272] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-13T18:55:45.570351] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-13T18:55:45.570496] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-13T18:55:45.570534] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-13T18:55:45.918535] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:55:46.017895] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-13T18:55:46.543178] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-13T18:55:46.564448] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T18:55:46.817963] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-13T18:55:47.618014] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-13T18:55:48.209620] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T18:55:48.232425] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T18:55:48.417942] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-13T18:55:49.217990] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-13T18:55:49.596136] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-13T18:55:49.931271] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T18:55:50.017930] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-13T18:55:50.517484] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-13T18:55:50.817945] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-13T18:55:51.617892] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-13T18:55:51.776075] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T18:55:52.417948] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-13T18:55:52.946511] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T18:55:53.208248] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T18:55:53.217986] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-13T18:55:54.017980] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-13T18:55:54.213382] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:55:54.600418] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T18:55:54.817906] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-13T18:55:55.617902] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-13T18:55:56.060535] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T18:55:56.235049] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T18:55:56.417935] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-13T18:55:56.969399] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T18:55:57.217961] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-13T18:55:57.825422] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T18:55:58.017968] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-13T18:55:58.817941] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-13T18:55:59.501583] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T18:55:59.617963] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-13T18:55:59.813159] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T18:56:00.417980] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-13T18:56:00.485224] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T18:56:01.217965] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-13T18:56:01.527149] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T18:56:02.017907] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-13T18:56:02.342057] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T18:56:02.818017] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-13T18:56:02.953590] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T18:56:03.436323] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-13T18:56:03.617943] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-13T18:56:04.417944] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-13T18:56:04.847893] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T18:56:04.851849] [INFO ] [REMOTE ] FFWM: Full fetch complete (51722 records). [2025-10-13T18:56:04.851964] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-13T18:56:05.223843] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-13T18:56:05.269887] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-13T18:56:05.269983] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-13T18:56:05.270803] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-13T18:56:05.270866] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-13T18:56:05.272341] [DEBUG] [LOCAL ] FFWM: Trimmed 51722 records to 35828 (keeping 200 days of data) [2025-10-13T18:56:05.389701] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T18:56:05.488962] [DEBUG] [LOCAL ] FFWM: Primary data saved (35828 records). [2025-10-13T18:56:05.489133] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-13T18:56:05.489901] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FFWM took 24.6s. Estimated remaining: 3h 36m 38s. Rate: 7.1 symbols/min [2025-10-13T18:56:05.655948] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:05.656160] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-13T18:56:05.656198] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-13T18:56:05.656310] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-13T18:56:05.656352] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-13T18:56:05.656397] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-13T18:56:05.656429] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-13T18:56:06.002925] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:06.017889] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-13T18:56:06.225545] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:56:06.225907] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-13T18:56:06.226001] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:56:06.226049] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-13T18:56:06.226105] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:56:06.226177] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-13T18:56:06.226282] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-13T18:56:06.226325] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-13T18:56:06.226366] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-13T18:56:06.226426] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FGSN took 0.7s. Estimated remaining: 3h 36m 15s. Rate: 7.1 symbols/min [2025-10-13T18:56:06.409881] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:06.413767] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T18:56:06.460000] [DEBUG] [LOCAL ] FHI: Loaded 40451 existing records from primary storage. [2025-10-13T18:56:06.460295] [INFO ] [MAIN ] FHI: Loaded 40451 existing records. [2025-10-13T18:56:06.633967] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:06.634177] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-13T18:56:06.634224] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-13T18:56:06.634720] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-13T18:56:06.634778] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-13T18:56:06.825720] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-13T18:56:06.986613] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:07.617949] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-13T18:56:08.151239] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T18:56:08.417986] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-13T18:56:09.105784] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T18:56:09.217959] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-13T18:56:09.422744] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:56:10.017949] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-13T18:56:10.448595] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T18:56:10.580127] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T18:56:10.817935] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-13T18:56:11.617949] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-13T18:56:12.356704] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T18:56:12.380791] [INFO ] [REMOTE ] FFC: Full fetch complete (24579 records). [2025-10-13T18:56:12.391544] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-13T18:56:12.394180] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:56:12.425733] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-13T18:56:12.784873] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-13T18:56:12.784954] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-13T18:56:12.785539] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-13T18:56:12.785579] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-13T18:56:12.786224] [DEBUG] [LOCAL ] FFC: Trimmed 24579 records to 16800 (keeping 200 days of data) [2025-10-13T18:56:12.889515] [DEBUG] [LOCAL ] FFC: Primary data saved (16800 records). [2025-10-13T18:56:12.889691] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-13T18:56:12.889791] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FFC took 47.1s. Estimated remaining: 3h 36m 4s. Rate: 7.1 symbols/min [2025-10-13T18:56:13.058119] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:13.109335] [DEBUG] [LOCAL ] FHN: Loaded 54153 existing records from primary storage. [2025-10-13T18:56:13.109667] [INFO ] [MAIN ] FHN: Loaded 54153 existing records. [2025-10-13T18:56:13.223038] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-13T18:56:13.286434] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:13.286817] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-13T18:56:13.286866] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-13T18:56:13.287369] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-13T18:56:13.287425] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-13T18:56:13.672028] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:13.683919] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T18:56:14.017937] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-13T18:56:14.603084] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T18:56:14.818020] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-13T18:56:15.500609] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T18:56:15.617931] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-13T18:56:15.717171] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T18:56:16.417938] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-13T18:56:16.616750] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T18:56:17.218032] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-13T18:56:17.973913] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T18:56:18.017891] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-13T18:56:18.817890] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-13T18:56:18.925178] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T18:56:19.617952] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-13T18:56:19.690777] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T18:56:19.764919] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T18:56:19.767391] [INFO ] [REMOTE ] FG: Full fetch complete (28287 records). [2025-10-13T18:56:19.767466] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-13T18:56:20.129581] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-13T18:56:20.129692] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-13T18:56:20.130194] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-13T18:56:20.130260] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-13T18:56:20.130955] [DEBUG] [LOCAL ] FG: Trimmed 28287 records to 22312 (keeping 200 days of data) [2025-10-13T18:56:20.266294] [DEBUG] [LOCAL ] FG: Primary data saved (22312 records). [2025-10-13T18:56:20.266426] [INFO ] [MAIN ] FG: Full history saved. [2025-10-13T18:56:20.266504] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FG took 37.5s. Estimated remaining: 3h 35m 53s. Rate: 7.1 symbols/min [2025-10-13T18:56:20.429457] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-13T18:56:20.433197] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:20.489602] [DEBUG] [LOCAL ] FI: Loaded 54313 existing records from primary storage. [2025-10-13T18:56:20.489966] [INFO ] [MAIN ] FI: Loaded 54313 existing records. [2025-10-13T18:56:20.667409] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:20.667661] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-13T18:56:20.667730] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-13T18:56:20.668854] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-13T18:56:20.668918] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-13T18:56:21.040473] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:21.064034] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T18:56:21.217964] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-13T18:56:22.017905] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-13T18:56:22.186943] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T18:56:22.817978] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-13T18:56:22.949743] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T18:56:23.175035] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T18:56:23.617931] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-13T18:56:24.417900] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-13T18:56:24.552239] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T18:56:24.803531] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-13T18:56:25.141226] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T18:56:25.217958] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-13T18:56:26.017988] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-13T18:56:26.550756] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-13T18:56:26.817902] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-13T18:56:26.963409] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T18:56:27.283856] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T18:56:27.284692] [INFO ] [REMOTE ] FGN: Full fetch complete (5655 records). [2025-10-13T18:56:27.284759] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-13T18:56:27.618238] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-13T18:56:27.642535] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-13T18:56:27.642625] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-13T18:56:27.642944] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-13T18:56:27.642997] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-13T18:56:27.643575] [DEBUG] [LOCAL ] FGN: Trimmed 5655 records to 3758 (keeping 200 days of data) [2025-10-13T18:56:27.669410] [DEBUG] [LOCAL ] FGN: Primary data saved (3758 records). [2025-10-13T18:56:27.669531] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-13T18:56:27.669662] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FGN took 42.4s. Estimated remaining: 3h 35m 43s. Rate: 7.1 symbols/min [2025-10-13T18:56:27.843286] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:27.866556] [DEBUG] [LOCAL ] FICO: Loaded 21793 existing records from primary storage. [2025-10-13T18:56:27.866839] [INFO ] [MAIN ] FICO: Loaded 21793 existing records. [2025-10-13T18:56:28.039381] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:28.039603] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-13T18:56:28.039673] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-13T18:56:28.040028] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-13T18:56:28.040084] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-13T18:56:28.388055] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:28.417894] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-13T18:56:29.152111] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T18:56:29.217900] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-13T18:56:29.441880] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T18:56:30.017981] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-13T18:56:30.817990] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-13T18:56:30.905933] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:56:31.505936] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T18:56:31.617972] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-13T18:56:31.956294] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T18:56:32.417946] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-13T18:56:32.976927] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T18:56:33.216750] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T18:56:33.220963] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-13T18:56:34.021788] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-13T18:56:34.817924] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-13T18:56:34.999085] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T18:56:35.521080] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T18:56:35.617985] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-13T18:56:36.288466] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:56:36.292319] [INFO ] [REMOTE ] FHI: Full fetch complete (57511 records). [2025-10-13T18:56:36.292418] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-13T18:56:36.428746] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-13T18:56:36.672996] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-13T18:56:36.673091] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-13T18:56:36.673885] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-13T18:56:36.673949] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-13T18:56:36.675165] [DEBUG] [LOCAL ] FHI: Trimmed 57511 records to 39869 (keeping 200 days of data) [2025-10-13T18:56:36.913151] [DEBUG] [LOCAL ] FHI: Primary data saved (39869 records). [2025-10-13T18:56:36.913302] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-13T18:56:36.914053] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FHI took 30.7s. Estimated remaining: 3h 35m 36s. Rate: 7.1 symbols/min [2025-10-13T18:56:37.110132] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:37.110452] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-13T18:56:37.110533] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-13T18:56:37.110755] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-13T18:56:37.110819] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-13T18:56:37.110875] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-13T18:56:37.110917] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-13T18:56:37.221672] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-13T18:56:37.502470] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:37.544516] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T18:56:37.606546] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-13T18:56:38.017991] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-13T18:56:38.817957] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-13T18:56:38.959163] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T18:56:39.130460] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-13T18:56:39.617971] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-13T18:56:39.689880] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:56:39.855813] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-13T18:56:40.417982] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-13T18:56:41.217983] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-13T18:56:42.017984] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-13T18:56:42.366044] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-13T18:56:42.396974] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T18:56:42.817967] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-13T18:56:43.244734] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T18:56:43.618006] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-13T18:56:43.713931] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T18:56:43.720159] [INFO ] [REMOTE ] FHN: Full fetch complete (77294 records). [2025-10-13T18:56:43.720293] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-13T18:56:43.883799] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-13T18:56:44.112355] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-13T18:56:44.112441] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-13T18:56:44.113411] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-13T18:56:44.113479] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-13T18:56:44.114966] [DEBUG] [LOCAL ] FHN: Trimmed 77294 records to 53388 (keeping 200 days of data) [2025-10-13T18:56:44.418627] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-13T18:56:44.443834] [DEBUG] [LOCAL ] FHN: Primary data saved (53388 records). [2025-10-13T18:56:44.443996] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-13T18:56:44.444096] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FHN took 31.6s. Estimated remaining: 3h 35m 26s. Rate: 7.1 symbols/min [2025-10-13T18:56:44.616245] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:44.659778] [DEBUG] [LOCAL ] FIGS: Loaded 49411 existing records from primary storage. [2025-10-13T18:56:44.660160] [INFO ] [MAIN ] FIGS: Loaded 49411 existing records. [2025-10-13T18:56:44.766942] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-13T18:56:44.856411] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:44.856668] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-13T18:56:44.856727] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-13T18:56:44.857496] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-13T18:56:44.857553] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-13T18:56:45.209088] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:45.217888] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-13T18:56:46.017946] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-13T18:56:46.289726] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-13T18:56:46.817964] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-13T18:56:46.875711] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-13T18:56:47.009394] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:56:47.009863] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-13T18:56:47.009979] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:56:47.010075] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-13T18:56:47.010159] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:56:47.010247] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-13T18:56:47.010335] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-13T18:56:47.010387] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-13T18:56:47.010450] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-13T18:56:47.010540] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FIG took 10.1s. Estimated remaining: 3h 35m 7s. Rate: 7.1 symbols/min [2025-10-13T18:56:47.194430] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:56:47.239889] [DEBUG] [LOCAL ] FIHL: Loaded 40181 existing records from primary storage. [2025-10-13T18:56:47.240198] [INFO ] [MAIN ] FIHL: Loaded 40181 existing records. [2025-10-13T18:56:47.429094] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:56:47.429316] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-13T18:56:47.429368] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-13T18:56:47.430304] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-13T18:56:47.430368] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-13T18:56:47.623050] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-13T18:56:47.808551] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:56:48.418009] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-13T18:56:49.017744] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T18:56:49.217945] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-13T18:56:49.790536] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T18:56:50.018006] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-13T18:56:50.057388] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T18:56:50.817947] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-13T18:56:50.961177] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T18:56:51.617934] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-13T18:56:51.736675] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T18:56:52.417971] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-13T18:56:53.200779] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:56:53.217885] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-13T18:56:54.010742] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T18:56:54.023027] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-13T18:56:54.817933] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-13T18:56:54.924207] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T18:56:55.366357] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-13T18:56:55.617942] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-13T18:56:56.417942] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-13T18:56:56.519348] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T18:56:56.754120] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T18:56:57.218015] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-13T18:56:57.980314] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T18:56:58.017882] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-13T18:56:58.817925] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-13T18:56:58.906861] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:56:59.191724] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T18:56:59.617959] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-13T18:57:00.048939] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T18:57:00.417981] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-13T18:57:01.044988] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-13T18:57:01.217892] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-13T18:57:01.299522] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T18:57:02.017954] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-13T18:57:02.652061] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T18:57:02.817979] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-13T18:57:03.617966] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-13T18:57:04.290303] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-13T18:57:04.417950] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-13T18:57:04.495369] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T18:57:04.966134] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T18:57:04.974636] [INFO ] [REMOTE ] FICO: Full fetch complete (29619 records). [2025-10-13T18:57:04.974895] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-13T18:57:05.223161] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-13T18:57:05.345167] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-13T18:57:05.345253] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-13T18:57:05.345779] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-13T18:57:05.345842] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-13T18:57:05.346693] [DEBUG] [LOCAL ] FICO: Trimmed 29619 records to 21625 (keeping 200 days of data) [2025-10-13T18:57:05.479171] [DEBUG] [LOCAL ] FICO: Primary data saved (21625 records). [2025-10-13T18:57:05.479297] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-13T18:57:05.479373] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FICO took 37.8s. Estimated remaining: 3h 35m 17s. Rate: 7.1 symbols/min [2025-10-13T18:57:05.645669] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:05.655184] [DEBUG] [LOCAL ] FINS: Loaded 8390 existing records from primary storage. [2025-10-13T18:57:05.655399] [INFO ] [MAIN ] FINS: Loaded 8390 existing records. [2025-10-13T18:57:05.833472] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:05.833707] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-13T18:57:05.833762] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-13T18:57:05.833944] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-13T18:57:05.833981] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-13T18:57:06.042132] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-13T18:57:06.191708] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:06.468756] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-13T18:57:06.817918] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-13T18:57:06.969935] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T18:57:07.539165] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T18:57:07.617889] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-13T18:57:08.417974] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-13T18:57:08.490060] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T18:57:09.217964] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-13T18:57:09.505794] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T18:57:09.728955] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-13T18:57:09.923595] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T18:57:09.929096] [INFO ] [REMOTE ] FI: Full fetch complete (77228 records). [2025-10-13T18:57:09.929235] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-13T18:57:10.023057] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-13T18:57:10.321836] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-13T18:57:10.321914] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-13T18:57:10.322795] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-13T18:57:10.322894] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-13T18:57:10.324345] [DEBUG] [LOCAL ] FI: Trimmed 77228 records to 53574 (keeping 200 days of data) [2025-10-13T18:57:10.653062] [DEBUG] [LOCAL ] FI: Primary data saved (53574 records). [2025-10-13T18:57:10.653415] [INFO ] [MAIN ] FI: Full history saved. [2025-10-13T18:57:10.653506] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FI took 50.4s. Estimated remaining: 3h 35m 3s. Rate: 7.1 symbols/min [2025-10-13T18:57:10.819562] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-13T18:57:10.824941] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:10.833106] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T18:57:10.881757] [DEBUG] [LOCAL ] FINV: Loaded 45966 existing records from primary storage. [2025-10-13T18:57:10.882158] [INFO ] [MAIN ] FINV: Loaded 45966 existing records. [2025-10-13T18:57:11.064707] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:11.065014] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-13T18:57:11.065065] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-13T18:57:11.066173] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-13T18:57:11.066232] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-13T18:57:11.433972] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:11.617985] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-13T18:57:12.417983] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-13T18:57:12.647210] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T18:57:13.031317] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T18:57:13.217952] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-13T18:57:13.819680] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T18:57:14.017896] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-13T18:57:14.817894] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-13T18:57:14.985169] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T18:57:15.474531] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T18:57:15.483925] [INFO ] [REMOTE ] FIHL: Full fetch complete (56157 records). [2025-10-13T18:57:15.484735] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T18:57:15.484841] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-13T18:57:15.623023] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-13T18:57:15.870753] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-13T18:57:15.870844] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-13T18:57:15.871559] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-13T18:57:15.871602] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-13T18:57:15.872839] [DEBUG] [LOCAL ] FIHL: Trimmed 56157 records to 39496 (keeping 200 days of data) [2025-10-13T18:57:16.110383] [DEBUG] [LOCAL ] FIHL: Primary data saved (39496 records). [2025-10-13T18:57:16.110590] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-13T18:57:16.111367] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FIHL took 29.1s. Estimated remaining: 3h 34m 49s. Rate: 7.1 symbols/min [2025-10-13T18:57:16.324481] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T18:57:16.417942] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-13T18:57:17.149740] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T18:57:17.217897] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-13T18:57:18.004282] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T18:57:18.017874] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-13T18:57:18.779153] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T18:57:18.817926] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-13T18:57:19.554262] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T18:57:19.617943] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-13T18:57:20.417999] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-13T18:57:21.217920] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-13T18:57:21.243825] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T18:57:21.281199] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T18:57:22.017940] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-13T18:57:22.699536] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T18:57:22.817960] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-13T18:57:23.564745] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T18:57:23.617966] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-13T18:57:23.656392] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T18:57:23.662452] [INFO ] [REMOTE ] FIGS: Full fetch complete (70793 records). [2025-10-13T18:57:23.662630] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-13T18:57:24.067726] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-13T18:57:24.067854] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-13T18:57:24.069192] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-13T18:57:24.069266] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-13T18:57:24.071240] [DEBUG] [LOCAL ] FIGS: Trimmed 70793 records to 48637 (keeping 200 days of data) [2025-10-13T18:57:24.286217] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T18:57:24.291013] [INFO ] [REMOTE ] FINS: Full fetch complete (11846 records). [2025-10-13T18:57:24.300073] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-13T18:57:24.420102] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-13T18:57:24.705706] [DEBUG] [LOCAL ] FIGS: Primary data saved (48637 records). [2025-10-13T18:57:24.724474] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-13T18:57:24.734572] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FIGS took 40.3s. Estimated remaining: 3h 34m 41s. Rate: 7.1 symbols/min [2025-10-13T18:57:24.768916] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-13T18:57:24.769020] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-13T18:57:24.769558] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-13T18:57:24.769601] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-13T18:57:24.770163] [DEBUG] [LOCAL ] FINS: Trimmed 11846 records to 8300 (keeping 200 days of data) [2025-10-13T18:57:24.825262] [DEBUG] [LOCAL ] FINS: Primary data saved (8300 records). [2025-10-13T18:57:24.825459] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-13T18:57:24.825608] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FINS took 19.3s. Estimated remaining: 3h 34m 17s. Rate: 7.1 symbols/min [2025-10-13T18:57:25.899844] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T18:57:25.909343] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-13T18:57:27.456617] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T18:57:27.466302] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-13T18:57:29.071148] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T18:57:29.081034] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-13T18:57:30.585916] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T18:57:30.595164] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-13T18:57:32.079878] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T18:57:32.090265] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-13T18:57:33.608237] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T18:57:33.618808] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-13T18:57:35.069743] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T18:57:35.081232] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-13T18:57:36.765567] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T18:57:36.776339] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-13T18:57:38.409262] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T18:57:38.414263] [INFO ] [REMOTE ] FINV: Full fetch complete (64218 records). [2025-10-13T18:57:38.414380] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-13T18:57:38.813521] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-13T18:57:38.813607] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-13T18:57:38.814457] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-13T18:57:38.814523] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-13T18:57:38.815906] [DEBUG] [LOCAL ] FINV: Trimmed 64218 records to 45299 (keeping 200 days of data) [2025-10-13T18:57:39.073275] [DEBUG] [LOCAL ] FINV: Primary data saved (45299 records). [2025-10-13T18:57:39.073408] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-13T18:57:39.073490] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FINV took 28.4s. Estimated remaining: 3h 34m 20s. Rate: 7.1 symbols/min [2025-10-13T18:57:39.775144] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:39.733251] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:39.814098] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:39.886353] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:39.886972] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-13T18:57:39.887025] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-13T18:57:39.887138] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-13T18:57:39.887182] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-13T18:57:39.887228] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-13T18:57:39.887267] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-13T18:57:40.012210] [DEBUG] [LOCAL ] FLC: Loaded 5479 existing records from primary storage. [2025-10-13T18:57:40.029733] [INFO ] [MAIN ] FLC: Loaded 5479 existing records. [2025-10-13T18:57:40.121746] [DEBUG] [LOCAL ] FIX: Loaded 29642 existing records from primary storage. [2025-10-13T18:57:40.172114] [INFO ] [MAIN ] FIX: Loaded 29642 existing records. [2025-10-13T18:57:40.469362] [DEBUG] [LOCAL ] FIS: Loaded 54124 existing records from primary storage. [2025-10-13T18:57:40.481957] [INFO ] [MAIN ] FIS: Loaded 54124 existing records. [2025-10-13T18:57:40.800306] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:40.851053] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:40.853831] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-13T18:57:40.853988] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-13T18:57:40.879696] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-13T18:57:40.879572] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-13T18:57:40.885564] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-13T18:57:40.899787] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-13T18:57:40.922363] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-13T18:57:40.889350] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:41.006920] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-13T18:57:41.006210] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-13T18:57:41.132744] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:41.184877] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-13T18:57:41.191673] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-13T18:57:41.221147] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-13T18:57:41.246570] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-13T18:57:41.492161] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:57:41.568773] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-13T18:57:41.631903] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:57:41.684833] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-13T18:57:41.715314] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:57:41.746410] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-13T18:57:41.749847] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:41.762433] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-13T18:57:41.762835] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-13T18:57:41.774612] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-13T18:57:41.785502] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-13T18:57:41.843445] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 2.8s. Estimated remaining: 3h 34m 1s. Rate: 7.1 symbols/min [2025-10-13T18:57:42.142367] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:42.222957] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-13T18:57:42.366917] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:42.383254] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-13T18:57:42.407931] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:42.476810] [DEBUG] [LOCAL ] FLG: Loaded 54092 existing records from primary storage. [2025-10-13T18:57:42.477313] [INFO ] [MAIN ] FLG: Loaded 54092 existing records. [2025-10-13T18:57:42.663321] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:42.663822] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-13T18:57:42.663921] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-13T18:57:42.664496] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-13T18:57:42.664554] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-13T18:57:42.936630] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T18:57:42.948957] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-13T18:57:43.029283] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:43.029592] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-13T18:57:43.591041] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T18:57:43.596964] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-13T18:57:43.710448] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T18:57:43.712297] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-13T18:57:44.177159] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T18:57:44.191867] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-13T18:57:44.272096] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T18:57:44.273703] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-13T18:57:44.816552] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-13T18:57:44.819199] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-13T18:57:44.853463] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T18:57:44.865137] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-13T18:57:45.097599] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T18:57:45.105317] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-13T18:57:45.263741] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T18:57:45.266601] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-13T18:57:45.714170] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T18:57:45.724714] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-13T18:57:45.868389] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T18:57:45.870220] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-13T18:57:46.234634] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-13T18:57:46.236623] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-13T18:57:46.340133] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T18:57:46.348003] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-13T18:57:46.547636] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T18:57:46.559009] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-13T18:57:46.852829] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T18:57:46.854626] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-13T18:57:47.145516] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T18:57:47.573336] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T18:57:47.618001] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-13T18:57:47.967213] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-13T18:57:48.109945] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T18:57:48.196812] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T18:57:48.417950] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-13T18:57:49.218023] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-13T18:57:50.017983] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-13T18:57:50.268364] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T18:57:50.643199] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T18:57:50.644229] [INFO ] [REMOTE ] FLC: Full fetch complete (7844 records). [2025-10-13T18:57:50.644296] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-13T18:57:50.829817] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-13T18:57:51.001345] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T18:57:51.041387] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-13T18:57:51.041478] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-13T18:57:51.042012] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-13T18:57:51.042063] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-13T18:57:51.042474] [DEBUG] [LOCAL ] FLC: Trimmed 7844 records to 5442 (keeping 200 days of data) [2025-10-13T18:57:51.075114] [DEBUG] [LOCAL ] FLC: Primary data saved (5442 records). [2025-10-13T18:57:51.075230] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-13T18:57:51.075313] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 12.0s. Estimated remaining: 3h 33m 54s. Rate: 7.1 symbols/min [2025-10-13T18:57:51.250398] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:57:51.282488] [DEBUG] [LOCAL ] FLNG: Loaded 34064 existing records from primary storage. [2025-10-13T18:57:51.282782] [INFO ] [MAIN ] FLNG: Loaded 34064 existing records. [2025-10-13T18:57:51.460312] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:57:51.460533] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-13T18:57:51.460582] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-13T18:57:51.461404] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-13T18:57:51.461462] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-13T18:57:51.630741] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-13T18:57:51.813117] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:57:52.417964] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-13T18:57:52.650381] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T18:57:53.087965] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T18:57:53.217973] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-13T18:57:53.938792] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T18:57:54.017930] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-13T18:57:54.817926] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-13T18:57:55.191530] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-13T18:57:55.511695] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T18:57:55.617970] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-13T18:57:56.417961] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-13T18:57:56.724491] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T18:57:57.037679] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T18:57:57.218024] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-13T18:57:58.018004] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-13T18:57:58.218677] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T18:57:58.610637] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T18:57:58.817952] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-13T18:57:59.259503] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T18:57:59.617948] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-13T18:58:00.005823] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-13T18:58:00.417985] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-13T18:58:01.217974] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-13T18:58:01.536215] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T18:58:02.018056] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-13T18:58:02.260578] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T18:58:02.454858] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T18:58:02.817963] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-13T18:58:03.361338] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T18:58:03.618003] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-13T18:58:04.417992] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-13T18:58:04.580171] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T18:58:05.217993] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-13T18:58:05.335589] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T18:58:05.410632] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T18:58:06.021472] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-13T18:58:06.542595] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T18:58:06.817954] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-13T18:58:07.618014] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-13T18:58:07.818991] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T18:58:07.890773] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T18:58:08.417954] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-13T18:58:08.982756] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T18:58:09.217964] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-13T18:58:10.017894] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-13T18:58:10.128236] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T18:58:10.681596] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T18:58:10.817937] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-13T18:58:11.614473] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T18:58:11.625238] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-13T18:58:11.995067] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T18:58:12.417965] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-13T18:58:13.223086] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-13T18:58:13.237754] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T18:58:13.811807] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T18:58:13.815181] [INFO ] [REMOTE ] FLNG: Full fetch complete (50224 records). [2025-10-13T18:58:13.815275] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-13T18:58:14.028735] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-13T18:58:14.213558] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-13T18:58:14.213684] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-13T18:58:14.214357] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-13T18:58:14.214528] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-13T18:58:14.215586] [DEBUG] [LOCAL ] FLNG: Trimmed 50224 records to 33739 (keeping 200 days of data) [2025-10-13T18:58:14.345854] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T18:58:14.444221] [DEBUG] [LOCAL ] FLNG: Primary data saved (33739 records). [2025-10-13T18:58:14.444365] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-13T18:58:14.444464] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLNG took 23.4s. Estimated remaining: 3h 34m 13s. Rate: 7.1 symbols/min [2025-10-13T18:58:14.612115] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:14.662396] [DEBUG] [LOCAL ] FLO: Loaded 52720 existing records from primary storage. [2025-10-13T18:58:14.662726] [INFO ] [MAIN ] FLO: Loaded 52720 existing records. [2025-10-13T18:58:14.821665] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-13T18:58:14.848736] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:14.849102] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-13T18:58:14.849175] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-13T18:58:14.855624] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-13T18:58:14.864964] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-13T18:58:14.879268] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T18:58:14.942016] [INFO ] [REMOTE ] FIS: Full fetch complete (77187 records). [2025-10-13T18:58:14.963289] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-13T18:58:15.536807] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:15.622858] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-13T18:58:15.679603] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-13T18:58:15.679730] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-13T18:58:15.680771] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-13T18:58:15.680840] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-13T18:58:15.682533] [DEBUG] [LOCAL ] FIS: Trimmed 77187 records to 53345 (keeping 200 days of data) [2025-10-13T18:58:16.017394] [DEBUG] [LOCAL ] FIS: Primary data saved (53345 records). [2025-10-13T18:58:16.017548] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-13T18:58:16.017670] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FIS took 36.9s. Estimated remaining: 3h 33m 52s. Rate: 7.1 symbols/min [2025-10-13T18:58:16.189886] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:16.190091] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-13T18:58:16.190134] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-13T18:58:16.190242] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-13T18:58:16.190283] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-13T18:58:16.190325] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-13T18:58:16.190357] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-13T18:58:16.308569] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T18:58:16.355987] [INFO ] [REMOTE ] FIX: Full fetch complete (45196 records). [2025-10-13T18:58:16.365170] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-13T18:58:16.442363] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-13T18:58:16.859695] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:16.955469] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-13T18:58:16.955552] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-13T18:58:16.956206] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-13T18:58:16.956272] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-13T18:58:16.957437] [DEBUG] [LOCAL ] FIX: Trimmed 45196 records to 29043 (keeping 200 days of data) [2025-10-13T18:58:17.144082] [DEBUG] [LOCAL ] FIX: Primary data saved (29043 records). [2025-10-13T18:58:17.144241] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-13T18:58:17.144354] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FIX took 38.1s. Estimated remaining: 3h 33m 31s. Rate: 7.1 symbols/min [2025-10-13T18:58:17.224065] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-13T18:58:17.331975] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:17.387402] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T18:58:17.418791] [DEBUG] [LOCAL ] FLR: Loaded 53945 existing records from primary storage. [2025-10-13T18:58:17.419226] [INFO ] [MAIN ] FLR: Loaded 53945 existing records. [2025-10-13T18:58:17.497186] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T18:58:17.520397] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-13T18:58:17.530728] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T18:58:17.530868] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-13T18:58:17.536734] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T18:58:17.547114] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-13T18:58:17.547255] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-13T18:58:17.552496] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-13T18:58:17.571262] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-13T18:58:17.582252] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLOC took 1.6s. Estimated remaining: 3h 33m 8s. Rate: 7.2 symbols/min [2025-10-13T18:58:17.693497] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:17.734092] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-13T18:58:17.739940] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-13T18:58:17.750774] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-13T18:58:17.750861] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-13T18:58:17.897428] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:18.023354] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-13T18:58:18.213068] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:18.214300] [DEBUG] [LOCAL ] FLS: Loaded 51020 existing records from primary storage. [2025-10-13T18:58:18.215023] [INFO ] [MAIN ] FLS: Loaded 51020 existing records. [2025-10-13T18:58:18.379998] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-13T18:58:18.416795] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:18.417112] [INFO ] [REMOTE ] FLG: Full fetch complete (77280 records). [2025-10-13T18:58:18.417433] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-13T18:58:18.417532] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-13T18:58:18.417636] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-13T18:58:18.451122] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-13T18:58:18.484290] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-13T18:58:18.824268] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-13T18:58:19.169391] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-13T18:58:19.182467] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-13T18:58:19.204435] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-13T18:58:19.204565] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-13T18:58:19.225772] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:19.226931] [DEBUG] [LOCAL ] FLG: Trimmed 77280 records to 53323 (keeping 200 days of data) [2025-10-13T18:58:19.560491] [DEBUG] [LOCAL ] FLG: Primary data saved (53323 records). [2025-10-13T18:58:19.560677] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-13T18:58:19.560792] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLG took 37.6s. Estimated remaining: 3h 32m 48s. Rate: 7.2 symbols/min [2025-10-13T18:58:19.627284] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-13T18:58:19.775869] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:19.804393] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T18:58:19.856853] [DEBUG] [LOCAL ] FLUT: Loaded 51543 existing records from primary storage. [2025-10-13T18:58:19.857162] [INFO ] [MAIN ] FLUT: Loaded 51543 existing records. [2025-10-13T18:58:20.033629] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:20.033835] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-13T18:58:20.033881] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-13T18:58:20.034939] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-13T18:58:20.034999] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-13T18:58:20.391188] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:20.417885] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-13T18:58:20.665043] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T18:58:21.217939] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-13T18:58:21.303028] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T18:58:22.017933] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-13T18:58:22.198746] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T18:58:22.761937] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T18:58:22.817881] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-13T18:58:23.167495] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T18:58:23.617956] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-13T18:58:24.417928] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-13T18:58:24.572778] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T18:58:25.217944] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-13T18:58:25.283352] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T18:58:26.017955] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-13T18:58:26.051602] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T18:58:26.818011] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-13T18:58:26.865910] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T18:58:27.618039] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-13T18:58:27.689478] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T18:58:28.417983] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-13T18:58:28.608229] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T18:58:29.027889] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:58:29.217998] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-13T18:58:30.017938] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-13T18:58:30.269876] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T18:58:30.818018] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-13T18:58:30.873384] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T18:58:31.617943] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-13T18:58:31.707041] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T18:58:32.417947] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-13T18:58:32.778807] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T18:58:33.041253] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T18:58:33.217975] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-13T18:58:34.018046] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-13T18:58:34.178934] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T18:58:34.817894] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-13T18:58:34.971548] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T18:58:35.311615] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T18:58:35.617991] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-13T18:58:36.417939] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-13T18:58:36.463980] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T18:58:37.217940] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-13T18:58:37.422630] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T18:58:38.020999] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-13T18:58:38.280700] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T18:58:38.563011] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T18:58:38.818015] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-13T18:58:39.406697] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T18:58:39.617895] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-13T18:58:40.417938] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-13T18:58:40.700585] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T18:58:41.096468] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T18:58:41.217993] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-13T18:58:42.017929] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-13T18:58:42.112908] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T18:58:42.614965] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T18:58:42.817957] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-13T18:58:43.617921] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-13T18:58:43.842851] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T18:58:44.336268] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T18:58:44.417895] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-13T18:58:45.217945] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-13T18:58:45.407231] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:58:46.017956] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-13T18:58:46.396117] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T18:58:46.554109] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T18:58:46.560387] [INFO ] [REMOTE ] FLO: Full fetch complete (75081 records). [2025-10-13T18:58:46.560626] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-13T18:58:46.824853] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-13T18:58:46.971485] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-13T18:58:46.971726] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-13T18:58:46.972962] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-13T18:58:46.973029] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-13T18:58:46.974825] [DEBUG] [LOCAL ] FLO: Trimmed 75081 records to 52028 (keeping 200 days of data) [2025-10-13T18:58:47.291516] [DEBUG] [LOCAL ] FLO: Primary data saved (52028 records). [2025-10-13T18:58:47.291677] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-13T18:58:47.291777] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLO took 32.8s. Estimated remaining: 3h 33m 14s. Rate: 7.1 symbols/min [2025-10-13T18:58:47.458763] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:47.479842] [DEBUG] [LOCAL ] FLXR: Loaded 21118 existing records from primary storage. [2025-10-13T18:58:47.480087] [INFO ] [MAIN ] FLXR: Loaded 21118 existing records. [2025-10-13T18:58:47.628104] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-13T18:58:47.661182] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:47.661750] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-13T18:58:47.661802] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-13T18:58:47.662108] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-13T18:58:47.662164] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-13T18:58:48.043330] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:48.076423] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T18:58:48.418017] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-13T18:58:48.615390] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T18:58:49.218016] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-13T18:58:49.683380] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-13T18:58:49.889852] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T18:58:49.895292] [INFO ] [REMOTE ] FLUT: Full fetch complete (73054 records). [2025-10-13T18:58:49.895405] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-13T18:58:50.032612] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-13T18:58:50.280015] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-13T18:58:50.280103] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-13T18:58:50.280980] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-13T18:58:50.281044] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-13T18:58:50.282441] [DEBUG] [LOCAL ] FLUT: Trimmed 73054 records to 50771 (keeping 200 days of data) [2025-10-13T18:58:50.582664] [DEBUG] [LOCAL ] FLUT: Primary data saved (50771 records). [2025-10-13T18:58:50.582817] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-13T18:58:50.582901] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLUT took 31.0s. Estimated remaining: 3h 32m 57s. Rate: 7.1 symbols/min [2025-10-13T18:58:50.752493] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:50.801584] [DEBUG] [LOCAL ] FMC: Loaded 52580 existing records from primary storage. [2025-10-13T18:58:50.801974] [INFO ] [MAIN ] FMC: Loaded 52580 existing records. [2025-10-13T18:58:50.825054] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-13T18:58:50.912821] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T18:58:50.993443] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:50.993757] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-13T18:58:50.993813] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-13T18:58:50.994173] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-13T18:58:50.994229] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-13T18:58:51.124369] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-13T18:58:51.381706] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:51.617927] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-13T18:58:52.417961] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-13T18:58:52.681627] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T18:58:52.944952] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T18:58:53.157804] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T18:58:53.217949] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-13T18:58:54.017950] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-13T18:58:54.052965] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T18:58:54.817948] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-13T18:58:55.617935] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-13T18:58:55.767163] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T18:58:55.866127] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-13T18:58:55.871943] [INFO ] [REMOTE ] FLR: Full fetch complete (76532 records). [2025-10-13T18:58:55.872118] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-13T18:58:56.279135] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-13T18:58:56.279211] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-13T18:58:56.280093] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-13T18:58:56.280161] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-13T18:58:56.281529] [DEBUG] [LOCAL ] FLR: Trimmed 76532 records to 53204 (keeping 200 days of data) [2025-10-13T18:58:56.441554] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-13T18:58:56.587229] [DEBUG] [LOCAL ] FLR: Primary data saved (53204 records). [2025-10-13T18:58:56.587363] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-13T18:58:56.587442] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLR took 39.4s. Estimated remaining: 3h 32m 44s. Rate: 7.1 symbols/min [2025-10-13T18:58:56.753852] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:56.760271] [DEBUG] [LOCAL ] FMN: Loaded 5439 existing records from primary storage. [2025-10-13T18:58:56.760431] [INFO ] [MAIN ] FMN: Loaded 5439 existing records. [2025-10-13T18:58:56.938379] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:56.938607] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-13T18:58:56.938685] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-13T18:58:56.938988] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-13T18:58:56.939046] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-13T18:58:57.219915] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-13T18:58:57.310353] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:57.391449] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T18:58:57.899112] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T18:58:57.905150] [INFO ] [REMOTE ] FLS: Full fetch complete (72006 records). [2025-10-13T18:58:57.905268] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-13T18:58:58.020956] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-13T18:58:58.195612] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-13T18:58:58.325709] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-13T18:58:58.325820] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-13T18:58:58.326795] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-13T18:58:58.326860] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-13T18:58:58.328548] [DEBUG] [LOCAL ] FLS: Trimmed 72006 records to 50339 (keeping 200 days of data) [2025-10-13T18:58:58.643696] [DEBUG] [LOCAL ] FLS: Primary data saved (50339 records). [2025-10-13T18:58:58.643835] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-13T18:58:58.643941] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FLS took 41.1s. Estimated remaining: 3h 32m 24s. Rate: 7.2 symbols/min [2025-10-13T18:58:58.813240] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:58:58.817998] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-13T18:58:58.844364] [DEBUG] [LOCAL ] FMS: Loaded 30508 existing records from primary storage. [2025-10-13T18:58:58.844665] [INFO ] [MAIN ] FMS: Loaded 30508 existing records. [2025-10-13T18:58:59.015961] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:58:59.016203] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-13T18:58:59.016250] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-13T18:58:59.016691] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-13T18:58:59.016748] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-13T18:58:59.364956] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:58:59.623083] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-13T18:58:59.644507] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T18:58:59.827272] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T18:59:00.417959] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-13T18:59:01.217960] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-13T18:59:01.260366] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T18:59:01.945548] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:59:02.017941] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-13T18:59:02.214338] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T18:59:02.818051] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-13T18:59:03.617925] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-13T18:59:03.832277] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-13T18:59:04.002328] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T18:59:04.284004] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T18:59:04.417939] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-13T18:59:05.217945] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-13T18:59:05.592336] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T18:59:05.745906] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-13T18:59:06.017992] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-13T18:59:06.817897] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-13T18:59:07.099589] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T18:59:07.617984] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-13T18:59:07.970635] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T18:59:08.157325] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T18:59:08.417939] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-13T18:59:09.217963] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-13T18:59:09.988415] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T18:59:10.017888] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-13T18:59:10.073856] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T18:59:10.758334] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T18:59:10.817895] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-13T18:59:11.617918] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-13T18:59:12.218190] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T18:59:12.417982] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-13T18:59:12.537571] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T18:59:13.217992] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-13T18:59:13.947008] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T18:59:13.947751] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T18:59:14.017891] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-13T18:59:14.643843] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T18:59:14.817936] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-13T18:59:15.617944] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-13T18:59:16.024007] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-13T18:59:16.238548] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T18:59:16.417956] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-13T18:59:16.937195] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-13T18:59:17.217982] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-13T18:59:17.958158] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T18:59:17.959741] [INFO ] [REMOTE ] FMN: Full fetch complete (10054 records). [2025-10-13T18:59:17.959834] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-13T18:59:18.025017] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-13T18:59:18.340882] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-13T18:59:18.340969] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-13T18:59:18.341231] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-13T18:59:18.341271] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-13T18:59:18.341706] [DEBUG] [LOCAL ] FMN: Trimmed 10054 records to 5362 (keeping 200 days of data) [2025-10-13T18:59:18.373613] [DEBUG] [LOCAL ] FMN: Primary data saved (5362 records). [2025-10-13T18:59:18.373731] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-13T18:59:18.373817] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMN took 21.8s. Estimated remaining: 3h 32m 36s. Rate: 7.1 symbols/min [2025-10-13T18:59:18.548192] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:18.592525] [DEBUG] [LOCAL ] FMX: Loaded 41027 existing records from primary storage. [2025-10-13T18:59:18.592957] [INFO ] [MAIN ] FMX: Loaded 41027 existing records. [2025-10-13T18:59:18.775659] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:18.775966] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-13T18:59:18.776020] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-13T18:59:18.777064] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-13T18:59:18.777126] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-13T18:59:18.825081] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-13T18:59:19.156503] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:19.617983] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-13T18:59:19.992997] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T18:59:20.030094] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T18:59:20.418021] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-13T18:59:21.009386] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T18:59:21.217990] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-13T18:59:22.018017] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-13T18:59:22.109557] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T18:59:22.654398] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T18:59:22.817986] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-13T18:59:23.427475] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T18:59:23.617965] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-13T18:59:24.131745] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T18:59:24.417998] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-13T18:59:25.217987] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-13T18:59:25.405803] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T18:59:25.636102] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T18:59:26.018002] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-13T18:59:26.445943] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T18:59:26.817976] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-13T18:59:27.377612] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T18:59:27.617955] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-13T18:59:27.947266] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-13T18:59:28.418015] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-13T18:59:28.706010] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-13T18:59:29.218006] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-13T18:59:29.573967] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T18:59:29.577230] [INFO ] [REMOTE ] FLXR: Full fetch complete (26512 records). [2025-10-13T18:59:29.577317] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-13T18:59:29.969974] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-13T18:59:29.970078] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-13T18:59:29.970661] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-13T18:59:29.970725] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-13T18:59:29.971405] [DEBUG] [LOCAL ] FLXR: Trimmed 26512 records to 20860 (keeping 200 days of data) [2025-10-13T18:59:30.026096] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-13T18:59:30.107627] [DEBUG] [LOCAL ] FLXR: Primary data saved (20860 records). [2025-10-13T18:59:30.107797] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-13T18:59:30.107957] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FLXR took 42.8s. Estimated remaining: 3h 32m 34s. Rate: 7.1 symbols/min [2025-10-13T18:59:30.288185] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:30.292543] [DEBUG] [LOCAL ] FMY: Loaded 1408 existing records from primary storage. [2025-10-13T18:59:30.292782] [INFO ] [MAIN ] FMY: Loaded 1408 existing records. [2025-10-13T18:59:30.475979] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:30.476345] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-13T18:59:30.476397] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-13T18:59:30.476553] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-13T18:59:30.476623] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-13T18:59:30.626823] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T18:59:30.679474] [INFO ] [REMOTE ] FMS: Full fetch complete (42365 records). [2025-10-13T18:59:30.745209] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-13T18:59:30.823860] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-13T18:59:30.981799] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:31.272679] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-13T18:59:31.272789] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-13T18:59:31.273672] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-13T18:59:31.273736] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-13T18:59:31.274989] [DEBUG] [LOCAL ] FMS: Trimmed 42365 records to 30169 (keeping 200 days of data) [2025-10-13T18:59:31.472329] [DEBUG] [LOCAL ] FMS: Primary data saved (30169 records). [2025-10-13T18:59:31.472506] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-13T18:59:31.473416] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMS took 32.8s. Estimated remaining: 3h 32m 13s. Rate: 7.1 symbols/min [2025-10-13T18:59:31.618072] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-13T18:59:31.651270] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:31.673508] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T18:59:31.681195] [INFO ] [REMOTE ] FMC: Full fetch complete (75156 records). [2025-10-13T18:59:31.681482] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-13T18:59:31.895423] [DEBUG] [LOCAL ] FN: Loaded 38595 existing records from primary storage. [2025-10-13T18:59:31.948523] [INFO ] [MAIN ] FN: Loaded 38595 existing records. [2025-10-13T18:59:32.046712] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-13T18:59:32.338113] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-13T18:59:32.362626] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:32.363398] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-13T18:59:32.365030] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-13T18:59:32.365297] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-13T18:59:32.365176] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-13T18:59:32.365567] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-13T18:59:32.367746] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-13T18:59:32.367830] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-13T18:59:32.401357] [DEBUG] [LOCAL ] FMC: Trimmed 75156 records to 51819 (keeping 200 days of data) [2025-10-13T18:59:32.426998] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-13T18:59:33.006004] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-13T18:59:33.003538] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:33.037073] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T18:59:33.169796] [DEBUG] [LOCAL ] FMC: Primary data saved (51819 records). [2025-10-13T18:59:33.170037] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-13T18:59:33.170172] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMC took 42.6s. Estimated remaining: 3h 31m 53s. Rate: 7.2 symbols/min [2025-10-13T18:59:33.225142] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-13T18:59:33.349744] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:33.404493] [DEBUG] [LOCAL ] FNB: Loaded 53309 existing records from primary storage. [2025-10-13T18:59:33.404953] [INFO ] [MAIN ] FNB: Loaded 53309 existing records. [2025-10-13T18:59:33.585748] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:33.586053] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-13T18:59:33.586119] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-13T18:59:33.587618] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-13T18:59:33.587730] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-13T18:59:33.978220] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:34.017886] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-13T18:59:34.804888] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-13T18:59:34.817933] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-13T18:59:35.623212] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-13T18:59:35.635496] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T18:59:36.240828] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T18:59:36.418003] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-13T18:59:36.867612] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T18:59:37.015404] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T18:59:37.217955] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-13T18:59:38.017946] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-13T18:59:38.754565] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T18:59:38.817929] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-13T18:59:39.520866] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T18:59:39.617978] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-13T18:59:39.991163] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T18:59:40.396238] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:59:40.417896] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-13T18:59:41.218010] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-13T18:59:41.711957] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T18:59:42.017928] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-13T18:59:42.156436] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T18:59:42.360745] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-13T18:59:42.817973] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-13T18:59:43.617972] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-13T18:59:44.392715] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T18:59:44.417890] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-13T18:59:45.217897] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-13T18:59:45.400097] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T18:59:45.502704] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-13T18:59:46.017934] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-13T18:59:46.072775] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T18:59:46.817972] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-13T18:59:47.602506] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T18:59:47.617876] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-13T18:59:48.170465] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T18:59:48.417952] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-13T18:59:48.840109] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-13T18:59:49.089476] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T18:59:49.217946] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-13T18:59:49.671242] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-13T18:59:50.017925] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-13T18:59:50.453811] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-13T18:59:50.817974] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-13T18:59:51.617973] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-13T18:59:52.417979] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-13T18:59:52.505288] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T18:59:52.811808] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-13T18:59:52.812490] [INFO ] [REMOTE ] FMY: Full fetch complete (1969 records). [2025-10-13T18:59:52.812557] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-13T18:59:53.170238] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-13T18:59:53.170409] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-13T18:59:53.170516] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-13T18:59:53.170554] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-13T18:59:53.170903] [DEBUG] [LOCAL ] FMY: Trimmed 1969 records to 1389 (keeping 200 days of data) [2025-10-13T18:59:53.179714] [DEBUG] [LOCAL ] FMY: Primary data saved (1389 records). [2025-10-13T18:59:53.179775] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-13T18:59:53.179880] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FMY took 23.1s. Estimated remaining: 3h 32m 5s. Rate: 7.1 symbols/min [2025-10-13T18:59:53.221801] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-13T18:59:53.352701] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:53.384878] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T18:59:53.445897] [DEBUG] [LOCAL ] FND: Loaded 52882 existing records from primary storage. [2025-10-13T18:59:53.446256] [INFO ] [MAIN ] FND: Loaded 52882 existing records. [2025-10-13T18:59:53.621910] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:53.622130] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-13T18:59:53.622205] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-13T18:59:53.623247] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-13T18:59:53.623304] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-13T18:59:53.962191] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:54.017885] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-13T18:59:54.675325] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T18:59:54.679023] [INFO ] [REMOTE ] FMX: Full fetch complete (57468 records). [2025-10-13T18:59:54.679114] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-13T18:59:54.826054] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-13T18:59:55.058282] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-13T18:59:55.058364] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-13T18:59:55.059141] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-13T18:59:55.059202] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-13T18:59:55.060922] [DEBUG] [LOCAL ] FMX: Trimmed 57468 records to 40458 (keeping 200 days of data) [2025-10-13T18:59:55.309485] [DEBUG] [LOCAL ] FMX: Primary data saved (40458 records). [2025-10-13T18:59:55.309634] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-13T18:59:55.309758] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FMX took 36.9s. Estimated remaining: 3h 31m 45s. Rate: 7.1 symbols/min [2025-10-13T18:59:55.494821] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T18:59:55.547965] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T18:59:55.573507] [DEBUG] [LOCAL ] FNF: Loaded 49668 existing records from primary storage. [2025-10-13T18:59:55.573811] [INFO ] [MAIN ] FNF: Loaded 49668 existing records. [2025-10-13T18:59:55.627860] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-13T18:59:55.754389] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T18:59:55.754610] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-13T18:59:55.754683] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-13T18:59:55.755125] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-13T18:59:55.755181] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-13T18:59:56.108428] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T18:59:56.417959] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-13T18:59:56.473359] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T18:59:57.086055] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T18:59:57.217990] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-13T18:59:57.931319] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T18:59:58.018002] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-13T18:59:58.746370] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T18:59:58.817922] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-13T18:59:59.592395] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T18:59:59.617886] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-13T19:00:00.174305] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:00:00.417959] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-13T19:00:01.218019] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-13T19:00:01.591990] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T19:00:02.022999] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-13T19:00:02.039998] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:00:02.653436] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T19:00:02.817948] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-13T19:00:03.617897] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-13T19:00:03.918777] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:00:04.418002] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-13T19:00:05.042509] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-13T19:00:05.217969] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-13T19:00:05.303884] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T19:00:06.017939] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-13T19:00:06.310514] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T19:00:06.817936] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-13T19:00:07.013713] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T19:00:07.617929] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-13T19:00:07.777606] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:00:07.906903] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T19:00:08.417947] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-13T19:00:09.217936] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-13T19:00:09.266061] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:00:10.017943] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-13T19:00:10.061436] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T19:00:10.817974] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-13T19:00:11.004191] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T19:00:11.617952] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-13T19:00:11.756753] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T19:00:11.951753] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T19:00:12.417962] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-13T19:00:13.217999] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-13T19:00:13.333311] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T19:00:13.850061] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:00:13.855773] [INFO ] [REMOTE ] FNB: Full fetch complete (75905 records). [2025-10-13T19:00:13.855947] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-13T19:00:14.032978] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-13T19:00:14.277934] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-13T19:00:14.278047] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-13T19:00:14.279091] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-13T19:00:14.279155] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-13T19:00:14.280682] [DEBUG] [LOCAL ] FNB: Trimmed 75905 records to 52572 (keeping 200 days of data) [2025-10-13T19:00:14.634473] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T19:00:14.667664] [DEBUG] [LOCAL ] FNB: Primary data saved (52572 records). [2025-10-13T19:00:14.667845] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-13T19:00:14.667952] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNB took 41.5s. Estimated remaining: 3h 31m 56s. Rate: 7.1 symbols/min [2025-10-13T19:00:14.834181] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-13T19:00:14.836900] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:14.880235] [DEBUG] [LOCAL ] FNV: Loaded 46876 existing records from primary storage. [2025-10-13T19:00:14.880566] [INFO ] [MAIN ] FNV: Loaded 46876 existing records. [2025-10-13T19:00:15.052199] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:15.052421] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-13T19:00:15.052467] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-13T19:00:15.053461] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-13T19:00:15.053519] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-13T19:00:15.400718] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:15.537596] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T19:00:15.541110] [INFO ] [REMOTE ] FN: Full fetch complete (55998 records). [2025-10-13T19:00:15.541206] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-13T19:00:15.623199] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-13T19:00:15.921948] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-13T19:00:15.922042] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-13T19:00:15.922882] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-13T19:00:15.922952] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-13T19:00:15.924186] [DEBUG] [LOCAL ] FN: Trimmed 55998 records to 37947 (keeping 200 days of data) [2025-10-13T19:00:16.148355] [DEBUG] [LOCAL ] FN: Primary data saved (37947 records). [2025-10-13T19:00:16.148503] [INFO ] [MAIN ] FN: Full history saved. [2025-10-13T19:00:16.149065] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FN took 44.7s. Estimated remaining: 3h 31m 36s. Rate: 7.1 symbols/min [2025-10-13T19:00:16.317680] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:16.333599] [DEBUG] [LOCAL ] FOA: Loaded 13275 existing records from primary storage. [2025-10-13T19:00:16.333863] [INFO ] [MAIN ] FOA: Loaded 13275 existing records. [2025-10-13T19:00:16.423173] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-13T19:00:16.513059] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:16.513429] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-13T19:00:16.513496] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-13T19:00:16.513720] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-13T19:00:16.513786] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-13T19:00:16.667587] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T19:00:16.925566] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:16.960936] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T19:00:17.217978] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-13T19:00:18.024458] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-13T19:00:18.029576] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:00:18.817934] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-13T19:00:18.905112] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T19:00:18.910530] [INFO ] [REMOTE ] FND: Full fetch complete (74771 records). [2025-10-13T19:00:18.910696] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-13T19:00:19.230408] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T19:00:19.327996] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-13T19:00:19.328105] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-13T19:00:19.329105] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-13T19:00:19.329193] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-13T19:00:19.330872] [DEBUG] [LOCAL ] FND: Trimmed 74771 records to 52147 (keeping 200 days of data) [2025-10-13T19:00:19.617947] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-13T19:00:19.640874] [DEBUG] [LOCAL ] FND: Primary data saved (52147 records). [2025-10-13T19:00:19.641007] [INFO ] [MAIN ] FND: Full history saved. [2025-10-13T19:00:19.641088] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FND took 26.5s. Estimated remaining: 3h 31m 19s. Rate: 7.2 symbols/min [2025-10-13T19:00:19.811550] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:19.821317] [DEBUG] [LOCAL ] FOF: Loaded 8672 existing records from primary storage. [2025-10-13T19:00:19.821574] [INFO ] [MAIN ] FOF: Loaded 8672 existing records. [2025-10-13T19:00:19.993878] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:19.994139] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-13T19:00:19.994200] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-13T19:00:19.994372] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-13T19:00:19.994456] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-13T19:00:20.374751] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:20.417954] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-13T19:00:20.574476] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T19:00:20.685993] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T19:00:21.134836] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T19:00:21.217942] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-13T19:00:22.017942] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-13T19:00:22.119366] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T19:00:22.728019] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T19:00:22.817992] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-13T19:00:23.617965] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-13T19:00:24.417925] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-13T19:00:24.454157] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-13T19:00:24.835417] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T19:00:25.051669] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T19:00:25.217948] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-13T19:00:26.017956] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-13T19:00:26.745196] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:00:26.817896] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-13T19:00:27.617948] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-13T19:00:27.702233] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T19:00:28.247892] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T19:00:28.417930] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-13T19:00:28.574789] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T19:00:29.065632] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-13T19:00:29.217936] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-13T19:00:30.017940] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-13T19:00:30.801381] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T19:00:30.806598] [INFO ] [REMOTE ] FNF: Full fetch complete (69691 records). [2025-10-13T19:00:30.806827] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-13T19:00:30.823123] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-13T19:00:31.197809] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-13T19:00:31.197896] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-13T19:00:31.198807] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-13T19:00:31.198870] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-13T19:00:31.200247] [DEBUG] [LOCAL ] FNF: Trimmed 69691 records to 48986 (keeping 200 days of data) [2025-10-13T19:00:31.496114] [DEBUG] [LOCAL ] FNF: Primary data saved (48986 records). [2025-10-13T19:00:31.496276] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-13T19:00:31.496356] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FNF took 36.2s. Estimated remaining: 3h 31m 16s. Rate: 7.1 symbols/min [2025-10-13T19:00:31.622513] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-13T19:00:31.668907] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:31.698020] [DEBUG] [LOCAL ] FOR: Loaded 19970 existing records from primary storage. [2025-10-13T19:00:31.699057] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T19:00:31.699598] [INFO ] [MAIN ] FOR: Loaded 19970 existing records. [2025-10-13T19:00:31.883744] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:31.884170] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-13T19:00:31.884364] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-13T19:00:31.884623] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-13T19:00:31.884723] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-13T19:00:32.282195] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:32.286489] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-13T19:00:32.314357] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T19:00:32.417966] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-13T19:00:32.975874] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T19:00:33.217935] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-13T19:00:34.017973] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-13T19:00:34.277622] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T19:00:34.808117] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T19:00:34.817873] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-13T19:00:35.580029] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T19:00:35.617993] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-13T19:00:36.417971] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-13T19:00:37.217944] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-13T19:00:37.505638] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-13T19:00:37.541935] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T19:00:38.012522] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T19:00:38.017876] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-13T19:00:38.817894] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-13T19:00:39.022136] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T19:00:39.617956] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-13T19:00:40.240341] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:00:40.417960] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-13T19:00:40.519134] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-13T19:00:41.217965] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-13T19:00:42.017951] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-13T19:00:42.064892] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:00:42.353392] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T19:00:42.820768] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T19:00:42.818771] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-13T19:00:43.617931] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-13T19:00:43.856818] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T19:00:44.417951] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-13T19:00:45.192491] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T19:00:45.219713] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-13T19:00:45.222895] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T19:00:46.017936] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-13T19:00:46.192679] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T19:00:46.732441] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T19:00:46.817928] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-13T19:00:47.617992] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-13T19:00:47.885633] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T19:00:48.417895] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-13T19:00:48.732369] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T19:00:49.225047] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-13T19:00:49.227976] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:00:50.018004] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-13T19:00:50.817990] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-13T19:00:50.875094] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T19:00:51.007255] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T19:00:51.570899] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-13T19:00:51.617939] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-13T19:00:52.417936] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-13T19:00:52.633172] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T19:00:52.635327] [INFO ] [REMOTE ] FOR: Full fetch complete (29765 records). [2025-10-13T19:00:52.635397] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-13T19:00:52.992590] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-13T19:00:52.992693] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-13T19:00:52.993191] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-13T19:00:52.993282] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-13T19:00:52.994009] [DEBUG] [LOCAL ] FOR: Trimmed 29765 records to 19785 (keeping 200 days of data) [2025-10-13T19:00:53.104054] [DEBUG] [LOCAL ] FOR: Primary data saved (19785 records). [2025-10-13T19:00:53.104191] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-13T19:00:53.104265] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOR took 21.6s. Estimated remaining: 3h 31m 31s. Rate: 7.1 symbols/min [2025-10-13T19:00:53.223108] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-13T19:00:53.277476] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:53.322445] [DEBUG] [LOCAL ] FOUR: Loaded 50337 existing records from primary storage. [2025-10-13T19:00:53.322820] [INFO ] [MAIN ] FOUR: Loaded 50337 existing records. [2025-10-13T19:00:53.494385] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:53.494616] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-13T19:00:53.494707] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-13T19:00:53.495210] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-13T19:00:53.495269] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-13T19:00:53.843871] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:54.017897] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-13T19:00:54.056167] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-13T19:00:54.073747] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T19:00:54.078971] [INFO ] [REMOTE ] FNV: Full fetch complete (66506 records). [2025-10-13T19:00:54.079125] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-13T19:00:54.476256] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-13T19:00:54.476345] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-13T19:00:54.477211] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-13T19:00:54.477275] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-13T19:00:54.478639] [DEBUG] [LOCAL ] FNV: Trimmed 66506 records to 46111 (keeping 200 days of data) [2025-10-13T19:00:54.765906] [DEBUG] [LOCAL ] FNV: Primary data saved (46111 records). [2025-10-13T19:00:54.766047] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-13T19:00:54.766137] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FNV took 40.1s. Estimated remaining: 3h 31m 11s. Rate: 7.1 symbols/min [2025-10-13T19:00:54.828243] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-13T19:00:54.935509] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:54.958456] [DEBUG] [LOCAL ] FPF: Loaded 18898 existing records from primary storage. [2025-10-13T19:00:54.958740] [INFO ] [MAIN ] FPF: Loaded 18898 existing records. [2025-10-13T19:00:55.134108] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:55.134311] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-13T19:00:55.134356] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-13T19:00:55.134622] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-13T19:00:55.134705] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-13T19:00:55.481430] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:55.617962] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-13T19:00:55.650865] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:00:55.652381] [INFO ] [REMOTE ] FOF: Full fetch complete (11889 records). [2025-10-13T19:00:55.652452] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-13T19:00:56.035543] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-13T19:00:56.035704] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-13T19:00:56.036005] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-13T19:00:56.036146] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-13T19:00:56.046300] [DEBUG] [LOCAL ] FOF: Trimmed 11889 records to 8585 (keeping 200 days of data) [2025-10-13T19:00:56.104806] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T19:00:56.130216] [DEBUG] [LOCAL ] FOF: Primary data saved (8585 records). [2025-10-13T19:00:56.130367] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-13T19:00:56.130453] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FOF took 36.5s. Estimated remaining: 3h 30m 50s. Rate: 7.1 symbols/min [2025-10-13T19:00:56.305911] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:56.324862] [DEBUG] [LOCAL ] FPH: Loaded 19617 existing records from primary storage. [2025-10-13T19:00:56.325154] [INFO ] [MAIN ] FPH: Loaded 19617 existing records. [2025-10-13T19:00:56.420508] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-13T19:00:56.516067] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:56.516252] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-13T19:00:56.516299] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-13T19:00:56.516560] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-13T19:00:56.516599] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-13T19:00:56.658535] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T19:00:56.693820] [INFO ] [REMOTE ] FOA: Full fetch complete (21924 records). [2025-10-13T19:00:56.711041] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-13T19:00:57.077070] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:57.232136] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-13T19:00:57.284908] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-13T19:00:57.285005] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-13T19:00:57.285711] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-13T19:00:57.285776] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-13T19:00:57.286440] [DEBUG] [LOCAL ] FOA: Trimmed 21924 records to 13120 (keeping 200 days of data) [2025-10-13T19:00:57.366358] [DEBUG] [LOCAL ] FOA: Primary data saved (13120 records). [2025-10-13T19:00:57.366525] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-13T19:00:57.366618] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FOA took 41.2s. Estimated remaining: 3h 30m 29s. Rate: 7.2 symbols/min [2025-10-13T19:00:57.544571] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:00:57.559313] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T19:00:57.595723] [DEBUG] [LOCAL ] FPI: Loaded 31503 existing records from primary storage. [2025-10-13T19:00:57.596043] [INFO ] [MAIN ] FPI: Loaded 31503 existing records. [2025-10-13T19:00:57.771331] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:00:57.771596] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-13T19:00:57.771667] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-13T19:00:57.772075] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-13T19:00:57.772132] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-13T19:00:58.023091] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-13T19:00:58.122905] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:00:58.297268] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T19:00:58.817953] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-13T19:00:59.617899] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-13T19:00:59.667139] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:00:59.778750] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T19:01:00.417954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-13T19:01:00.972505] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T19:01:01.217934] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-13T19:01:02.018015] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-13T19:01:02.216394] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T19:01:02.629002] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T19:01:02.817978] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-13T19:01:02.997076] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T19:01:03.617989] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-13T19:01:03.783489] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T19:01:04.417994] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-13T19:01:04.554975] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T19:01:05.217934] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-13T19:01:06.017892] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-13T19:01:06.130186] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T19:01:06.155103] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-13T19:01:06.817942] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-13T19:01:07.067717] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T19:01:07.617938] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-13T19:01:08.194132] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T19:01:08.417930] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-13T19:01:08.758907] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-13T19:01:09.217896] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-13T19:01:09.434034] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T19:01:10.017951] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-13T19:01:10.817927] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-13T19:01:10.910375] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:01:11.018764] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T19:01:11.617966] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-13T19:01:11.981776] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T19:01:12.417989] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-13T19:01:12.748635] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-13T19:01:13.217954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-13T19:01:13.928686] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T19:01:14.017995] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-13T19:01:14.574701] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T19:01:14.818058] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-13T19:01:14.999682] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T19:01:15.617992] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-13T19:01:15.995750] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T19:01:16.418010] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-13T19:01:17.218030] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-13T19:01:17.371937] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:01:17.820994] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T19:01:18.017895] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-13T19:01:18.173734] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:01:18.817925] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-13T19:01:19.456724] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T19:01:19.617945] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-13T19:01:19.768750] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T19:01:20.417941] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-13T19:01:21.218002] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-13T19:01:21.333474] [DEBUG] [REMOTE ] FPI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-13T19:01:21.333907] [WARN ] [REMOTE ] FPI: No data returned for month 2025-09 [2025-10-13T19:01:21.334044] [FATAL] [REMOTE ] FPI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:01:21.334147] [FATAL] [MAIN ] FPI: Failed to fetch primary data. [2025-10-13T19:01:21.334188] [WARN ] [MAIN ] FPI: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:01:21.334227] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-13T19:01:21.334285] [DEBUG] [LOCAL ] FPI: No primary data file found to delete. [2025-10-13T19:01:21.334321] [INFO ] [LOCAL ] FPI: Starting deletion of derivative data. [2025-10-13T19:01:21.334663] [DEBUG] [LOCAL ] FPI: Deleted derivative data file. [2025-10-13T19:01:21.335689] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FPI took 24.0s. Estimated remaining: 3h 30m 48s. Rate: 7.1 symbols/min [2025-10-13T19:01:21.582564] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:21.598115] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T19:01:21.638625] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-13T19:01:21.692868] [DEBUG] [LOCAL ] FR: Loaded 47016 existing records from primary storage. [2025-10-13T19:01:21.693225] [INFO ] [MAIN ] FR: Loaded 47016 existing records. [2025-10-13T19:01:21.900501] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:21.900785] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-13T19:01:21.900845] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-13T19:01:21.901482] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-13T19:01:21.901540] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-13T19:01:22.019477] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-13T19:01:22.277267] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:22.817896] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-13T19:01:23.212478] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T19:01:23.617988] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-13T19:01:23.684744] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-13T19:01:24.417951] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-13T19:01:25.149113] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-13T19:01:25.217897] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-13T19:01:25.418737] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T19:01:26.017954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-13T19:01:26.817889] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-13T19:01:27.082015] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-13T19:01:27.617976] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-13T19:01:27.806484] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T19:01:27.855157] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T19:01:28.417976] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-13T19:01:28.689722] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T19:01:29.217944] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-13T19:01:30.017945] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-13T19:01:30.285225] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T19:01:30.290633] [INFO ] [REMOTE ] FOUR: Full fetch complete (72034 records). [2025-10-13T19:01:30.290804] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-13T19:01:30.681029] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-13T19:01:30.681259] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-13T19:01:30.682155] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-13T19:01:30.682232] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-13T19:01:30.686064] [DEBUG] [LOCAL ] FOUR: Trimmed 72034 records to 49672 (keeping 200 days of data) [2025-10-13T19:01:30.820344] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-13T19:01:30.823979] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T19:01:31.014088] [DEBUG] [LOCAL ] FOUR: Primary data saved (49672 records). [2025-10-13T19:01:31.014242] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-13T19:01:31.014374] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FOUR took 37.9s. Estimated remaining: 3h 30m 42s. Rate: 7.1 symbols/min [2025-10-13T19:01:31.121955] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T19:01:31.151569] [INFO ] [REMOTE ] FPH: Full fetch complete (31173 records). [2025-10-13T19:01:31.188356] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-13T19:01:31.197571] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:31.377925] [DEBUG] [LOCAL ] FRA: Loaded 14769 existing records from primary storage. [2025-10-13T19:01:31.398088] [INFO ] [MAIN ] FRA: Loaded 14769 existing records. [2025-10-13T19:01:31.628272] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-13T19:01:31.789215] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-13T19:01:31.789565] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-13T19:01:31.790159] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-13T19:01:31.790459] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-13T19:01:31.788794] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:31.790736] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-13T19:01:31.791003] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-13T19:01:31.791511] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-13T19:01:31.791479] [DEBUG] [LOCAL ] FPH: Trimmed 31173 records to 19370 (keeping 200 days of data) [2025-10-13T19:01:31.791666] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-13T19:01:32.064251] [DEBUG] [LOCAL ] FPH: Primary data saved (19370 records). [2025-10-13T19:01:32.090476] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-13T19:01:32.107786] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FPH took 36.0s. Estimated remaining: 3h 30m 21s. Rate: 7.1 symbols/min [2025-10-13T19:01:32.100692] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T19:01:32.419879] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-13T19:01:32.436771] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:32.449096] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:32.467446] [DEBUG] [LOCAL ] FRGE: Loaded 17061 existing records from primary storage. [2025-10-13T19:01:32.467716] [INFO ] [MAIN ] FRGE: Loaded 17061 existing records. [2025-10-13T19:01:32.639505] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:32.639776] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-13T19:01:32.639825] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-13T19:01:32.640092] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-13T19:01:32.640147] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-13T19:01:32.991636] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:33.217932] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-13T19:01:33.444600] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T19:01:33.486779] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:01:33.489409] [INFO ] [REMOTE ] FPF: Full fetch complete (26624 records). [2025-10-13T19:01:33.489480] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-13T19:01:33.850588] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-13T19:01:33.850752] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-13T19:01:33.851275] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-13T19:01:33.851473] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-13T19:01:33.867414] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T19:01:33.872776] [DEBUG] [LOCAL ] FPF: Trimmed 26624 records to 18766 (keeping 200 days of data) [2025-10-13T19:01:33.982920] [DEBUG] [LOCAL ] FPF: Primary data saved (18766 records). [2025-10-13T19:01:33.983069] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-13T19:01:33.983185] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FPF took 39.2s. Estimated remaining: 3h 30m 1s. Rate: 7.2 symbols/min [2025-10-13T19:01:34.023106] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-13T19:01:34.150387] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:34.204749] [DEBUG] [LOCAL ] FRO: Loaded 52446 existing records from primary storage. [2025-10-13T19:01:34.205118] [INFO ] [MAIN ] FRO: Loaded 52446 existing records. [2025-10-13T19:01:34.379639] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:34.379910] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-13T19:01:34.379956] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-13T19:01:34.380686] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-13T19:01:34.380743] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-13T19:01:34.723112] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:34.817883] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-13T19:01:35.602420] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T19:01:35.617884] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-13T19:01:36.414213] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:01:36.424225] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-13T19:01:37.103828] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T19:01:37.217886] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-13T19:01:37.725485] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:01:38.017996] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-13T19:01:38.547101] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T19:01:38.817983] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-13T19:01:39.617938] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-13T19:01:40.107133] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-13T19:01:40.204975] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T19:01:40.417973] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-13T19:01:40.627863] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T19:01:41.217984] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-13T19:01:41.281434] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:01:42.017969] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-13T19:01:42.189287] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T19:01:42.740502] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T19:01:42.817967] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-13T19:01:43.411496] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T19:01:43.617978] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-13T19:01:44.417953] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-13T19:01:44.579910] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T19:01:45.217987] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-13T19:01:45.589674] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T19:01:46.017942] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-13T19:01:46.788028] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T19:01:46.817901] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-13T19:01:47.009566] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T19:01:47.617962] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-13T19:01:48.417985] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-13T19:01:48.547531] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T19:01:48.582389] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T19:01:49.217931] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-13T19:01:49.302450] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T19:01:50.017980] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-13T19:01:50.142934] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T19:01:50.817954] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-13T19:01:51.587977] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T19:01:51.623086] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-13T19:01:51.647972] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T19:01:52.417992] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-13T19:01:52.523284] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T19:01:53.217999] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-13T19:01:54.017987] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-13T19:01:54.330293] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T19:01:54.332686] [INFO ] [REMOTE ] FRA: Full fetch complete (23783 records). [2025-10-13T19:01:54.332834] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-13T19:01:54.461429] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-13T19:01:54.744439] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-13T19:01:54.744523] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-13T19:01:54.745022] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-13T19:01:54.745084] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-13T19:01:54.745675] [DEBUG] [LOCAL ] FRA: Trimmed 23783 records to 14428 (keeping 200 days of data) [2025-10-13T19:01:54.819976] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-13T19:01:54.835586] [DEBUG] [LOCAL ] FRA: Primary data saved (14428 records). [2025-10-13T19:01:54.835776] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-13T19:01:54.835877] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRA took 23.8s. Estimated remaining: 3h 30m 14s. Rate: 7.1 symbols/min [2025-10-13T19:01:55.005792] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:55.044796] [DEBUG] [LOCAL ] FRT: Loaded 42422 existing records from primary storage. [2025-10-13T19:01:55.045081] [INFO ] [MAIN ] FRT: Loaded 42422 existing records. [2025-10-13T19:01:55.224176] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:55.224437] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-13T19:01:55.224494] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-13T19:01:55.225007] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-13T19:01:55.225064] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-13T19:01:55.589074] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:55.617888] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-13T19:01:55.669942] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T19:01:56.133722] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T19:01:56.139080] [INFO ] [REMOTE ] FR: Full fetch complete (66703 records). [2025-10-13T19:01:56.139209] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-13T19:01:56.422533] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-13T19:01:56.516279] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-13T19:01:56.516369] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-13T19:01:56.517193] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-13T19:01:56.517257] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-13T19:01:56.518578] [DEBUG] [LOCAL ] FR: Trimmed 66703 records to 46458 (keeping 200 days of data) [2025-10-13T19:01:56.812080] [DEBUG] [LOCAL ] FR: Primary data saved (46458 records). [2025-10-13T19:01:56.812222] [INFO ] [MAIN ] FR: Full history saved. [2025-10-13T19:01:56.812998] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FR took 35.5s. Estimated remaining: 3h 29m 55s. Rate: 7.1 symbols/min [2025-10-13T19:01:56.982332] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:01:57.021717] [DEBUG] [LOCAL ] FSCO: Loaded 38653 existing records from primary storage. [2025-10-13T19:01:57.022188] [INFO ] [MAIN ] FSCO: Loaded 38653 existing records. [2025-10-13T19:01:57.203463] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:01:57.203906] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-13T19:01:57.203983] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-13T19:01:57.204416] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-13T19:01:57.204476] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-13T19:01:57.234930] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-13T19:01:57.509545] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T19:01:57.594101] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:01:58.017954] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-13T19:01:58.247586] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-13T19:01:58.343368] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T19:01:58.817970] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-13T19:01:59.464950] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T19:01:59.617956] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-13T19:02:00.057730] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T19:02:00.418001] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-13T19:02:01.223012] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-13T19:02:01.238116] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:02:02.017927] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-13T19:02:02.082198] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T19:02:02.817890] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-13T19:02:03.071322] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T19:02:03.287974] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T19:02:03.617963] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-13T19:02:04.417889] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-13T19:02:04.467056] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T19:02:04.825120] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T19:02:05.217933] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-13T19:02:06.017894] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-13T19:02:06.405157] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T19:02:06.622599] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T19:02:06.817920] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-13T19:02:07.563748] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T19:02:07.617877] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-13T19:02:07.657494] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T19:02:08.417898] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-13T19:02:08.494036] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T19:02:08.495618] [INFO ] [REMOTE ] FRGE: Full fetch complete (31316 records). [2025-10-13T19:02:08.495715] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-13T19:02:08.855428] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-13T19:02:08.855516] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-13T19:02:08.856107] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-13T19:02:08.856169] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-13T19:02:08.856981] [DEBUG] [LOCAL ] FRGE: Trimmed 31316 records to 16319 (keeping 200 days of data) [2025-10-13T19:02:08.952854] [DEBUG] [LOCAL ] FRGE: Primary data saved (16319 records). [2025-10-13T19:02:08.952998] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-13T19:02:08.953074] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRGE took 36.8s. Estimated remaining: 3h 29m 53s. Rate: 7.1 symbols/min [2025-10-13T19:02:09.119783] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:02:09.168300] [DEBUG] [LOCAL ] FSK: Loaded 50179 existing records from primary storage. [2025-10-13T19:02:09.168612] [INFO ] [MAIN ] FSK: Loaded 50179 existing records. [2025-10-13T19:02:09.231093] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-13T19:02:09.351988] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:02:09.352295] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-13T19:02:09.352360] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-13T19:02:09.352939] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-13T19:02:09.352998] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-13T19:02:09.717531] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:02:10.017943] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-13T19:02:10.321844] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-13T19:02:10.817961] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-13T19:02:11.028705] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:02:11.617982] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-13T19:02:11.683566] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T19:02:12.417917] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-13T19:02:12.687307] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T19:02:12.721502] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T19:02:13.217947] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-13T19:02:14.017890] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-13T19:02:14.125459] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T19:02:14.729158] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:02:14.817884] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-13T19:02:15.617829] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-13T19:02:15.966355] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-13T19:02:16.281977] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T19:02:16.417984] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-13T19:02:17.101840] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T19:02:17.217927] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-13T19:02:17.674431] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T19:02:18.017959] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-13T19:02:18.822531] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-13T19:02:18.825315] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:02:19.617997] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-13T19:02:19.805920] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T19:02:20.332210] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T19:02:20.417966] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-13T19:02:20.906386] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T19:02:21.218027] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-13T19:02:22.017941] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-13T19:02:22.211996] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T19:02:22.457974] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T19:02:22.817993] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-13T19:02:23.482390] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T19:02:23.617938] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-13T19:02:24.417939] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-13T19:02:24.488435] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:02:25.110064] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T19:02:25.114853] [INFO ] [REMOTE ] FRT: Full fetch complete (60295 records). [2025-10-13T19:02:25.115059] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-13T19:02:25.222777] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-13T19:02:25.538714] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-13T19:02:25.538835] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-13T19:02:25.540034] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-13T19:02:25.540103] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-13T19:02:25.541960] [DEBUG] [LOCAL ] FRT: Trimmed 60295 records to 41675 (keeping 200 days of data) [2025-10-13T19:02:25.872092] [DEBUG] [LOCAL ] FRT: Primary data saved (41675 records). [2025-10-13T19:02:25.872264] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-13T19:02:25.872363] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FRT took 31.0s. Estimated remaining: 3h 29m 59s. Rate: 7.1 symbols/min [2025-10-13T19:02:26.022751] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-13T19:02:26.052637] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:02:26.109273] [DEBUG] [LOCAL ] FSLY: Loaded 52002 existing records from primary storage. [2025-10-13T19:02:26.109753] [INFO ] [MAIN ] FSLY: Loaded 52002 existing records. [2025-10-13T19:02:26.304202] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:02:26.304717] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-13T19:02:26.304799] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-13T19:02:26.305439] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-13T19:02:26.334231] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-13T19:02:26.399811] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-13T19:02:26.751953] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:02:26.817953] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-13T19:02:26.862379] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T19:02:27.378833] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:02:27.618001] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-13T19:02:28.417898] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-13T19:02:28.744904] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-13T19:02:28.751244] [INFO ] [REMOTE ] FRO: Full fetch complete (75205 records). [2025-10-13T19:02:28.751483] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-13T19:02:29.101377] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T19:02:29.135429] [INFO ] [REMOTE ] FSCO: Full fetch complete (54945 records). [2025-10-13T19:02:29.155435] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-13T19:02:29.228598] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-13T19:02:29.233985] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-13T19:02:29.248042] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-13T19:02:29.228326] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-13T19:02:29.258097] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-13T19:02:29.328464] [DEBUG] [LOCAL ] FRO: Trimmed 75205 records to 51695 (keeping 200 days of data) [2025-10-13T19:02:29.701565] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-13T19:02:29.701952] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-13T19:02:29.702849] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-13T19:02:29.702934] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-13T19:02:29.708394] [DEBUG] [LOCAL ] FSCO: Trimmed 54945 records to 38370 (keeping 200 days of data) [2025-10-13T19:02:30.085611] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:02:30.106003] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-13T19:02:30.170736] [DEBUG] [LOCAL ] FSCO: Primary data saved (38370 records). [2025-10-13T19:02:30.171337] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-13T19:02:30.188367] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSCO took 33.4s. Estimated remaining: 3h 29m 44s. Rate: 7.1 symbols/min [2025-10-13T19:02:30.383963] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:02:30.389469] [DEBUG] [LOCAL ] FRO: Primary data saved (51695 records). [2025-10-13T19:02:30.390056] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-13T19:02:30.390195] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FRO took 56.4s. Estimated remaining: 3h 29m 21s. Rate: 7.1 symbols/min [2025-10-13T19:02:30.581904] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:02:30.619350] [DEBUG] [LOCAL ] FSM: Loaded 54076 existing records from primary storage. [2025-10-13T19:02:30.619706] [INFO ] [MAIN ] FSM: Loaded 54076 existing records. [2025-10-13T19:02:30.825275] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:02:30.826629] [DEBUG] [LOCAL ] FSS: Loaded 34290 existing records from primary storage. [2025-10-13T19:02:30.827012] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-13T19:02:30.827119] [INFO ] [MAIN ] FSS: Loaded 34290 existing records. [2025-10-13T19:02:30.840060] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-13T19:02:30.873122] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-13T19:02:30.878454] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-13T19:02:31.155366] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:02:31.236914] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-13T19:02:31.261175] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-13T19:02:31.310125] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-13T19:02:31.310406] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-13T19:02:31.546099] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-13T19:02:31.623261] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-13T19:02:31.612148] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:02:31.652260] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-13T19:02:31.836219] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:02:32.011435] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T19:02:32.417945] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-13T19:02:33.217951] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-13T19:02:33.359997] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:02:33.437136] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T19:02:33.466411] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T19:02:34.017956] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-13T19:02:34.817940] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-13T19:02:35.051993] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T19:02:35.617987] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-13T19:02:35.797748] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T19:02:36.418028] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-13T19:02:36.676006] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T19:02:37.217946] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-13T19:02:37.460164] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T19:02:37.467930] [INFO ] [REMOTE ] FSK: Full fetch complete (71757 records). [2025-10-13T19:02:37.468116] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-13T19:02:37.840624] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T19:02:37.892492] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-13T19:02:37.892567] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-13T19:02:37.893449] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-13T19:02:37.893521] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-13T19:02:37.895019] [DEBUG] [LOCAL ] FSK: Trimmed 71757 records to 49449 (keeping 200 days of data) [2025-10-13T19:02:38.067615] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-13T19:02:38.200456] [DEBUG] [LOCAL ] FSK: Primary data saved (49449 records). [2025-10-13T19:02:38.200607] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-13T19:02:38.200722] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FSK took 29.2s. Estimated remaining: 3h 29m 12s. Rate: 7.1 symbols/min [2025-10-13T19:02:38.365700] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:02:38.375581] [DEBUG] [LOCAL ] FT: Loaded 6823 existing records from primary storage. [2025-10-13T19:02:38.375819] [INFO ] [MAIN ] FT: Loaded 6823 existing records. [2025-10-13T19:02:38.586318] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:02:38.586706] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-13T19:02:38.586768] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-13T19:02:38.587038] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-13T19:02:38.587097] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-13T19:02:38.817986] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-13T19:02:39.002092] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:02:39.035196] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T19:02:39.487986] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T19:02:39.617944] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-13T19:02:40.308716] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T19:02:40.417960] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-13T19:02:41.217957] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-13T19:02:41.475004] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T19:02:41.928273] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-13T19:02:41.954378] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T19:02:42.017922] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-13T19:02:42.817977] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-13T19:02:43.283444] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T19:02:43.617965] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-13T19:02:43.784466] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T19:02:44.314695] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-13T19:02:44.417950] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-13T19:02:45.217952] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-13T19:02:46.018024] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-13T19:02:46.035387] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T19:02:46.070465] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:02:46.817952] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-13T19:02:47.564836] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T19:02:47.601823] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T19:02:47.617893] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-13T19:02:48.391142] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T19:02:48.417890] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-13T19:02:48.871634] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T19:02:49.217936] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-13T19:02:49.984765] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T19:02:50.017950] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-13T19:02:50.817959] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-13T19:02:51.485471] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T19:02:51.549218] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T19:02:51.617958] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-13T19:02:52.417955] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-13T19:02:53.217958] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-13T19:02:53.483422] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-13T19:02:53.662880] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T19:02:53.991275] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T19:02:54.017953] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-13T19:02:54.786507] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T19:02:54.787974] [INFO ] [REMOTE ] FT: Full fetch complete (9226 records). [2025-10-13T19:02:54.788046] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-13T19:02:54.823181] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-13T19:02:55.148037] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-13T19:02:55.148122] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-13T19:02:55.148412] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-13T19:02:55.148459] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-13T19:02:55.148906] [DEBUG] [LOCAL ] FT: Trimmed 9226 records to 6748 (keeping 200 days of data) [2025-10-13T19:02:55.186907] [DEBUG] [LOCAL ] FT: Primary data saved (6748 records). [2025-10-13T19:02:55.187021] [INFO ] [MAIN ] FT: Full history saved. [2025-10-13T19:02:55.187100] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FT took 17.0s. Estimated remaining: 3h 29m 18s. Rate: 7.1 symbols/min [2025-10-13T19:02:55.617895] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-13T19:02:56.320299] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T19:02:56.417962] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-13T19:02:57.217963] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-13T19:02:57.436470] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T19:02:58.017958] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-13T19:02:58.138291] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T19:02:58.311865] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-13T19:02:58.817943] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-13T19:02:59.457127] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:02:59.617978] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-13T19:03:00.148947] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:03:00.418002] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-13T19:03:01.217973] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-13T19:03:01.507968] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T19:03:02.017982] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-13T19:03:02.203464] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T19:03:02.209059] [INFO ] [REMOTE ] FSLY: Full fetch complete (74862 records). [2025-10-13T19:03:02.209215] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-13T19:03:02.629890] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-13T19:03:02.626286] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:03:02.630046] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-13T19:03:02.633706] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-13T19:03:02.633923] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-13T19:03:02.634986] [INFO ] [REMOTE ] FSS: Full fetch complete (48418 records). [2025-10-13T19:03:02.635211] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-13T19:03:02.666792] [DEBUG] [LOCAL ] FSLY: Trimmed 74862 records to 51276 (keeping 200 days of data) [2025-10-13T19:03:03.115153] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-13T19:03:03.116768] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-13T19:03:03.118390] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-13T19:03:03.118473] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-13T19:03:03.129730] [DEBUG] [LOCAL ] FSS: Trimmed 48418 records to 33816 (keeping 200 days of data) [2025-10-13T19:03:03.508490] [DEBUG] [LOCAL ] FSLY: Primary data saved (51276 records). [2025-10-13T19:03:03.509766] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-13T19:03:03.510146] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FSLY took 37.6s. Estimated remaining: 3h 29m 9s. Rate: 7.1 symbols/min [2025-10-13T19:03:03.526607] [DEBUG] [LOCAL ] FSS: Primary data saved (33816 records). [2025-10-13T19:03:03.526810] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-13T19:03:03.526904] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FSS took 33.1s. Estimated remaining: 3h 28m 47s. Rate: 7.1 symbols/min [2025-10-13T19:03:03.871673] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T19:03:03.883277] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-13T19:03:05.687946] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T19:03:05.698883] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-13T19:03:07.594430] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T19:03:07.606452] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-13T19:03:09.368957] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T19:03:09.380210] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-13T19:03:11.297229] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T19:03:11.309030] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-13T19:03:13.111022] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-13T19:03:13.116622] [INFO ] [REMOTE ] FSM: Full fetch complete (76868 records). [2025-10-13T19:03:13.116793] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-13T19:03:13.510366] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-13T19:03:13.510450] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-13T19:03:13.511333] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-13T19:03:13.511396] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-13T19:03:13.512962] [DEBUG] [LOCAL ] FSM: Trimmed 76868 records to 53298 (keeping 200 days of data) [2025-10-13T19:03:13.817123] [DEBUG] [LOCAL ] FSM: Primary data saved (53298 records). [2025-10-13T19:03:13.817284] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-13T19:03:13.818191] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FSM took 43.6s. Estimated remaining: 3h 28m 42s. Rate: 7.1 symbols/min [2025-10-13T19:03:14.459206] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:14.529792] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:14.522512] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:14.616825] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:14.629737] [DEBUG] [LOCAL ] FTHY: Loaded 12479 existing records from primary storage. [2025-10-13T19:03:14.630229] [INFO ] [MAIN ] FTHY: Loaded 12479 existing records. [2025-10-13T19:03:14.786455] [DEBUG] [LOCAL ] FTS: Loaded 43045 existing records from primary storage. [2025-10-13T19:03:14.843154] [INFO ] [MAIN ] FTS: Loaded 43045 existing records. [2025-10-13T19:03:14.896733] [DEBUG] [LOCAL ] FTK: Loaded 33004 existing records from primary storage. [2025-10-13T19:03:14.900700] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:14.925162] [INFO ] [MAIN ] FTK: Loaded 33004 existing records. [2025-10-13T19:03:14.953192] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-13T19:03:14.936226] [DEBUG] [LOCAL ] FTI: Loaded 54071 existing records from primary storage. [2025-10-13T19:03:14.997772] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-13T19:03:15.014034] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-13T19:03:15.019340] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-13T19:03:15.003299] [INFO ] [MAIN ] FTI: Loaded 54071 existing records. [2025-10-13T19:03:15.488437] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:15.536085] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-13T19:03:15.577809] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:15.611260] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-13T19:03:15.640854] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-13T19:03:15.644208] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:15.644510] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-13T19:03:15.667400] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-13T19:03:15.667738] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-13T19:03:15.667622] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-13T19:03:15.683773] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-13T19:03:15.693039] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-13T19:03:15.724031] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-13T19:03:15.792479] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-13T19:03:15.886742] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-13T19:03:16.078722] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:16.130055] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-13T19:03:16.817106] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:16.864456] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-13T19:03:16.912357] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:16.913479] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-13T19:03:16.991877] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:16.992175] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-13T19:03:17.353256] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T19:03:17.357293] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-13T19:03:18.063483] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T19:03:18.068558] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-13T19:03:18.133188] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T19:03:18.136499] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-13T19:03:18.476676] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:03:18.485265] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-13T19:03:18.739636] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T19:03:18.740083] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T19:03:18.753354] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-13T19:03:18.755128] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-13T19:03:19.195044] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T19:03:19.201147] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-13T19:03:19.509046] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-13T19:03:19.511433] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-13T19:03:19.564936] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T19:03:19.573321] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-13T19:03:20.195598] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-13T19:03:20.200633] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-13T19:03:20.272068] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-13T19:03:20.276848] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-13T19:03:20.395245] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:03:20.405669] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-13T19:03:20.745621] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-13T19:03:20.748954] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-13T19:03:20.841713] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T19:03:20.850098] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-13T19:03:21.512520] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T19:03:21.518694] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-13T19:03:21.565121] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T19:03:21.829592] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T19:03:22.017900] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-13T19:03:22.408745] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T19:03:22.519774] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T19:03:22.817902] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-13T19:03:23.618069] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-13T19:03:23.686607] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T19:03:23.957485] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T19:03:24.091277] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T19:03:24.417983] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-13T19:03:25.204248] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T19:03:25.217872] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-13T19:03:26.017946] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-13T19:03:26.070174] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T19:03:26.817961] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-13T19:03:27.606556] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T19:03:27.617878] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-13T19:03:28.364367] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T19:03:28.417999] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-13T19:03:29.186886] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:03:29.217981] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-13T19:03:29.874579] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T19:03:30.017960] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-13T19:03:30.579266] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:03:30.817992] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-13T19:03:31.618075] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-13T19:03:31.733675] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T19:03:32.417978] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-13T19:03:32.472568] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:03:33.217989] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-13T19:03:33.426545] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T19:03:33.522392] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T19:03:34.018040] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-13T19:03:34.805600] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T19:03:34.817881] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-13T19:03:35.191602] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T19:03:35.618001] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-13T19:03:36.241403] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:03:36.417951] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-13T19:03:36.962955] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:03:36.967373] [INFO ] [REMOTE ] FTK: Full fetch complete (44109 records). [2025-10-13T19:03:36.967558] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-13T19:03:37.229841] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-13T19:03:37.373629] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-13T19:03:37.373753] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-13T19:03:37.374437] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-13T19:03:37.374479] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-13T19:03:37.375527] [DEBUG] [LOCAL ] FTK: Trimmed 44109 records to 32807 (keeping 200 days of data) [2025-10-13T19:03:37.564494] [DEBUG] [LOCAL ] FTK: Primary data saved (32807 records). [2025-10-13T19:03:37.564708] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-13T19:03:37.564833] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTK took 23.7s. Estimated remaining: 3h 28m 59s. Rate: 7.1 symbols/min [2025-10-13T19:03:37.741913] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:37.797181] [DEBUG] [LOCAL ] FTV: Loaded 53761 existing records from primary storage. [2025-10-13T19:03:37.797582] [INFO ] [MAIN ] FTV: Loaded 53761 existing records. [2025-10-13T19:03:37.995392] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:37.996639] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-13T19:03:37.996470] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T19:03:37.996811] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-13T19:03:38.001368] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-13T19:03:38.001490] [INFO ] [REMOTE ] FTS: Full fetch complete (60218 records). [2025-10-13T19:03:38.001696] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-13T19:03:38.001829] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-13T19:03:38.022411] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-13T19:03:38.135741] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T19:03:38.217218] [INFO ] [REMOTE ] FTHY: Full fetch complete (17499 records). [2025-10-13T19:03:38.226331] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-13T19:03:39.080763] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:39.091619] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-13T19:03:39.102117] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-13T19:03:39.131701] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-13T19:03:39.152509] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-13T19:03:39.157738] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-13T19:03:39.168958] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-13T19:03:39.169243] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-13T19:03:39.169550] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-13T19:03:39.169685] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-13T19:03:39.170003] [DEBUG] [LOCAL ] FTS: Trimmed 60218 records to 42510 (keeping 200 days of data) [2025-10-13T19:03:39.171030] [DEBUG] [LOCAL ] FTHY: Trimmed 17499 records to 12332 (keeping 200 days of data) [2025-10-13T19:03:39.473688] [DEBUG] [LOCAL ] FTHY: Primary data saved (12332 records). [2025-10-13T19:03:39.483915] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-13T19:03:39.486504] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTHY took 25.7s. Estimated remaining: 3h 28m 40s. Rate: 7.1 symbols/min [2025-10-13T19:03:39.691079] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:39.692114] [DEBUG] [LOCAL ] FTS: Primary data saved (42510 records). [2025-10-13T19:03:39.693100] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-13T19:03:39.694414] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTS took 25.9s. Estimated remaining: 3h 28m 18s. Rate: 7.1 symbols/min [2025-10-13T19:03:39.784542] [DEBUG] [LOCAL ] FTWO: Loaded 1910 existing records from primary storage. [2025-10-13T19:03:39.801505] [INFO ] [MAIN ] FTWO: Loaded 1910 existing records. [2025-10-13T19:03:39.908802] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:40.057606] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:40.058163] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-13T19:03:40.058235] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-13T19:03:40.058578] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-13T19:03:40.059100] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-13T19:03:40.222543] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-13T19:03:40.292506] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-13T19:03:40.292215] [DEBUG] [LOCAL ] FUBO: Loaded 54485 existing records from primary storage. [2025-10-13T19:03:40.348872] [INFO ] [MAIN ] FUBO: Loaded 54485 existing records. [2025-10-13T19:03:40.641880] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:40.659806] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-13T19:03:40.682598] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:40.683394] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-13T19:03:40.683440] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-13T19:03:40.683930] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-13T19:03:40.683999] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-13T19:03:41.037724] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:41.065405] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T19:03:41.217958] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-13T19:03:41.248529] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T19:03:42.017983] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-13T19:03:42.094590] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T19:03:42.424682] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-13T19:03:42.817948] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-13T19:03:43.325154] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T19:03:43.617942] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-13T19:03:44.417957] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-13T19:03:44.523050] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T19:03:44.942728] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-13T19:03:45.217941] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-13T19:03:46.017970] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-13T19:03:46.093198] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-13T19:03:46.455891] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-13T19:03:46.817961] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-13T19:03:46.935110] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T19:03:47.617955] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-13T19:03:48.417954] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-13T19:03:49.075046] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-13T19:03:49.217897] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-13T19:03:49.488544] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T19:03:50.017937] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-13T19:03:50.106057] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T19:03:50.817964] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-13T19:03:51.121889] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-13T19:03:51.415339] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-13T19:03:51.445083] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:03:51.450775] [INFO ] [REMOTE ] FTI: Full fetch complete (77129 records). [2025-10-13T19:03:51.450916] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-13T19:03:51.622778] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-13T19:03:51.841445] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-13T19:03:51.841545] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-13T19:03:51.842508] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-13T19:03:51.842579] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-13T19:03:51.846989] [DEBUG] [LOCAL ] FTI: Trimmed 77129 records to 53299 (keeping 200 days of data) [2025-10-13T19:03:52.164853] [DEBUG] [LOCAL ] FTI: Primary data saved (53299 records). [2025-10-13T19:03:52.164997] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-13T19:03:52.165593] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTI took 38.3s. Estimated remaining: 3h 28m 16s. Rate: 7.1 symbols/min [2025-10-13T19:03:52.330514] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:03:52.364957] [DEBUG] [LOCAL ] FUL: Loaded 33279 existing records from primary storage. [2025-10-13T19:03:52.365240] [INFO ] [MAIN ] FUL: Loaded 33279 existing records. [2025-10-13T19:03:52.426636] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-13T19:03:52.545382] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:03:52.545679] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-13T19:03:52.545750] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-13T19:03:52.546508] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-13T19:03:52.546581] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-13T19:03:52.891718] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:03:53.217958] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-13T19:03:53.545786] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T19:03:54.017937] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-13T19:03:54.427355] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T19:03:54.611528] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-13T19:03:54.817899] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-13T19:03:55.617896] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-13T19:03:55.873236] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T19:03:56.082605] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-13T19:03:56.417940] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-13T19:03:57.040936] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-13T19:03:57.217969] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-13T19:03:57.792771] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T19:03:58.017972] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-13T19:03:58.460811] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T19:03:58.817898] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-13T19:03:59.154905] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T19:03:59.617938] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-13T19:04:00.417941] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-13T19:04:00.596204] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T19:04:00.859984] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T19:04:01.217963] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-13T19:04:02.017952] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-13T19:04:02.572052] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T19:04:02.578991] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-13T19:04:02.817940] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-13T19:04:02.985279] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-13T19:04:03.118227] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-13T19:04:03.617945] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-13T19:04:04.417904] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-13T19:04:05.217957] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-13T19:04:05.512551] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-13T19:04:05.668085] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T19:04:06.017997] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-13T19:04:06.323850] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T19:04:06.568567] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T19:04:06.569462] [INFO ] [REMOTE ] FTWO: Full fetch complete (3313 records). [2025-10-13T19:04:06.569529] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-13T19:04:06.823097] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-13T19:04:06.928377] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-13T19:04:06.928455] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-13T19:04:06.928575] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-13T19:04:06.928613] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-13T19:04:06.929009] [DEBUG] [LOCAL ] FTWO: Trimmed 3313 records to 1896 (keeping 200 days of data) [2025-10-13T19:04:06.940692] [DEBUG] [LOCAL ] FTWO: Primary data saved (1896 records). [2025-10-13T19:04:06.940751] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-13T19:04:06.940852] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FTWO took 27.5s. Estimated remaining: 3h 28m 18s. Rate: 7.1 symbols/min [2025-10-13T19:04:07.133533] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:07.194149] [DEBUG] [LOCAL ] FUN: Loaded 52553 existing records from primary storage. [2025-10-13T19:04:07.194503] [INFO ] [MAIN ] FUN: Loaded 52553 existing records. [2025-10-13T19:04:07.373363] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:07.373592] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-13T19:04:07.373638] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-13T19:04:07.374181] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-13T19:04:07.374238] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-13T19:04:07.624549] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-13T19:04:07.748425] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:08.345841] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T19:04:08.417940] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-13T19:04:09.217987] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-13T19:04:09.929775] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T19:04:10.023052] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-13T19:04:10.038744] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-13T19:04:10.817897] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-13T19:04:10.985206] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T19:04:11.436005] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T19:04:11.617979] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-13T19:04:12.417888] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-13T19:04:12.584859] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T19:04:13.217896] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-13T19:04:13.392998] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T19:04:13.599478] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T19:04:14.018018] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-13T19:04:14.818051] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-13T19:04:15.346585] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-13T19:04:15.352636] [INFO ] [REMOTE ] FUBO: Full fetch complete (77771 records). [2025-10-13T19:04:15.352809] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-13T19:04:15.619410] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-13T19:04:15.760848] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T19:04:15.792629] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-13T19:04:15.793091] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-13T19:04:15.794013] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-13T19:04:15.794077] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-13T19:04:15.795537] [DEBUG] [LOCAL ] FUBO: Trimmed 77771 records to 53715 (keeping 200 days of data) [2025-10-13T19:04:16.097534] [DEBUG] [LOCAL ] FUBO: Primary data saved (53715 records). [2025-10-13T19:04:16.097706] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-13T19:04:16.097797] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUBO took 36.4s. Estimated remaining: 3h 28m 11s. Rate: 7.1 symbols/min [2025-10-13T19:04:16.271951] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:16.286372] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T19:04:16.292015] [INFO ] [REMOTE ] FTV: Full fetch complete (76416 records). [2025-10-13T19:04:16.292184] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-13T19:04:16.427508] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-13T19:04:16.463006] [DEBUG] [LOCAL ] FVR: Loaded 21773 existing records from primary storage. [2025-10-13T19:04:16.505335] [INFO ] [MAIN ] FVR: Loaded 21773 existing records. [2025-10-13T19:04:16.859609] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-13T19:04:16.866346] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-13T19:04:16.902417] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-13T19:04:16.902533] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-13T19:04:16.901368] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:16.902949] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-13T19:04:16.903417] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-13T19:04:16.903948] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-13T19:04:16.904012] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-13T19:04:16.909266] [DEBUG] [LOCAL ] FTV: Trimmed 76416 records to 53035 (keeping 200 days of data) [2025-10-13T19:04:17.256551] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T19:04:17.306888] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-13T19:04:17.501976] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:17.659819] [DEBUG] [LOCAL ] FTV: Primary data saved (53035 records). [2025-10-13T19:04:17.660001] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-13T19:04:17.660145] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FTV took 40.1s. Estimated remaining: 3h 27m 51s. Rate: 7.1 symbols/min [2025-10-13T19:04:17.851575] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:17.892719] [DEBUG] [LOCAL ] FVRR: Loaded 40837 existing records from primary storage. [2025-10-13T19:04:17.893063] [INFO ] [MAIN ] FVRR: Loaded 40837 existing records. [2025-10-13T19:04:18.018289] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-13T19:04:18.071013] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:18.071444] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-13T19:04:18.071490] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-13T19:04:18.071934] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-13T19:04:18.071991] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-13T19:04:18.427699] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:18.461320] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-13T19:04:18.823142] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-13T19:04:18.835712] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:04:18.896370] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T19:04:19.617963] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-13T19:04:20.317225] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T19:04:20.417899] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-13T19:04:20.603702] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:04:21.217992] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-13T19:04:22.005847] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T19:04:22.017873] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-13T19:04:22.523630] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T19:04:22.817966] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-13T19:04:23.564807] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T19:04:23.617896] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-13T19:04:23.787847] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-13T19:04:24.417965] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-13T19:04:25.108901] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T19:04:25.217900] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-13T19:04:25.831444] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T19:04:26.017957] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-13T19:04:26.817896] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-13T19:04:26.918746] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T19:04:27.363923] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T19:04:27.367501] [INFO ] [REMOTE ] FUL: Full fetch complete (47743 records). [2025-10-13T19:04:27.367597] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-13T19:04:27.623080] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-13T19:04:27.745055] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-13T19:04:27.745197] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-13T19:04:27.745878] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-13T19:04:27.745944] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-13T19:04:27.746966] [DEBUG] [LOCAL ] FUL: Trimmed 47743 records to 32704 (keeping 200 days of data) [2025-10-13T19:04:27.935924] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T19:04:27.961635] [DEBUG] [LOCAL ] FUL: Primary data saved (32704 records). [2025-10-13T19:04:27.961753] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-13T19:04:27.961838] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUL took 35.8s. Estimated remaining: 3h 27m 46s. Rate: 7.1 symbols/min [2025-10-13T19:04:28.133190] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:28.136735] [DEBUG] [LOCAL ] FXED: Loaded 1266 existing records from primary storage. [2025-10-13T19:04:28.136873] [INFO ] [MAIN ] FXED: Loaded 1266 existing records. [2025-10-13T19:04:28.309360] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:28.309586] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-13T19:04:28.309633] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-13T19:04:28.309831] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-13T19:04:28.309886] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-13T19:04:28.423045] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-13T19:04:28.657466] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:29.107614] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T19:04:29.217927] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-13T19:04:29.523196] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T19:04:30.018006] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-13T19:04:30.725100] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:04:30.817894] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-13T19:04:31.052415] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-13T19:04:31.159445] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-13T19:04:31.617963] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-13T19:04:31.937125] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-13T19:04:32.417961] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-13T19:04:33.217942] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-13T19:04:33.963507] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T19:04:34.017892] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-13T19:04:34.447857] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-13T19:04:34.817982] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-13T19:04:35.083758] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T19:04:35.617899] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-13T19:04:36.417899] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-13T19:04:36.477409] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T19:04:36.808577] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-13T19:04:37.217972] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-13T19:04:37.283908] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:04:38.017957] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-13T19:04:38.818014] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-13T19:04:39.032217] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T19:04:39.548383] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-13T19:04:39.617944] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-13T19:04:39.823365] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T19:04:40.417952] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-13T19:04:40.758965] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-13T19:04:41.217971] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-13T19:04:41.454013] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T19:04:41.875624] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-13T19:04:42.017939] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-13T19:04:42.817955] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-13T19:04:43.230710] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-13T19:04:43.617976] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-13T19:04:43.760367] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T19:04:43.963789] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-13T19:04:44.417952] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-13T19:04:45.217939] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-13T19:04:45.554790] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T19:04:46.017951] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-13T19:04:46.128553] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T19:04:46.136773] [INFO ] [REMOTE ] FUN: Full fetch complete (73094 records). [2025-10-13T19:04:46.137005] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-13T19:04:46.479156] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T19:04:46.537202] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-13T19:04:46.537291] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-13T19:04:46.538321] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-13T19:04:46.538387] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-13T19:04:46.539793] [DEBUG] [LOCAL ] FUN: Trimmed 73094 records to 51875 (keeping 200 days of data) [2025-10-13T19:04:46.828387] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-13T19:04:46.851179] [DEBUG] [LOCAL ] FUN: Primary data saved (51875 records). [2025-10-13T19:04:46.851323] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-13T19:04:46.851449] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FUN took 39.9s. Estimated remaining: 3h 27m 55s. Rate: 7.1 symbols/min [2025-10-13T19:04:47.039444] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:47.089859] [DEBUG] [LOCAL ] G: Loaded 50737 existing records from primary storage. [2025-10-13T19:04:47.090213] [INFO ] [MAIN ] G: Loaded 50737 existing records. [2025-10-13T19:04:47.279568] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-13T19:04:47.308976] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:47.311527] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-13T19:04:47.311614] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-13T19:04:47.312062] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-13T19:04:47.312131] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-13T19:04:47.623088] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-13T19:04:47.678183] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:48.099441] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-13T19:04:48.417949] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-13T19:04:49.217974] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-13T19:04:50.017347] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:04:50.027310] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-13T19:04:50.216068] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T19:04:50.475384] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T19:04:50.476155] [INFO ] [REMOTE ] FXED: Full fetch complete (1807 records). [2025-10-13T19:04:50.476221] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-13T19:04:50.823074] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-13T19:04:50.867304] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-13T19:04:50.867419] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-13T19:04:50.867541] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-13T19:04:50.867605] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-13T19:04:50.868070] [DEBUG] [LOCAL ] FXED: Trimmed 1807 records to 1252 (keeping 200 days of data) [2025-10-13T19:04:50.877610] [DEBUG] [LOCAL ] FXED: Primary data saved (1252 records). [2025-10-13T19:04:50.877707] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-13T19:04:50.877792] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FXED took 22.9s. Estimated remaining: 3h 27m 39s. Rate: 7.1 symbols/min [2025-10-13T19:04:51.067316] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:51.096424] [DEBUG] [LOCAL ] GAB: Loaded 28235 existing records from primary storage. [2025-10-13T19:04:51.096748] [INFO ] [MAIN ] GAB: Loaded 28235 existing records. [2025-10-13T19:04:51.279284] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:51.279565] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-13T19:04:51.279614] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-13T19:04:51.279936] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-13T19:04:51.280007] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-13T19:04:51.626944] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-13T19:04:51.631621] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:52.345615] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:04:52.417882] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-13T19:04:53.129207] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T19:04:53.217891] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-13T19:04:53.989096] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T19:04:53.993629] [INFO ] [REMOTE ] FVRR: Full fetch complete (59265 records). [2025-10-13T19:04:53.993800] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-13T19:04:54.026275] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-13T19:04:54.376317] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-13T19:04:54.376395] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-13T19:04:54.377152] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-13T19:04:54.377241] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-13T19:04:54.378406] [DEBUG] [LOCAL ] FVRR: Trimmed 59265 records to 40494 (keeping 200 days of data) [2025-10-13T19:04:54.612362] [DEBUG] [LOCAL ] FVRR: Primary data saved (40494 records). [2025-10-13T19:04:54.612515] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-13T19:04:54.612752] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. FVRR took 37.0s. Estimated remaining: 3h 27m 23s. Rate: 7.1 symbols/min [2025-10-13T19:04:54.788602] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:54.819023] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-13T19:04:54.823141] [DEBUG] [LOCAL ] GAM: Loaded 4102 existing records from primary storage. [2025-10-13T19:04:54.825638] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T19:04:54.826204] [INFO ] [MAIN ] GAM: Loaded 4102 existing records. [2025-10-13T19:04:55.013043] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:55.013288] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-13T19:04:55.013337] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-13T19:04:55.013513] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-13T19:04:55.013579] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-13T19:04:55.366985] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:55.415624] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T19:04:55.475161] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T19:04:55.477747] [INFO ] [REMOTE ] FVR: Full fetch complete (29483 records). [2025-10-13T19:04:55.477836] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-13T19:04:55.623061] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-13T19:04:55.856989] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-13T19:04:55.857098] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-13T19:04:55.857897] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-13T19:04:55.857991] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-13T19:04:55.859240] [DEBUG] [LOCAL ] FVR: Trimmed 29483 records to 21321 (keeping 200 days of data) [2025-10-13T19:04:56.000932] [DEBUG] [LOCAL ] FVR: Primary data saved (21321 records). [2025-10-13T19:04:56.001109] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-13T19:04:56.001208] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. FVR took 39.9s. Estimated remaining: 3h 27m 3s. Rate: 7.1 symbols/min [2025-10-13T19:04:56.183294] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:04:56.237414] [DEBUG] [LOCAL ] GAP: Loaded 54432 existing records from primary storage. [2025-10-13T19:04:56.237814] [INFO ] [MAIN ] GAP: Loaded 54432 existing records. [2025-10-13T19:04:56.423163] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T19:04:56.422114] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:04:56.417987] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-13T19:04:56.425944] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-13T19:04:56.426841] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-13T19:04:56.427411] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-13T19:04:56.427468] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-13T19:04:56.783132] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:04:57.217934] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-13T19:04:57.639139] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T19:04:58.017935] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-13T19:04:58.657834] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T19:04:58.792632] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-13T19:04:58.817877] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-13T19:04:59.618003] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-13T19:05:00.053610] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-13T19:05:00.236602] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T19:05:00.417942] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-13T19:05:01.218007] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-13T19:05:01.966283] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T19:05:02.017927] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-13T19:05:02.327012] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T19:05:02.817896] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-13T19:05:03.528714] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-13T19:05:03.617968] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-13T19:05:03.952534] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T19:05:04.417993] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-13T19:05:04.971338] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T19:05:05.053781] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-13T19:05:05.217888] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-13T19:05:05.786936] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T19:05:06.017950] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-13T19:05:06.562203] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T19:05:06.818069] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-13T19:05:07.618003] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-13T19:05:08.237287] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T19:05:08.417952] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-13T19:05:08.650622] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T19:05:09.217900] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-13T19:05:09.673965] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T19:05:10.017960] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-13T19:05:10.817936] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-13T19:05:10.878748] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T19:05:11.617967] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-13T19:05:11.701073] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:05:12.041102] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-13T19:05:12.417985] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-13T19:05:13.163241] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:05:13.217877] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-13T19:05:13.598742] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T19:05:14.017964] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-13T19:05:14.818086] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-13T19:05:14.910084] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T19:05:15.617977] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-13T19:05:15.945567] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T19:05:16.131396] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-13T19:05:16.202869] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-13T19:05:16.417950] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-13T19:05:17.218004] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-13T19:05:17.760875] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-13T19:05:18.017991] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-13T19:05:18.320829] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:05:18.470592] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-13T19:05:18.471550] [INFO ] [REMOTE ] GAM: Full fetch complete (6563 records). [2025-10-13T19:05:18.471615] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-13T19:05:18.835178] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-13T19:05:18.827436] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-13T19:05:18.836083] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-13T19:05:18.836276] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-13T19:05:18.836317] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-13T19:05:18.836716] [DEBUG] [LOCAL ] GAM: Trimmed 6563 records to 3987 (keeping 200 days of data) [2025-10-13T19:05:18.862595] [DEBUG] [LOCAL ] GAM: Primary data saved (3987 records). [2025-10-13T19:05:18.862722] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-13T19:05:18.862807] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. GAM took 24.2s. Estimated remaining: 3h 27m 19s. Rate: 7.1 symbols/min [2025-10-13T19:05:19.030939] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:19.052319] [DEBUG] [LOCAL ] GATX: Loaded 18334 existing records from primary storage. [2025-10-13T19:05:19.052577] [INFO ] [MAIN ] GATX: Loaded 18334 existing records. [2025-10-13T19:05:19.226493] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:05:19.226752] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-13T19:05:19.226806] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-13T19:05:19.227161] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-13T19:05:19.227217] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-13T19:05:19.574476] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:05:19.617880] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-13T19:05:20.417929] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-13T19:05:20.650587] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T19:05:20.831911] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T19:05:21.217950] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-13T19:05:22.017937] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-13T19:05:22.238922] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T19:05:22.818001] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-13T19:05:23.000541] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T19:05:23.071794] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T19:05:23.618021] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-13T19:05:23.884669] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T19:05:24.417956] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-13T19:05:25.217939] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-13T19:05:25.606103] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T19:05:25.609243] [INFO ] [REMOTE ] GAB: Full fetch complete (39335 records). [2025-10-13T19:05:25.609361] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-13T19:05:25.757696] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-13T19:05:26.022259] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-13T19:05:26.037892] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-13T19:05:26.038033] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-13T19:05:26.039690] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-13T19:05:26.039757] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-13T19:05:26.040604] [DEBUG] [LOCAL ] GAB: Trimmed 39335 records to 27677 (keeping 200 days of data) [2025-10-13T19:05:26.132268] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T19:05:26.210710] [DEBUG] [LOCAL ] GAB: Primary data saved (27677 records). [2025-10-13T19:05:26.210850] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-13T19:05:26.210932] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GAB took 35.3s. Estimated remaining: 3h 27m 8s. Rate: 7.1 symbols/min [2025-10-13T19:05:26.375066] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:26.388781] [DEBUG] [LOCAL ] GBAB: Loaded 13161 existing records from primary storage. [2025-10-13T19:05:26.389001] [INFO ] [MAIN ] GBAB: Loaded 13161 existing records. [2025-10-13T19:05:26.559181] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:05:26.559393] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-13T19:05:26.559441] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-13T19:05:26.559689] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-13T19:05:26.559745] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-13T19:05:26.824397] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-13T19:05:26.904742] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:05:27.617902] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-13T19:05:27.694340] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T19:05:28.417963] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-13T19:05:28.661064] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-13T19:05:28.926748] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-13T19:05:29.217945] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-13T19:05:30.017988] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-13T19:05:30.100855] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T19:05:30.106290] [INFO ] [REMOTE ] G: Full fetch complete (71766 records). [2025-10-13T19:05:30.106409] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-13T19:05:30.495046] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-13T19:05:30.495129] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-13T19:05:30.496111] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-13T19:05:30.496176] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-13T19:05:30.497485] [DEBUG] [LOCAL ] G: Trimmed 71766 records to 50010 (keeping 200 days of data) [2025-10-13T19:05:30.801287] [DEBUG] [LOCAL ] G: Primary data saved (50010 records). [2025-10-13T19:05:30.801438] [INFO ] [MAIN ] G: Full history saved. [2025-10-13T19:05:30.801521] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. G took 43.9s. Estimated remaining: 3h 26m 54s. Rate: 7.1 symbols/min [2025-10-13T19:05:30.834058] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-13T19:05:31.010430] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:31.032495] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T19:05:31.061134] [DEBUG] [LOCAL ] GBCI: Loaded 41170 existing records from primary storage. [2025-10-13T19:05:31.061474] [INFO ] [MAIN ] GBCI: Loaded 41170 existing records. [2025-10-13T19:05:31.246733] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:05:31.247042] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-13T19:05:31.247212] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-13T19:05:31.257637] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-13T19:05:31.274957] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-13T19:05:31.345447] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-13T19:05:31.620521] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-13T19:05:31.662117] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:05:31.742594] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-13T19:05:32.418154] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-13T19:05:33.217944] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-13T19:05:33.451436] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-13T19:05:33.457874] [INFO ] [REMOTE ] GAP: Full fetch complete (77632 records). [2025-10-13T19:05:33.458174] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-13T19:05:33.813684] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-13T19:05:33.895621] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-13T19:05:33.895746] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-13T19:05:33.896746] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-13T19:05:33.896841] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-13T19:05:33.898336] [DEBUG] [LOCAL ] GAP: Trimmed 77632 records to 53653 (keeping 200 days of data) [2025-10-13T19:05:34.017984] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-13T19:05:34.219748] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-13T19:05:34.219905] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-13T19:05:34.220814] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GAP took 38.2s. Estimated remaining: 3h 26m 37s. Rate: 7.1 symbols/min [2025-10-13T19:05:34.392243] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:34.392546] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-13T19:05:34.392618] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-13T19:05:34.392807] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-13T19:05:34.392852] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-13T19:05:34.392893] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-13T19:05:34.392924] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-13T19:05:34.681519] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:05:34.790806] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:05:34.817898] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-13T19:05:35.175851] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-13T19:05:35.256310] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-13T19:05:35.617949] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-13T19:05:36.378915] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T19:05:36.418002] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-13T19:05:36.762395] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-13T19:05:37.218038] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-13T19:05:37.461929] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-13T19:05:38.017946] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-13T19:05:38.446480] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T19:05:38.817958] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-13T19:05:39.561502] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T19:05:39.617963] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-13T19:05:40.417981] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-13T19:05:40.635313] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T19:05:41.217964] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-13T19:05:41.300449] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-13T19:05:42.017979] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-13T19:05:42.315047] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T19:05:42.760207] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T19:05:42.817997] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-13T19:05:43.617894] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-13T19:05:43.762799] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T19:05:43.976875] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-13T19:05:44.417945] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-13T19:05:45.136945] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T19:05:45.217887] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-13T19:05:46.017939] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-13T19:05:46.775175] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T19:05:46.817880] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-13T19:05:47.070535] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T19:05:47.617981] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-13T19:05:47.978580] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-13T19:05:48.006968] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-13T19:05:48.417926] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-13T19:05:49.217982] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-13T19:05:49.379230] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T19:05:49.381001] [INFO ] [REMOTE ] GATX: Full fetch complete (24857 records). [2025-10-13T19:05:49.381069] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-13T19:05:49.783668] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-13T19:05:49.783781] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-13T19:05:49.784366] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-13T19:05:49.784407] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-13T19:05:49.785117] [DEBUG] [LOCAL ] GATX: Trimmed 24857 records to 18135 (keeping 200 days of data) [2025-10-13T19:05:49.898921] [DEBUG] [LOCAL ] GATX: Primary data saved (18135 records). [2025-10-13T19:05:49.899060] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-13T19:05:49.899143] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GATX took 31.0s. Estimated remaining: 3h 26m 41s. Rate: 7.1 symbols/min [2025-10-13T19:05:50.023137] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-13T19:05:50.070161] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:50.107634] [DEBUG] [LOCAL ] GBTG: Loaded 40575 existing records from primary storage. [2025-10-13T19:05:50.108078] [INFO ] [MAIN ] GBTG: Loaded 40575 existing records. [2025-10-13T19:05:50.216768] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T19:05:50.295680] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:05:50.295896] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-13T19:05:50.295944] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-13T19:05:50.296332] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-13T19:05:50.296387] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-13T19:05:50.434716] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-13T19:05:50.647977] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:05:50.817900] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-13T19:05:51.617963] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-13T19:05:51.945233] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-13T19:05:52.272268] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T19:05:52.417926] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-13T19:05:53.217960] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-13T19:05:53.659921] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T19:05:53.794095] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T19:05:54.017958] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-13T19:05:54.385719] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-13T19:05:54.817967] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-13T19:05:55.617982] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-13T19:05:56.373398] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T19:05:56.422029] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-13T19:05:56.424211] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:05:57.217939] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-13T19:05:57.933244] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:05:58.017960] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-13T19:05:58.068812] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-13T19:05:58.817968] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-13T19:05:59.203372] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-13T19:05:59.204220] [INFO ] [REMOTE ] GBLI: Full fetch complete (1303 records). [2025-10-13T19:05:59.204292] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-13T19:05:59.396444] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-13T19:05:59.396883] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:05:59.397070] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:05:59.397238] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-13T19:05:59.397354] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-13T19:05:59.397607] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-13T19:05:59.397786] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-13T19:05:59.397903] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBLI took 25.2s. Estimated remaining: 3h 26m 34s. Rate: 7.1 symbols/min [2025-10-13T19:05:59.548871] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T19:05:59.626526] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-13T19:05:59.630608] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:05:59.666057] [DEBUG] [LOCAL ] GBX: Loaded 29532 existing records from primary storage. [2025-10-13T19:05:59.666394] [INFO ] [MAIN ] GBX: Loaded 29532 existing records. [2025-10-13T19:05:59.850117] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:05:59.850380] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-13T19:05:59.850428] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-13T19:05:59.850827] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-13T19:05:59.850888] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-13T19:06:00.220564] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:00.417959] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-13T19:06:00.434341] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:06:00.436371] [INFO ] [REMOTE ] GBAB: Full fetch complete (19126 records). [2025-10-13T19:06:00.436467] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-13T19:06:00.829717] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-13T19:06:00.829869] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-13T19:06:00.830564] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-13T19:06:00.830609] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-13T19:06:00.831769] [DEBUG] [LOCAL ] GBAB: Trimmed 19126 records to 13018 (keeping 200 days of data) [2025-10-13T19:06:00.917179] [DEBUG] [LOCAL ] GBAB: Primary data saved (13018 records). [2025-10-13T19:06:00.917373] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-13T19:06:00.917473] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBAB took 34.7s. Estimated remaining: 3h 26m 14s. Rate: 7.1 symbols/min [2025-10-13T19:06:01.101900] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:01.149532] [DEBUG] [LOCAL ] GCI: Loaded 44675 existing records from primary storage. [2025-10-13T19:06:01.149983] [INFO ] [MAIN ] GCI: Loaded 44675 existing records. [2025-10-13T19:06:01.227351] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-13T19:06:01.359992] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:01.360375] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-13T19:06:01.360434] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-13T19:06:01.360935] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-13T19:06:01.360994] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-13T19:06:01.712369] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T19:06:01.774219] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:02.017979] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-13T19:06:02.817997] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-13T19:06:02.846359] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T19:06:03.085828] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T19:06:03.617976] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-13T19:06:04.081686] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T19:06:04.417967] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-13T19:06:05.210763] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T19:06:05.223931] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-13T19:06:05.957525] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T19:06:06.020020] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-13T19:06:06.026043] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T19:06:06.817993] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-13T19:06:07.541709] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:06:07.617944] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-13T19:06:08.135370] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T19:06:08.418029] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-13T19:06:09.217971] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-13T19:06:09.324345] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T19:06:09.453227] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T19:06:10.017987] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-13T19:06:10.767799] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T19:06:10.817931] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-13T19:06:11.396114] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T19:06:11.617967] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-13T19:06:12.417960] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-13T19:06:12.458163] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:06:13.095917] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T19:06:13.100842] [INFO ] [REMOTE ] GBCI: Full fetch complete (58656 records). [2025-10-13T19:06:13.100973] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-13T19:06:13.223096] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-13T19:06:13.479552] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-13T19:06:13.479632] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-13T19:06:13.480435] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-13T19:06:13.480512] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-13T19:06:13.481661] [DEBUG] [LOCAL ] GBCI: Trimmed 58656 records to 40690 (keeping 200 days of data) [2025-10-13T19:06:13.738044] [DEBUG] [LOCAL ] GBCI: Primary data saved (40690 records). [2025-10-13T19:06:13.738458] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-13T19:06:13.738672] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GBCI took 42.9s. Estimated remaining: 3h 26m 13s. Rate: 7.1 symbols/min [2025-10-13T19:06:13.909506] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:13.937308] [DEBUG] [LOCAL ] GCO: Loaded 24281 existing records from primary storage. [2025-10-13T19:06:13.937634] [INFO ] [MAIN ] GCO: Loaded 24281 existing records. [2025-10-13T19:06:14.019876] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-13T19:06:14.128282] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:14.128768] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-13T19:06:14.128848] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-13T19:06:14.154497] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-13T19:06:14.154434] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T19:06:14.154701] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-13T19:06:14.531897] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:14.772131] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:06:14.817888] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-13T19:06:15.387777] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T19:06:15.617952] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-13T19:06:16.223565] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T19:06:16.417965] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-13T19:06:17.117817] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T19:06:17.217960] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-13T19:06:17.880143] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T19:06:18.017950] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-13T19:06:18.467243] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T19:06:18.818076] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-13T19:06:19.417816] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T19:06:19.617990] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-13T19:06:20.417928] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-13T19:06:20.484915] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:06:20.988738] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T19:06:21.217956] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-13T19:06:21.629327] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T19:06:22.018020] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-13T19:06:22.499860] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-13T19:06:22.817958] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-13T19:06:22.898006] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-13T19:06:23.617943] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-13T19:06:23.952234] [DEBUG] [REMOTE ] GCO: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-13T19:06:23.952561] [WARN ] [REMOTE ] GCO: No data returned for month 2025-02 [2025-10-13T19:06:23.952674] [FATAL] [REMOTE ] GCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:06:23.952760] [FATAL] [MAIN ] GCO: Failed to fetch primary data. [2025-10-13T19:06:23.952799] [WARN ] [MAIN ] GCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:06:23.952862] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-13T19:06:23.952924] [DEBUG] [LOCAL ] GCO: No primary data file found to delete. [2025-10-13T19:06:23.952959] [INFO ] [LOCAL ] GCO: Starting deletion of derivative data. [2025-10-13T19:06:23.953194] [DEBUG] [LOCAL ] GCO: Deleted derivative data file. [2025-10-13T19:06:23.953280] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCO took 10.2s. Estimated remaining: 3h 26m 8s. Rate: 7.1 symbols/min [2025-10-13T19:06:24.169825] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T19:06:24.194433] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:24.231621] [DEBUG] [LOCAL ] GCTS: Loaded 20601 existing records from primary storage. [2025-10-13T19:06:24.232000] [INFO ] [MAIN ] GCTS: Loaded 20601 existing records. [2025-10-13T19:06:24.422377] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-13T19:06:24.477982] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:24.478715] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-13T19:06:24.478800] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-13T19:06:24.479218] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-13T19:06:24.479293] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-13T19:06:25.016619] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:25.218010] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-13T19:06:25.927508] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T19:06:25.931790] [INFO ] [REMOTE ] GBTG: Full fetch complete (56375 records). [2025-10-13T19:06:25.931954] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-13T19:06:26.023148] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-13T19:06:26.324312] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-13T19:06:26.324394] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-13T19:06:26.325132] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-13T19:06:26.325195] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-13T19:06:26.326274] [DEBUG] [LOCAL ] GBTG: Trimmed 56375 records to 40089 (keeping 200 days of data) [2025-10-13T19:06:26.551636] [DEBUG] [LOCAL ] GBTG: Primary data saved (40089 records). [2025-10-13T19:06:26.551798] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-13T19:06:26.551916] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GBTG took 36.7s. Estimated remaining: 3h 25m 50s. Rate: 7.1 symbols/min [2025-10-13T19:06:26.728205] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:26.738529] [DEBUG] [LOCAL ] GCV: Loaded 7736 existing records from primary storage. [2025-10-13T19:06:26.738756] [INFO ] [MAIN ] GCV: Loaded 7736 existing records. [2025-10-13T19:06:26.830558] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-13T19:06:26.950253] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:26.952236] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:06:26.961184] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-13T19:06:26.961414] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-13T19:06:26.962277] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-13T19:06:26.962338] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-13T19:06:27.276674] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T19:06:27.339052] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:27.617892] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-13T19:06:27.899507] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T19:06:28.212549] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T19:06:28.417942] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-13T19:06:29.218065] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-13T19:06:29.773493] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T19:06:29.920161] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T19:06:30.017970] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-13T19:06:30.817948] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-13T19:06:30.981504] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T19:06:31.244171] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T19:06:31.618004] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-13T19:06:32.190343] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T19:06:32.418007] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-13T19:06:33.217994] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-13T19:06:34.017933] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-13T19:06:34.260818] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T19:06:34.275535] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T19:06:34.640403] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T19:06:34.817965] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-13T19:06:35.617949] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-13T19:06:36.374608] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T19:06:36.381793] [INFO ] [REMOTE ] GCI: Full fetch complete (63207 records). [2025-10-13T19:06:36.381932] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-13T19:06:36.423706] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-13T19:06:36.604441] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T19:06:36.794883] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-13T19:06:36.794960] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-13T19:06:36.795733] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-13T19:06:36.795794] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-13T19:06:36.797017] [DEBUG] [LOCAL ] GCI: Trimmed 63207 records to 43935 (keeping 200 days of data) [2025-10-13T19:06:37.058359] [DEBUG] [LOCAL ] GCI: Primary data saved (43935 records). [2025-10-13T19:06:37.058498] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-13T19:06:37.058591] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCI took 36.1s. Estimated remaining: 3h 25m 45s. Rate: 7.1 symbols/min [2025-10-13T19:06:37.229692] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:37.227180] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-13T19:06:37.248871] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T19:06:37.284101] [DEBUG] [LOCAL ] GD: Loaded 47478 existing records from primary storage. [2025-10-13T19:06:37.284417] [INFO ] [MAIN ] GD: Loaded 47478 existing records. [2025-10-13T19:06:37.454438] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:37.454662] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-13T19:06:37.454721] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-13T19:06:37.455156] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-13T19:06:37.455212] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-13T19:06:37.793916] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:37.950948] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T19:06:38.017889] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-13T19:06:38.817995] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-13T19:06:39.080534] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T19:06:39.617938] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-13T19:06:40.027505] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T19:06:40.335219] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-13T19:06:40.417908] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-13T19:06:41.217931] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-13T19:06:41.606213] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T19:06:41.609302] [INFO ] [REMOTE ] GBX: Full fetch complete (42728 records). [2025-10-13T19:06:41.609383] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-13T19:06:41.975187] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-13T19:06:41.975397] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-13T19:06:41.976353] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-13T19:06:41.976419] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-13T19:06:41.977995] [DEBUG] [LOCAL ] GBX: Trimmed 42728 records to 29077 (keeping 200 days of data) [2025-10-13T19:06:42.035562] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-13T19:06:42.178177] [DEBUG] [LOCAL ] GBX: Primary data saved (29077 records). [2025-10-13T19:06:42.178427] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-13T19:06:42.178564] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GBX took 42.8s. Estimated remaining: 3h 25m 31s. Rate: 7.1 symbols/min [2025-10-13T19:06:42.356131] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:42.413714] [DEBUG] [LOCAL ] GDDY: Loaded 50527 existing records from primary storage. [2025-10-13T19:06:42.414178] [INFO ] [MAIN ] GDDY: Loaded 50527 existing records. [2025-10-13T19:06:42.624619] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T19:06:42.621742] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:42.630571] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-13T19:06:42.631191] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-13T19:06:42.632132] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-13T19:06:42.632196] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-13T19:06:42.828305] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-13T19:06:43.014366] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:43.617906] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-13T19:06:43.934870] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T19:06:44.300248] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T19:06:44.357180] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T19:06:44.417930] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-13T19:06:45.145766] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T19:06:45.217991] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-13T19:06:46.017951] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-13T19:06:46.817997] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-13T19:06:46.959953] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:06:46.981135] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T19:06:47.617972] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-13T19:06:47.890315] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T19:06:48.418002] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-13T19:06:49.087063] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T19:06:49.217894] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-13T19:06:50.017984] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-13T19:06:50.169495] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T19:06:50.648478] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T19:06:50.817936] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-13T19:06:50.949689] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:06:51.589885] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T19:06:51.591476] [INFO ] [REMOTE ] GCV: Full fetch complete (9716 records). [2025-10-13T19:06:51.591543] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-13T19:06:51.623128] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-13T19:06:51.967244] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-13T19:06:51.967340] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-13T19:06:51.967759] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-13T19:06:51.967823] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-13T19:06:51.968350] [DEBUG] [LOCAL ] GCV: Trimmed 9716 records to 7706 (keeping 200 days of data) [2025-10-13T19:06:52.017196] [DEBUG] [LOCAL ] GCV: Primary data saved (7706 records). [2025-10-13T19:06:52.017363] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-13T19:06:52.017490] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GCV took 25.5s. Estimated remaining: 3h 25m 25s. Rate: 7.1 symbols/min [2025-10-13T19:06:52.231529] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:52.236962] [DEBUG] [LOCAL ] GDIV: Loaded 3659 existing records from primary storage. [2025-10-13T19:06:52.237146] [INFO ] [MAIN ] GDIV: Loaded 3659 existing records. [2025-10-13T19:06:52.422810] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-13T19:06:52.448824] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:52.449764] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-13T19:06:52.449827] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-13T19:06:52.449987] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-13T19:06:52.450043] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-13T19:06:52.840784] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T19:06:52.875328] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:53.217981] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-13T19:06:53.940567] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T19:06:54.017935] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-13T19:06:54.382736] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T19:06:54.817924] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-13T19:06:55.120363] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-13T19:06:55.123517] [INFO ] [REMOTE ] GCTS: Full fetch complete (26890 records). [2025-10-13T19:06:55.123679] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-13T19:06:55.495702] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-13T19:06:55.495794] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-13T19:06:55.496285] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-13T19:06:55.496344] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-13T19:06:55.497001] [DEBUG] [LOCAL ] GCTS: Trimmed 26890 records to 20410 (keeping 200 days of data) [2025-10-13T19:06:55.610118] [DEBUG] [LOCAL ] GCTS: Primary data saved (20410 records). [2025-10-13T19:06:55.610251] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-13T19:06:55.610326] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GCTS took 31.7s. Estimated remaining: 3h 25m 9s. Rate: 7.1 symbols/min [2025-10-13T19:06:55.623139] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-13T19:06:55.780191] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:06:55.785168] [DEBUG] [LOCAL ] GDL: Loaded 2585 existing records from primary storage. [2025-10-13T19:06:55.785320] [INFO ] [MAIN ] GDL: Loaded 2585 existing records. [2025-10-13T19:06:55.955670] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:06:55.955890] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-13T19:06:55.955937] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-13T19:06:55.956112] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-13T19:06:55.956171] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-13T19:06:56.319544] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:06:56.314008] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T19:06:56.417899] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-13T19:06:56.570281] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-13T19:06:56.791780] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-13T19:06:57.218023] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-13T19:06:58.017974] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-13T19:06:58.482568] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T19:06:58.817973] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-13T19:06:58.865837] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T19:06:59.242781] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T19:06:59.618014] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-13T19:07:00.417986] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-13T19:07:01.217999] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-13T19:07:01.351228] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T19:07:01.785983] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T19:07:02.018013] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-13T19:07:02.388562] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T19:07:02.393218] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-13T19:07:02.821218] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-13T19:07:03.617969] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-13T19:07:04.275454] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-13T19:07:04.417981] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-13T19:07:04.576070] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T19:07:05.085578] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-13T19:07:05.217981] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-13T19:07:05.762417] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T19:07:06.017951] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-13T19:07:06.387175] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-13T19:07:06.817938] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-13T19:07:07.361828] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T19:07:07.617985] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-13T19:07:08.057180] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T19:07:08.417994] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-13T19:07:08.892707] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-13T19:07:09.217998] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-13T19:07:10.017978] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-13T19:07:10.555402] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T19:07:10.819424] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-13T19:07:10.825736] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T19:07:11.617961] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-13T19:07:12.418053] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-13T19:07:12.685624] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T19:07:12.883913] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-13T19:07:13.217940] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-13T19:07:13.283486] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:07:13.681105] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T19:07:14.017976] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-13T19:07:14.597213] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T19:07:14.817973] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-13T19:07:15.617966] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-13T19:07:16.417936] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-13T19:07:16.673389] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-13T19:07:16.989896] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-13T19:07:16.991188] [INFO ] [REMOTE ] GDL: Full fetch complete (3484 records). [2025-10-13T19:07:16.991307] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-13T19:07:17.222355] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-13T19:07:17.534996] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-13T19:07:17.535140] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-13T19:07:17.535422] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-13T19:07:17.535676] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-13T19:07:17.536366] [DEBUG] [LOCAL ] GDL: Trimmed 3484 records to 2501 (keeping 200 days of data) [2025-10-13T19:07:17.557734] [DEBUG] [LOCAL ] GDL: Primary data saved (2501 records). [2025-10-13T19:07:17.558216] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-13T19:07:17.558433] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDL took 21.9s. Estimated remaining: 3h 25m 22s. Rate: 7.1 symbols/min [2025-10-13T19:07:17.747816] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-13T19:07:17.866320] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:17.877845] [DEBUG] [LOCAL ] GDO: Loaded 5982 existing records from primary storage. [2025-10-13T19:07:17.878193] [INFO ] [MAIN ] GDO: Loaded 5982 existing records. [2025-10-13T19:07:18.023175] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-13T19:07:18.085215] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:18.085688] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-13T19:07:18.085778] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-13T19:07:18.086009] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-13T19:07:18.086067] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-13T19:07:18.474535] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:18.596067] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T19:07:18.817956] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-13T19:07:19.264464] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T19:07:19.617994] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-13T19:07:20.417936] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-13T19:07:20.508827] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T19:07:20.882884] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-13T19:07:21.217934] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-13T19:07:21.308554] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T19:07:21.833501] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T19:07:22.017992] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-13T19:07:22.817975] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-13T19:07:23.617954] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-13T19:07:23.675054] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T19:07:23.681105] [INFO ] [REMOTE ] GDDY: Full fetch complete (71832 records). [2025-10-13T19:07:23.681298] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-13T19:07:24.100744] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-13T19:07:24.100871] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-13T19:07:24.101973] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-13T19:07:24.102040] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-13T19:07:24.103749] [DEBUG] [LOCAL ] GDDY: Trimmed 71832 records to 49810 (keeping 200 days of data) [2025-10-13T19:07:24.325252] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T19:07:24.415220] [DEBUG] [LOCAL ] GDDY: Primary data saved (49810 records). [2025-10-13T19:07:24.415356] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-13T19:07:24.416280] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDDY took 42.2s. Estimated remaining: 3h 25m 11s. Rate: 7.1 symbols/min [2025-10-13T19:07:24.427619] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-13T19:07:24.599965] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:24.596673] [DEBUG] [REMOTE ] GDIV: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-13T19:07:24.600909] [WARN ] [REMOTE ] GDIV: No data returned for month 2025-10 [2025-10-13T19:07:24.601029] [FATAL] [REMOTE ] GDIV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:07:24.601239] [FATAL] [MAIN ] GDIV: Failed to fetch primary data. [2025-10-13T19:07:24.601334] [WARN ] [MAIN ] GDIV: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:07:24.601389] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-13T19:07:24.601563] [DEBUG] [LOCAL ] GDIV: No primary data file found to delete. [2025-10-13T19:07:24.601757] [INFO ] [LOCAL ] GDIV: Starting deletion of derivative data. [2025-10-13T19:07:24.611458] [DEBUG] [LOCAL ] GDIV: Deleted derivative data file. [2025-10-13T19:07:24.626733] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDIV took 32.6s. Estimated remaining: 3h 24m 50s. Rate: 7.1 symbols/min [2025-10-13T19:07:24.628840] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-13T19:07:24.831112] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:24.844452] [DEBUG] [LOCAL ] GDOT: Loaded 38316 existing records from primary storage. [2025-10-13T19:07:24.844827] [INFO ] [MAIN ] GDOT: Loaded 38316 existing records. [2025-10-13T19:07:25.028789] [DEBUG] [LOCAL ] GDV: Loaded 19886 existing records from primary storage. [2025-10-13T19:07:25.049211] [INFO ] [MAIN ] GDV: Loaded 19886 existing records. [2025-10-13T19:07:25.048875] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:25.096414] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-13T19:07:25.105491] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-13T19:07:25.129980] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-13T19:07:25.130054] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-13T19:07:25.229323] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-13T19:07:25.446010] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:25.512770] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-13T19:07:25.523996] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-13T19:07:25.549405] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-13T19:07:25.549508] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-13T19:07:25.770168] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:25.999529] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:26.017895] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-13T19:07:26.817962] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-13T19:07:26.936537] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T19:07:26.941257] [INFO ] [REMOTE ] GD: Full fetch complete (69759 records). [2025-10-13T19:07:26.941384] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-13T19:07:27.113489] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T19:07:27.388405] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-13T19:07:27.388510] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-13T19:07:27.389419] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-13T19:07:27.389487] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-13T19:07:27.391006] [DEBUG] [LOCAL ] GD: Trimmed 69759 records to 46773 (keeping 200 days of data) [2025-10-13T19:07:27.490291] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T19:07:27.624026] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-13T19:07:27.704789] [DEBUG] [LOCAL ] GD: Primary data saved (46773 records). [2025-10-13T19:07:27.704931] [INFO ] [MAIN ] GD: Full history saved. [2025-10-13T19:07:27.705024] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GD took 50.6s. Estimated remaining: 3h 24m 33s. Rate: 7.1 symbols/min [2025-10-13T19:07:27.875976] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:27.924072] [DEBUG] [LOCAL ] GE: Loaded 54486 existing records from primary storage. [2025-10-13T19:07:27.924449] [INFO ] [MAIN ] GE: Loaded 54486 existing records. [2025-10-13T19:07:28.099302] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:28.099613] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-13T19:07:28.099696] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-13T19:07:28.100942] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-13T19:07:28.101002] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-13T19:07:28.423201] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-13T19:07:28.462523] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:28.988522] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T19:07:29.050675] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-13T19:07:29.217953] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-13T19:07:30.017979] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-13T19:07:30.475069] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T19:07:30.717873] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-13T19:07:30.817907] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-13T19:07:31.507639] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T19:07:31.617976] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-13T19:07:32.418002] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-13T19:07:32.849315] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-13T19:07:33.218007] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-13T19:07:34.017908] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-13T19:07:34.584891] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-13T19:07:34.709141] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T19:07:34.739927] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T19:07:34.817959] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-13T19:07:35.617945] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-13T19:07:36.376396] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:07:36.417887] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-13T19:07:37.217887] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-13T19:07:37.702423] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T19:07:37.811689] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T19:07:37.886478] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T19:07:38.017907] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-13T19:07:38.675418] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T19:07:38.817951] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-13T19:07:39.617978] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-13T19:07:40.216335] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T19:07:40.417940] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-13T19:07:41.217984] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-13T19:07:41.577363] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-13T19:07:41.838790] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T19:07:42.017888] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-13T19:07:42.118616] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T19:07:42.817995] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-13T19:07:43.419145] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T19:07:43.617901] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-13T19:07:43.856692] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T19:07:44.417962] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-13T19:07:45.129815] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-13T19:07:45.217906] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-13T19:07:45.701741] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-13T19:07:45.826348] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T19:07:46.017945] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-13T19:07:46.817951] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-13T19:07:47.553182] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T19:07:47.617903] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-13T19:07:48.417972] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-13T19:07:49.003025] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-13T19:07:49.006925] [INFO ] [REMOTE ] GDOT: Full fetch complete (53120 records). [2025-10-13T19:07:49.007027] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-13T19:07:49.087180] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:07:49.119393] [INFO ] [REMOTE ] GDO: Full fetch complete (8639 records). [2025-10-13T19:07:49.158889] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-13T19:07:49.237304] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-13T19:07:49.602803] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-13T19:07:49.731109] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-13T19:07:49.741492] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-13T19:07:49.742352] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-13T19:07:49.742711] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-13T19:07:49.793691] [DEBUG] [LOCAL ] GDOT: Trimmed 53120 records to 37679 (keeping 200 days of data) [2025-10-13T19:07:49.821996] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-13T19:07:49.822087] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-13T19:07:49.822247] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-13T19:07:49.822322] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-13T19:07:49.823257] [DEBUG] [LOCAL ] GDO: Trimmed 8639 records to 5913 (keeping 200 days of data) [2025-10-13T19:07:49.943486] [DEBUG] [LOCAL ] GDO: Primary data saved (5913 records). [2025-10-13T19:07:49.944430] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-13T19:07:49.944844] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GDO took 32.4s. Estimated remaining: 3h 24m 47s. Rate: 7.1 symbols/min [2025-10-13T19:07:50.022748] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-13T19:07:50.137753] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:50.209923] [DEBUG] [LOCAL ] GEF: Loaded 20991 existing records from primary storage. [2025-10-13T19:07:50.242238] [INFO ] [MAIN ] GEF: Loaded 20991 existing records. [2025-10-13T19:07:50.344330] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:07:50.457503] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:50.459290] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-13T19:07:50.459928] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-13T19:07:50.461657] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-13T19:07:50.461728] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-13T19:07:50.775323] [DEBUG] [LOCAL ] GDOT: Primary data saved (37679 records). [2025-10-13T19:07:50.792874] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-13T19:07:50.803701] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GDOT took 26.4s. Estimated remaining: 3h 24m 26s. Rate: 7.1 symbols/min [2025-10-13T19:07:50.824460] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-13T19:07:50.874246] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:51.016400] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:07:51.056873] [DEBUG] [LOCAL ] GEL: Loaded 32658 existing records from primary storage. [2025-10-13T19:07:51.057214] [INFO ] [MAIN ] GEL: Loaded 32658 existing records. [2025-10-13T19:07:51.236578] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:07:51.236864] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-13T19:07:51.236912] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-13T19:07:51.237551] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-13T19:07:51.237607] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-13T19:07:51.583220] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:07:51.617889] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-13T19:07:51.956890] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T19:07:52.419241] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-13T19:07:52.419128] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-13T19:07:52.845098] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T19:07:53.217966] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-13T19:07:53.411134] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-13T19:07:54.017947] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-13T19:07:54.545564] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T19:07:54.817959] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-13T19:07:55.174776] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T19:07:55.617959] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-13T19:07:56.417939] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-13T19:07:56.729405] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T19:07:56.911944] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-13T19:07:57.217936] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-13T19:07:57.519564] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T19:07:57.945575] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T19:07:58.017882] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-13T19:07:58.817996] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-13T19:07:58.960171] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T19:07:59.617978] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-13T19:08:00.418010] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-13T19:08:01.189055] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T19:08:01.217882] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-13T19:08:01.359973] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-13T19:08:01.457034] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T19:08:01.460102] [INFO ] [REMOTE ] GDV: Full fetch complete (28432 records). [2025-10-13T19:08:01.460242] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-13T19:08:01.849896] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-13T19:08:01.849981] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-13T19:08:01.850550] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-13T19:08:01.850593] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-13T19:08:01.851264] [DEBUG] [LOCAL ] GDV: Trimmed 28432 records to 19548 (keeping 200 days of data) [2025-10-13T19:08:01.971776] [DEBUG] [LOCAL ] GDV: Primary data saved (19548 records). [2025-10-13T19:08:01.971924] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-13T19:08:01.972004] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GDV took 37.3s. Estimated remaining: 3h 24m 22s. Rate: 7.1 symbols/min [2025-10-13T19:08:02.025674] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-13T19:08:02.139582] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:02.191933] [DEBUG] [LOCAL ] GENI: Loaded 53716 existing records from primary storage. [2025-10-13T19:08:02.192270] [INFO ] [MAIN ] GENI: Loaded 53716 existing records. [2025-10-13T19:08:02.367785] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:02.368035] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-13T19:08:02.368085] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-13T19:08:02.369349] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-13T19:08:02.369418] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-13T19:08:02.748500] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:02.784306] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:08:02.817884] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-13T19:08:03.617980] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-13T19:08:04.018864] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T19:08:04.119866] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:08:04.417965] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-13T19:08:05.217946] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-13T19:08:05.295493] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T19:08:05.667342] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T19:08:06.017993] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-13T19:08:06.220034] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T19:08:06.818020] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-13T19:08:07.617970] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-13T19:08:08.237247] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-13T19:08:08.398164] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T19:08:08.417880] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-13T19:08:08.655966] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T19:08:09.217959] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-13T19:08:09.993076] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T19:08:10.018595] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-13T19:08:10.020763] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T19:08:10.026917] [INFO ] [REMOTE ] GE: Full fetch complete (77770 records). [2025-10-13T19:08:10.027078] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-13T19:08:10.472027] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-13T19:08:10.472124] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-13T19:08:10.473257] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-13T19:08:10.473331] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-13T19:08:10.474973] [DEBUG] [LOCAL ] GE: Trimmed 77770 records to 53706 (keeping 200 days of data) [2025-10-13T19:08:10.817966] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-13T19:08:10.838836] [DEBUG] [LOCAL ] GE: Primary data saved (53706 records). [2025-10-13T19:08:10.838939] [INFO ] [MAIN ] GE: Full history saved. [2025-10-13T19:08:10.839014] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GE took 43.1s. Estimated remaining: 3h 24m 14s. Rate: 7.1 symbols/min [2025-10-13T19:08:11.013624] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:11.061865] [DEBUG] [LOCAL ] GEO: Loaded 52625 existing records from primary storage. [2025-10-13T19:08:11.062212] [INFO ] [MAIN ] GEO: Loaded 52625 existing records. [2025-10-13T19:08:11.251575] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T19:08:11.255270] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:11.259453] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-13T19:08:11.260145] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-13T19:08:11.261137] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-13T19:08:11.261195] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-13T19:08:11.614493] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:11.617881] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-13T19:08:12.417907] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-13T19:08:12.600804] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T19:08:13.166042] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T19:08:13.217907] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-13T19:08:13.397115] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T19:08:14.017938] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-13T19:08:14.818028] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-13T19:08:15.129746] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T19:08:15.193897] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T19:08:15.617963] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-13T19:08:16.417935] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-13T19:08:16.494557] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:08:17.218005] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-13T19:08:17.425172] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T19:08:17.810687] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T19:08:18.017894] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-13T19:08:18.416361] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T19:08:18.817951] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-13T19:08:19.051822] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T19:08:19.617935] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-13T19:08:20.417901] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-13T19:08:20.628424] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T19:08:20.676667] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T19:08:21.217979] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-13T19:08:22.017955] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-13T19:08:22.238979] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T19:08:22.440044] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T19:08:22.817985] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-13T19:08:23.617998] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-13T19:08:23.665686] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:08:24.210320] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T19:08:24.417991] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-13T19:08:24.450201] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-13T19:08:24.454272] [INFO ] [REMOTE ] GEL: Full fetch complete (48173 records). [2025-10-13T19:08:24.454440] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-13T19:08:24.834780] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-13T19:08:24.834874] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-13T19:08:24.835581] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-13T19:08:24.835666] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-13T19:08:24.836732] [DEBUG] [LOCAL ] GEL: Trimmed 48173 records to 31996 (keeping 200 days of data) [2025-10-13T19:08:25.026378] [DEBUG] [LOCAL ] GEL: Primary data saved (31996 records). [2025-10-13T19:08:25.026521] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-13T19:08:25.027535] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GEL took 34.2s. Estimated remaining: 3h 24m 15s. Rate: 7.1 symbols/min [2025-10-13T19:08:25.195598] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:25.219052] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-13T19:08:25.236573] [DEBUG] [LOCAL ] GES: Loaded 39210 existing records from primary storage. [2025-10-13T19:08:25.236921] [INFO ] [MAIN ] GES: Loaded 39210 existing records. [2025-10-13T19:08:25.411258] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:25.411556] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-13T19:08:25.411704] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-13T19:08:25.412787] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-13T19:08:25.412857] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-13T19:08:25.760965] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:26.017905] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-13T19:08:26.279713] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T19:08:26.341437] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T19:08:26.817973] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-13T19:08:27.537576] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T19:08:27.618010] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-13T19:08:28.417902] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-13T19:08:28.613030] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T19:08:28.667406] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T19:08:29.218006] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-13T19:08:29.876449] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T19:08:30.018000] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-13T19:08:30.817970] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-13T19:08:31.181977] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-13T19:08:31.219587] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T19:08:31.617902] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-13T19:08:31.640358] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:08:31.642888] [INFO ] [REMOTE ] GEF: Full fetch complete (29301 records). [2025-10-13T19:08:31.642959] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-13T19:08:32.016586] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-13T19:08:32.016701] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-13T19:08:32.017286] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-13T19:08:32.017332] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-13T19:08:32.018231] [DEBUG] [LOCAL ] GEF: Trimmed 29301 records to 20781 (keeping 200 days of data) [2025-10-13T19:08:32.147010] [DEBUG] [LOCAL ] GEF: Primary data saved (20781 records). [2025-10-13T19:08:32.147154] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-13T19:08:32.147249] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GEF took 42.2s. Estimated remaining: 3h 24m 5s. Rate: 7.1 symbols/min [2025-10-13T19:08:32.314083] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:32.349969] [DEBUG] [LOCAL ] GETY: Loaded 35855 existing records from primary storage. [2025-10-13T19:08:32.350256] [INFO ] [MAIN ] GETY: Loaded 35855 existing records. [2025-10-13T19:08:32.423131] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-13T19:08:32.527727] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:32.527992] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-13T19:08:32.528048] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-13T19:08:32.528722] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-13T19:08:32.528782] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-13T19:08:32.871401] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:33.217886] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-13T19:08:33.404372] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T19:08:33.990549] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T19:08:34.017949] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-13T19:08:34.618915] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T19:08:34.817974] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-13T19:08:35.272548] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T19:08:35.617936] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-13T19:08:36.417951] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-13T19:08:36.815215] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-13T19:08:36.900345] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T19:08:37.217954] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-13T19:08:38.018003] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-13T19:08:38.352691] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-13T19:08:38.818011] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-13T19:08:39.120975] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-13T19:08:39.126438] [INFO ] [REMOTE ] GENI: Full fetch complete (75685 records). [2025-10-13T19:08:39.126578] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-13T19:08:39.533493] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-13T19:08:39.533592] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-13T19:08:39.534546] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-13T19:08:39.534608] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-13T19:08:39.536058] [DEBUG] [LOCAL ] GENI: Trimmed 75685 records to 52939 (keeping 200 days of data) [2025-10-13T19:08:39.621714] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-13T19:08:39.784822] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T19:08:39.904044] [DEBUG] [LOCAL ] GENI: Primary data saved (52939 records). [2025-10-13T19:08:39.904216] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-13T19:08:39.904315] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GENI took 37.9s. Estimated remaining: 3h 23m 55s. Rate: 7.1 symbols/min [2025-10-13T19:08:40.417986] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-13T19:08:40.497435] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-13T19:08:41.217894] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-13T19:08:41.363977] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T19:08:41.651716] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T19:08:42.017991] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-13T19:08:42.817898] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-13T19:08:42.916499] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T19:08:42.921797] [INFO ] [REMOTE ] GEO: Full fetch complete (75431 records). [2025-10-13T19:08:42.921910] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-13T19:08:43.312638] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-13T19:08:43.312853] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-13T19:08:43.313821] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-13T19:08:43.313930] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-13T19:08:43.315565] [DEBUG] [LOCAL ] GEO: Trimmed 75431 records to 51877 (keeping 200 days of data) [2025-10-13T19:08:43.419509] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T19:08:43.628551] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-13T19:08:43.655024] [DEBUG] [LOCAL ] GEO: Primary data saved (51877 records). [2025-10-13T19:08:43.655124] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-13T19:08:43.655203] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GEO took 32.8s. Estimated remaining: 3h 23m 39s. Rate: 7.1 symbols/min [2025-10-13T19:08:43.969959] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T19:08:44.417996] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-13T19:08:45.155522] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T19:08:45.217884] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-13T19:08:45.762800] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T19:08:46.017966] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-13T19:08:46.617451] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T19:08:46.818028] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-13T19:08:47.618242] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T19:08:47.626234] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-13T19:08:48.317909] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:08:48.417900] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-13T19:08:49.143555] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T19:08:49.217897] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-13T19:08:49.357492] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T19:08:50.018005] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-13T19:08:50.592224] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T19:08:50.817893] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-13T19:08:51.394932] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T19:08:51.398722] [INFO ] [REMOTE ] GES: Full fetch complete (58820 records). [2025-10-13T19:08:51.398825] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-13T19:08:51.777744] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-13T19:08:51.777833] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-13T19:08:51.778617] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-13T19:08:51.778701] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-13T19:08:51.779970] [DEBUG] [LOCAL ] GES: Trimmed 58820 records to 38436 (keeping 200 days of data) [2025-10-13T19:08:52.016626] [DEBUG] [LOCAL ] GES: Primary data saved (38436 records). [2025-10-13T19:08:52.016844] [INFO ] [MAIN ] GES: Full history saved. [2025-10-13T19:08:52.017571] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GES took 27.0s. Estimated remaining: 3h 23m 31s. Rate: 7.1 symbols/min [2025-10-13T19:08:52.149108] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:08:52.156454] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-13T19:08:53.639436] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T19:08:53.643200] [INFO ] [REMOTE ] GETY: Full fetch complete (55412 records). [2025-10-13T19:08:53.643345] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-13T19:08:54.014308] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-13T19:08:54.014399] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-13T19:08:54.015140] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-13T19:08:54.015205] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-13T19:08:54.016897] [DEBUG] [LOCAL ] GETY: Trimmed 55412 records to 35067 (keeping 200 days of data) [2025-10-13T19:08:54.209543] [DEBUG] [LOCAL ] GETY: Primary data saved (35067 records). [2025-10-13T19:08:54.209711] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-13T19:08:54.209801] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GETY took 22.1s. Estimated remaining: 3h 23m 13s. Rate: 7.1 symbols/min [2025-10-13T19:08:54.850383] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:54.943318] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:54.949464] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:54.977362] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:08:54.981001] [DEBUG] [LOCAL ] GF: Loaded 2802 existing records from primary storage. [2025-10-13T19:08:54.981268] [INFO ] [MAIN ] GF: Loaded 2802 existing records. [2025-10-13T19:08:55.100544] [DEBUG] [LOCAL ] GFF: Loaded 30567 existing records from primary storage. [2025-10-13T19:08:55.127833] [INFO ] [MAIN ] GFF: Loaded 30567 existing records. [2025-10-13T19:08:55.242373] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:55.311817] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-13T19:08:55.312008] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-13T19:08:55.328326] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-13T19:08:55.355703] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-13T19:08:55.515825] [DEBUG] [LOCAL ] GEV: Loaded 53780 existing records from primary storage. [2025-10-13T19:08:55.490630] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:55.536719] [INFO ] [MAIN ] GEV: Loaded 53780 existing records. [2025-10-13T19:08:55.538042] [DEBUG] [LOCAL ] GFI: Loaded 53878 existing records from primary storage. [2025-10-13T19:08:55.570728] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-13T19:08:55.571215] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-13T19:08:55.561929] [INFO ] [MAIN ] GFI: Loaded 53878 existing records. [2025-10-13T19:08:55.622338] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-13T19:08:55.656190] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-13T19:08:56.194684] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:56.218471] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-13T19:08:56.218276] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:08:56.219049] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-13T19:08:56.219166] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-13T19:08:56.225821] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-13T19:08:56.241355] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-13T19:08:56.276481] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-13T19:08:56.332782] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-13T19:08:56.381714] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-13T19:08:56.434240] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:56.488876] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-13T19:08:56.953725] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:56.986295] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-13T19:08:57.274451] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:57.303813] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:08:57.308617] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-13T19:08:57.308900] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-13T19:08:57.309550] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:08:57.312605] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-13T19:08:57.861359] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T19:08:57.862795] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-13T19:08:58.395760] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T19:08:58.407058] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-13T19:08:58.443348] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T19:08:58.444928] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-13T19:08:58.847347] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T19:08:58.857318] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-13T19:08:59.147955] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T19:08:59.563336] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-13T19:08:59.617879] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-13T19:08:59.734594] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T19:09:00.418073] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-13T19:09:01.217946] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-13T19:09:01.293502] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-13T19:09:02.017977] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-13T19:09:02.142970] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T19:09:02.143886] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T19:09:02.371949] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-13T19:09:02.818012] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-13T19:09:03.617899] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-13T19:09:03.650717] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T19:09:04.202099] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T19:09:04.417955] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-13T19:09:05.016420] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T19:09:05.217965] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-13T19:09:05.861083] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-13T19:09:06.017979] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-13T19:09:06.756098] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T19:09:06.817966] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-13T19:09:07.617940] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-13T19:09:08.074548] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-13T19:09:08.191372] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T19:09:08.417944] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-13T19:09:09.217907] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-13T19:09:09.456705] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T19:09:09.555859] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-13T19:09:10.018004] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-13T19:09:10.317794] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-13T19:09:10.707492] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-13T19:09:10.817899] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-13T19:09:11.617956] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-13T19:09:12.078740] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T19:09:12.097987] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T19:09:12.418004] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-13T19:09:13.217984] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-13T19:09:13.607937] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-13T19:09:14.017954] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-13T19:09:14.540587] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-13T19:09:14.817938] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-13T19:09:15.279422] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T19:09:15.280230] [INFO ] [REMOTE ] GF: Full fetch complete (4997 records). [2025-10-13T19:09:15.280296] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-13T19:09:15.626864] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-13T19:09:15.627191] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-13T19:09:15.627834] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-13T19:09:15.627985] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-13T19:09:15.628050] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-13T19:09:15.628442] [DEBUG] [LOCAL ] GF: Trimmed 4997 records to 2724 (keeping 200 days of data) [2025-10-13T19:09:15.645120] [DEBUG] [LOCAL ] GF: Primary data saved (2724 records). [2025-10-13T19:09:15.645185] [INFO ] [MAIN ] GF: Full history saved. [2025-10-13T19:09:15.645251] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GF took 21.4s. Estimated remaining: 3h 23m 25s. Rate: 7.1 symbols/min [2025-10-13T19:09:15.809669] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:15.859535] [DEBUG] [LOCAL ] GFL: Loaded 48588 existing records from primary storage. [2025-10-13T19:09:15.859917] [INFO ] [MAIN ] GFL: Loaded 48588 existing records. [2025-10-13T19:09:16.034174] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:16.034348] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-13T19:09:16.034415] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-13T19:09:16.034913] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-13T19:09:16.034969] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-13T19:09:16.384237] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:16.417875] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-13T19:09:16.459374] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-13T19:09:17.217885] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-13T19:09:17.661195] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T19:09:17.708569] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T19:09:18.017898] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-13T19:09:18.817957] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-13T19:09:19.300467] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-13T19:09:19.342165] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T19:09:19.617971] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-13T19:09:20.418038] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-13T19:09:20.748590] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-13T19:09:21.136028] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T19:09:21.217975] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-13T19:09:22.017955] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-13T19:09:22.701360] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T19:09:22.817884] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-13T19:09:22.939212] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-13T19:09:23.618028] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-13T19:09:23.674577] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T19:09:24.417998] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-13T19:09:24.505443] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T19:09:25.217965] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-13T19:09:25.774494] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-13T19:09:26.017959] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-13T19:09:26.379479] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T19:09:26.626689] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T19:09:26.817947] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-13T19:09:27.617957] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-13T19:09:28.204553] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-13T19:09:28.418040] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-13T19:09:28.599449] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T19:09:28.777066] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-13T19:09:29.217993] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-13T19:09:30.018008] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-13T19:09:30.755081] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-13T19:09:30.761101] [INFO ] [REMOTE ] GEV: Full fetch complete (76901 records). [2025-10-13T19:09:30.761253] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-13T19:09:30.825196] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-13T19:09:31.079946] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T19:09:31.192127] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:09:31.217798] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-13T19:09:31.218002] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-13T19:09:31.218929] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-13T19:09:31.219011] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-13T19:09:31.219125] [INFO ] [REMOTE ] GFF: Full fetch complete (44011 records). [2025-10-13T19:09:31.219316] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-13T19:09:31.319047] [DEBUG] [LOCAL ] GEV: Trimmed 76901 records to 53002 (keeping 200 days of data) [2025-10-13T19:09:31.620609] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-13T19:09:31.701947] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-13T19:09:31.702366] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-13T19:09:31.703113] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-13T19:09:31.703453] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-13T19:09:31.708354] [DEBUG] [LOCAL ] GFF: Trimmed 44011 records to 30038 (keeping 200 days of data) [2025-10-13T19:09:32.028830] [DEBUG] [LOCAL ] GFF: Primary data saved (30038 records). [2025-10-13T19:09:32.029471] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-13T19:09:32.030698] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 37.8s. Estimated remaining: 3h 23m 29s. Rate: 7.1 symbols/min [2025-10-13T19:09:32.207823] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:32.227301] [DEBUG] [LOCAL ] GFR: Loaded 8021 existing records from primary storage. [2025-10-13T19:09:32.231577] [INFO ] [MAIN ] GFR: Loaded 8021 existing records. [2025-10-13T19:09:32.480747] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:32.488489] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-13T19:09:32.489337] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-13T19:09:32.491845] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-13T19:09:32.491922] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-13T19:09:32.588890] [DEBUG] [LOCAL ] GEV: Primary data saved (53002 records). [2025-10-13T19:09:32.599607] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-13T19:09:32.600027] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GEV took 38.4s. Estimated remaining: 3h 23m 8s. Rate: 7.1 symbols/min [2025-10-13T19:09:32.960167] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:33.041033] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:33.042711] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-13T19:09:33.082886] [DEBUG] [LOCAL ] GGB: Loaded 51931 existing records from primary storage. [2025-10-13T19:09:33.083229] [INFO ] [MAIN ] GGB: Loaded 51931 existing records. [2025-10-13T19:09:33.263489] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:33.263870] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-13T19:09:33.264028] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-13T19:09:33.275800] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-13T19:09:33.290066] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-13T19:09:33.357868] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-13T19:09:33.428160] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-13T19:09:33.619765] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-13T19:09:33.708750] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:33.945135] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T19:09:34.017974] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-13T19:09:34.817968] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-13T19:09:35.615775] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:09:35.625147] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-13T19:09:35.675309] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-13T19:09:35.680982] [INFO ] [REMOTE ] GFI: Full fetch complete (76504 records). [2025-10-13T19:09:35.681098] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-13T19:09:36.067434] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-13T19:09:36.067525] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-13T19:09:36.068474] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-13T19:09:36.068542] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-13T19:09:36.069987] [DEBUG] [LOCAL ] GFI: Trimmed 76504 records to 53116 (keeping 200 days of data) [2025-10-13T19:09:36.392703] [DEBUG] [LOCAL ] GFI: Primary data saved (53116 records). [2025-10-13T19:09:36.393015] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-13T19:09:36.393136] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 42.2s. Estimated remaining: 3h 22m 53s. Rate: 7.1 symbols/min [2025-10-13T19:09:36.429115] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-13T19:09:36.569798] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:36.603570] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T19:09:36.605486] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T19:09:36.651037] [DEBUG] [LOCAL ] GGG: Loaded 41367 existing records from primary storage. [2025-10-13T19:09:36.651357] [INFO ] [MAIN ] GGG: Loaded 41367 existing records. [2025-10-13T19:09:36.822564] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:36.822828] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-13T19:09:36.822875] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-13T19:09:36.823813] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-13T19:09:36.823870] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-13T19:09:37.170310] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:37.217957] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-13T19:09:37.996536] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T19:09:38.017943] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-13T19:09:38.761798] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T19:09:38.761554] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T19:09:38.817886] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-13T19:09:39.619520] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-13T19:09:39.621896] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-13T19:09:40.417951] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-13T19:09:41.217899] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-13T19:09:41.253915] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T19:09:41.286516] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T19:09:42.018014] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-13T19:09:42.664171] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T19:09:42.802544] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-13T19:09:42.817889] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-13T19:09:43.491477] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T19:09:43.617977] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-13T19:09:44.417990] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-13T19:09:45.171944] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T19:09:45.217990] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-13T19:09:45.826487] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-13T19:09:46.017973] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-13T19:09:46.205427] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-13T19:09:46.585683] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-13T19:09:46.818012] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-13T19:09:47.617983] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-13T19:09:48.219587] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-13T19:09:48.388390] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:09:48.417893] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-13T19:09:49.217950] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-13T19:09:50.017947] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-13T19:09:50.081389] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T19:09:50.417273] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T19:09:50.422417] [INFO ] [REMOTE ] GFL: Full fetch complete (69221 records). [2025-10-13T19:09:50.422549] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-13T19:09:50.815460] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T19:09:50.835746] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-13T19:09:50.819089] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-13T19:09:50.835892] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-13T19:09:50.837213] [INFO ] [REMOTE ] GFR: Full fetch complete (12316 records). [2025-10-13T19:09:50.837335] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-13T19:09:50.838246] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-13T19:09:50.839128] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-13T19:09:50.944425] [DEBUG] [LOCAL ] GFL: Trimmed 69221 records to 47788 (keeping 200 days of data) [2025-10-13T19:09:51.320006] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-13T19:09:51.320588] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-13T19:09:51.321164] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-13T19:09:51.321519] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-13T19:09:51.325454] [DEBUG] [LOCAL ] GFR: Trimmed 12316 records to 7832 (keeping 200 days of data) [2025-10-13T19:09:51.373858] [DEBUG] [LOCAL ] GFR: Primary data saved (7832 records). [2025-10-13T19:09:51.374483] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-13T19:09:51.375164] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GFR took 19.3s. Estimated remaining: 3h 22m 54s. Rate: 7.1 symbols/min [2025-10-13T19:09:51.637882] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:51.634624] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-13T19:09:51.661575] [DEBUG] [LOCAL ] GGT: Loaded 14394 existing records from primary storage. [2025-10-13T19:09:51.662706] [INFO ] [MAIN ] GGT: Loaded 14394 existing records. [2025-10-13T19:09:51.854840] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:51.856329] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-13T19:09:51.856626] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-13T19:09:51.857519] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-13T19:09:51.857885] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-13T19:09:52.271607] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:52.273339] [DEBUG] [LOCAL ] GFL: Primary data saved (47788 records). [2025-10-13T19:09:52.273482] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-13T19:09:52.273590] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GFL took 36.6s. Estimated remaining: 3h 22m 34s. Rate: 7.1 symbols/min [2025-10-13T19:09:52.438416] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-13T19:09:52.441426] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:09:52.446511] [DEBUG] [LOCAL ] GGZ: Loaded 2465 existing records from primary storage. [2025-10-13T19:09:52.446758] [INFO ] [MAIN ] GGZ: Loaded 2465 existing records. [2025-10-13T19:09:52.625683] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:09:52.626059] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-13T19:09:52.647466] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-13T19:09:52.648137] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-13T19:09:52.648198] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-13T19:09:52.648988] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T19:09:53.009150] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:09:53.057337] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T19:09:53.217896] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-13T19:09:53.319244] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:09:53.921370] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-13T19:09:54.017965] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-13T19:09:54.817954] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-13T19:09:55.376868] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T19:09:55.617902] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-13T19:09:55.808037] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T19:09:56.084118] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T19:09:56.417938] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-13T19:09:57.217950] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-13T19:09:58.017999] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-13T19:09:58.142800] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T19:09:58.352734] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-13T19:09:58.700231] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:09:58.817894] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-13T19:09:59.617939] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-13T19:10:00.419842] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-13T19:10:00.423229] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:10:01.217944] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-13T19:10:01.284755] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:10:01.815387] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-13T19:10:02.017959] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-13T19:10:02.818005] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-13T19:10:03.486682] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T19:10:03.614835] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T19:10:03.618044] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-13T19:10:03.867167] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-13T19:10:04.417951] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-13T19:10:05.031091] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T19:10:05.217988] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-13T19:10:05.341096] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T19:10:06.018039] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-13T19:10:06.111464] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-13T19:10:06.322562] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-13T19:10:06.818047] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-13T19:10:07.618008] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-13T19:10:07.996944] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T19:10:08.137622] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-13T19:10:08.417912] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-13T19:10:09.214270] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T19:10:09.217795] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-13T19:10:10.017896] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-13T19:10:10.263300] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T19:10:10.817949] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-13T19:10:11.344957] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-13T19:10:11.617967] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-13T19:10:11.796328] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T19:10:12.417976] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-13T19:10:12.884955] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T19:10:13.148519] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T19:10:13.154377] [INFO ] [REMOTE ] GGG: Full fetch complete (59314 records). [2025-10-13T19:10:13.154606] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-13T19:10:13.223401] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-13T19:10:13.607188] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-13T19:10:13.607285] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-13T19:10:13.608190] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-13T19:10:13.608258] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-13T19:10:13.609550] [DEBUG] [LOCAL ] GGG: Trimmed 59314 records to 40761 (keeping 200 days of data) [2025-10-13T19:10:13.862270] [DEBUG] [LOCAL ] GGG: Primary data saved (40761 records). [2025-10-13T19:10:13.862411] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-13T19:10:13.862491] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGG took 37.5s. Estimated remaining: 3h 22m 46s. Rate: 7.1 symbols/min [2025-10-13T19:10:14.025553] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-13T19:10:14.028245] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:14.033521] [DEBUG] [LOCAL ] GHC: Loaded 2905 existing records from primary storage. [2025-10-13T19:10:14.033882] [INFO ] [MAIN ] GHC: Loaded 2905 existing records. [2025-10-13T19:10:14.232916] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:14.233169] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-13T19:10:14.233217] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-13T19:10:14.233442] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-13T19:10:14.233500] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-13T19:10:14.582134] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:14.817904] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-13T19:10:14.993270] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T19:10:15.033348] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T19:10:15.115452] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-13T19:10:15.617940] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-13T19:10:16.417997] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-13T19:10:16.544560] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T19:10:17.217962] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-13T19:10:17.887396] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T19:10:18.017910] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-13T19:10:18.367576] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T19:10:18.818015] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-13T19:10:18.910471] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-13T19:10:19.618032] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-13T19:10:20.416217] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-13T19:10:20.421815] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-13T19:10:20.423850] [INFO ] [REMOTE ] GGB: Full fetch complete (74145 records). [2025-10-13T19:10:20.424120] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-13T19:10:20.577325] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-13T19:10:20.883094] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-13T19:10:20.883193] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-13T19:10:20.884104] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-13T19:10:20.884173] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-13T19:10:20.885680] [DEBUG] [LOCAL ] GGB: Trimmed 74145 records to 51339 (keeping 200 days of data) [2025-10-13T19:10:21.093378] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:10:21.095730] [INFO ] [REMOTE ] GGZ: Full fetch complete (4002 records). [2025-10-13T19:10:21.096082] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-13T19:10:21.218346] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-13T19:10:21.501604] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-13T19:10:21.502297] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-13T19:10:21.503051] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-13T19:10:21.503675] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-13T19:10:21.507213] [DEBUG] [LOCAL ] GGZ: Trimmed 4002 records to 2409 (keeping 200 days of data) [2025-10-13T19:10:21.527751] [DEBUG] [LOCAL ] GGZ: Primary data saved (2409 records). [2025-10-13T19:10:21.530116] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-13T19:10:21.530549] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGZ took 29.3s. Estimated remaining: 3h 22m 37s. Rate: 7.1 symbols/min [2025-10-13T19:10:21.738866] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:21.763697] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-13T19:10:21.772853] [DEBUG] [LOCAL ] GHG: Loaded 3294 existing records from primary storage. [2025-10-13T19:10:21.774332] [INFO ] [MAIN ] GHG: Loaded 3294 existing records. [2025-10-13T19:10:21.965486] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:21.972557] [DEBUG] [LOCAL ] GGB: Primary data saved (51339 records). [2025-10-13T19:10:21.972877] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-13T19:10:21.973134] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-13T19:10:21.973253] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-13T19:10:21.973475] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GGB took 49.4s. Estimated remaining: 3h 22m 16s. Rate: 7.1 symbols/min [2025-10-13T19:10:21.973831] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-13T19:10:22.021748] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-13T19:10:22.053547] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-13T19:10:22.277234] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:22.433211] [DEBUG] [LOCAL ] GHI: Loaded 7339 existing records from primary storage. [2025-10-13T19:10:22.449911] [INFO ] [MAIN ] GHI: Loaded 7339 existing records. [2025-10-13T19:10:22.702445] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:22.722593] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:22.722783] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-13T19:10:22.722832] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-13T19:10:22.723143] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-13T19:10:22.723217] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-13T19:10:22.823068] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-13T19:10:23.088431] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:23.167768] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T19:10:23.404238] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-13T19:10:23.617941] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-13T19:10:24.417905] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-13T19:10:24.624623] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:10:24.626901] [INFO ] [REMOTE ] GGT: Full fetch complete (18819 records). [2025-10-13T19:10:24.626970] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-13T19:10:24.915145] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-13T19:10:24.999997] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-13T19:10:25.000076] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-13T19:10:25.000467] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-13T19:10:25.000505] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-13T19:10:25.001092] [DEBUG] [LOCAL ] GGT: Trimmed 18819 records to 14336 (keeping 200 days of data) [2025-10-13T19:10:25.100456] [DEBUG] [LOCAL ] GGT: Primary data saved (14336 records). [2025-10-13T19:10:25.100604] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-13T19:10:25.100705] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GGT took 33.7s. Estimated remaining: 3h 21m 59s. Rate: 7.1 symbols/min [2025-10-13T19:10:25.223002] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-13T19:10:25.271204] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:25.277283] [DEBUG] [LOCAL ] GHLD: Loaded 4263 existing records from primary storage. [2025-10-13T19:10:25.277491] [INFO ] [MAIN ] GHLD: Loaded 4263 existing records. [2025-10-13T19:10:25.457266] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:25.457492] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-13T19:10:25.457537] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-13T19:10:25.457748] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-13T19:10:25.457804] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-13T19:10:25.807059] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:26.017903] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-13T19:10:26.238930] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T19:10:26.312490] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-10-13T19:10:26.817949] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-13T19:10:27.494944] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-13T19:10:27.618013] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-13T19:10:28.110420] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T19:10:28.417965] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-13T19:10:29.111755] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-13T19:10:29.217976] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-13T19:10:29.648441] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-13T19:10:30.017972] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-13T19:10:30.602102] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T19:10:30.817973] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-13T19:10:31.297907] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-13T19:10:31.617993] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-13T19:10:32.197046] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T19:10:32.418005] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-13T19:10:33.044726] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T19:10:33.217938] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-13T19:10:33.921309] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T19:10:34.017977] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-13T19:10:34.685440] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:10:34.686635] [INFO ] [REMOTE ] GHC: Full fetch complete (3591 records). [2025-10-13T19:10:34.686737] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-13T19:10:34.823107] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-13T19:10:35.107576] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-13T19:10:35.107691] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-13T19:10:35.107955] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-13T19:10:35.108020] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-13T19:10:35.108416] [DEBUG] [LOCAL ] GHC: Trimmed 3591 records to 2904 (keeping 200 days of data) [2025-10-13T19:10:35.127054] [DEBUG] [LOCAL ] GHC: Primary data saved (2904 records). [2025-10-13T19:10:35.127139] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-13T19:10:35.127220] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHC took 21.3s. Estimated remaining: 3h 21m 53s. Rate: 7.1 symbols/min [2025-10-13T19:10:35.307688] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-13T19:10:35.311395] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:35.329613] [DEBUG] [LOCAL ] GHM: Loaded 14401 existing records from primary storage. [2025-10-13T19:10:35.329912] [INFO ] [MAIN ] GHM: Loaded 14401 existing records. [2025-10-13T19:10:35.511852] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:35.512167] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-13T19:10:35.512231] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-13T19:10:35.512521] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-13T19:10:35.512590] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-13T19:10:35.623295] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-13T19:10:35.899463] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:36.093662] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T19:10:36.417963] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-13T19:10:36.903545] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-13T19:10:37.217960] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-13T19:10:37.680382] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T19:10:38.017951] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-13T19:10:38.746930] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-13T19:10:38.817908] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-13T19:10:39.503823] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T19:10:39.617966] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-13T19:10:40.417981] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-13T19:10:40.611099] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T19:10:40.848525] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-13T19:10:41.217961] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-13T19:10:41.810067] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T19:10:42.017937] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-13T19:10:42.434781] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T19:10:42.817902] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-13T19:10:43.434149] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T19:10:43.617941] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-13T19:10:44.298627] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T19:10:44.417982] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-13T19:10:45.054321] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T19:10:45.217892] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-13T19:10:45.809857] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T19:10:45.810896] [INFO ] [REMOTE ] GHLD: Full fetch complete (4936 records). [2025-10-13T19:10:45.810984] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-13T19:10:46.023154] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-13T19:10:46.170315] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-13T19:10:46.170395] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-13T19:10:46.170551] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-13T19:10:46.170590] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-13T19:10:46.170978] [DEBUG] [LOCAL ] GHLD: Trimmed 4936 records to 4242 (keeping 200 days of data) [2025-10-13T19:10:46.196177] [DEBUG] [LOCAL ] GHLD: Primary data saved (4242 records). [2025-10-13T19:10:46.196252] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-13T19:10:46.196363] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHLD took 21.1s. Estimated remaining: 3h 21m 49s. Rate: 7.1 symbols/min [2025-10-13T19:10:46.371028] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:46.393088] [DEBUG] [LOCAL ] GHY: Loaded 21183 existing records from primary storage. [2025-10-13T19:10:46.393369] [INFO ] [MAIN ] GHY: Loaded 21183 existing records. [2025-10-13T19:10:46.572482] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:46.572815] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-13T19:10:46.572872] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-13T19:10:46.574071] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-13T19:10:46.574131] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-13T19:10:46.754524] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T19:10:46.823817] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-13T19:10:46.946806] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:47.607564] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T19:10:47.617877] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-13T19:10:48.360581] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T19:10:48.417881] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-13T19:10:49.151961] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-13T19:10:49.217908] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-13T19:10:50.017991] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-13T19:10:50.146416] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T19:10:50.817901] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-13T19:10:50.856344] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T19:10:50.857834] [INFO ] [REMOTE ] GHI: Full fetch complete (11307 records). [2025-10-13T19:10:50.857903] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-13T19:10:51.203103] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-13T19:10:51.203235] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-13T19:10:51.203539] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-13T19:10:51.203578] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-13T19:10:51.204038] [DEBUG] [LOCAL ] GHI: Trimmed 11307 records to 7235 (keeping 200 days of data) [2025-10-13T19:10:51.248195] [DEBUG] [LOCAL ] GHI: Primary data saved (7235 records). [2025-10-13T19:10:51.248325] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-13T19:10:51.248425] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHI took 29.3s. Estimated remaining: 3h 21m 35s. Rate: 7.1 symbols/min [2025-10-13T19:10:51.413246] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:10:51.446999] [DEBUG] [LOCAL ] GIB: Loaded 32258 existing records from primary storage. [2025-10-13T19:10:51.447293] [INFO ] [MAIN ] GIB: Loaded 32258 existing records. [2025-10-13T19:10:51.623286] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-13T19:10:51.626442] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:10:51.627693] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-13T19:10:51.627759] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-13T19:10:51.628572] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-13T19:10:51.628633] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-13T19:10:51.976868] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T19:10:52.007516] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:10:52.417900] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-13T19:10:52.802102] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T19:10:53.211768] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T19:10:53.217869] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-13T19:10:54.017900] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-13T19:10:54.414975] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T19:10:54.826577] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-13T19:10:54.827493] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T19:10:55.617932] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-13T19:10:56.149565] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T19:10:56.417903] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-13T19:10:56.766545] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T19:10:57.217914] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-13T19:10:57.674479] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-13T19:10:57.831932] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-13T19:10:58.017888] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-13T19:10:58.817942] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-13T19:10:59.386577] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-13T19:10:59.464117] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T19:10:59.617965] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-13T19:11:00.417988] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-13T19:11:00.967046] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T19:11:01.217933] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-13T19:11:01.558187] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T19:11:02.017980] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-13T19:11:02.325090] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T19:11:02.817961] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-13T19:11:03.301627] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-13T19:11:03.397232] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-13T19:11:03.617953] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-13T19:11:04.417958] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-13T19:11:04.441461] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-13T19:11:05.217987] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-13T19:11:05.675011] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-13T19:11:05.857121] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T19:11:06.017956] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-13T19:11:06.600990] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-13T19:11:06.817947] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-13T19:11:07.614770] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T19:11:07.617976] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-13T19:11:08.417982] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-13T19:11:08.978273] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T19:11:09.217940] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-13T19:11:09.378636] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:11:10.017983] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-13T19:11:10.376488] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-13T19:11:10.817986] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-13T19:11:11.042498] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-13T19:11:11.617900] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-13T19:11:11.910192] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T19:11:12.090768] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T19:11:12.417993] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-13T19:11:13.003411] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T19:11:13.217954] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-13T19:11:13.852796] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T19:11:13.853819] [INFO ] [REMOTE ] GHG: Full fetch complete (4145 records). [2025-10-13T19:11:13.853886] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-13T19:11:14.030918] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-13T19:11:14.218637] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-13T19:11:14.218796] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-13T19:11:14.218950] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-13T19:11:14.218988] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-13T19:11:14.219361] [DEBUG] [LOCAL ] GHG: Trimmed 4145 records to 3279 (keeping 200 days of data) [2025-10-13T19:11:14.237809] [DEBUG] [LOCAL ] GHG: Primary data saved (3279 records). [2025-10-13T19:11:14.237973] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-13T19:11:14.238090] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GHG took 52.7s. Estimated remaining: 3h 21m 50s. Rate: 7.1 symbols/min [2025-10-13T19:11:14.408246] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:14.423813] [DEBUG] [LOCAL ] GIC: Loaded 13577 existing records from primary storage. [2025-10-13T19:11:14.424025] [INFO ] [MAIN ] GIC: Loaded 13577 existing records. [2025-10-13T19:11:14.597443] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:14.597668] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-13T19:11:14.597729] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-13T19:11:14.598189] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-13T19:11:14.598247] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-13T19:11:14.823210] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-13T19:11:14.963549] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:15.092011] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T19:11:15.617947] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-13T19:11:16.363134] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T19:11:16.417943] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-13T19:11:16.532341] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-13T19:11:17.217910] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-13T19:11:17.516439] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-13T19:11:18.017945] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-13T19:11:18.466867] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-13T19:11:18.473749] [INFO ] [REMOTE ] GIB: Full fetch complete (45706 records). [2025-10-13T19:11:18.473878] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-13T19:11:18.823030] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-13T19:11:18.859096] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-13T19:11:18.859342] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-13T19:11:18.860145] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-13T19:11:18.860323] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-13T19:11:18.861418] [DEBUG] [LOCAL ] GIB: Trimmed 45706 records to 31605 (keeping 200 days of data) [2025-10-13T19:11:19.053496] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T19:11:19.075834] [DEBUG] [LOCAL ] GIB: Primary data saved (31605 records). [2025-10-13T19:11:19.075963] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-13T19:11:19.076046] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIB took 27.8s. Estimated remaining: 3h 21m 36s. Rate: 7.1 symbols/min [2025-10-13T19:11:19.247682] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:19.287143] [DEBUG] [LOCAL ] GIL: Loaded 44393 existing records from primary storage. [2025-10-13T19:11:19.287480] [INFO ] [MAIN ] GIL: Loaded 44393 existing records. [2025-10-13T19:11:19.465768] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:19.466010] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-13T19:11:19.466055] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-13T19:11:19.467187] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-13T19:11:19.467244] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-13T19:11:19.621801] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-13T19:11:19.819430] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:19.828325] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T19:11:20.418011] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-13T19:11:20.816561] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T19:11:21.217949] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-13T19:11:21.811935] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T19:11:22.017960] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-13T19:11:22.118438] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-13T19:11:22.818017] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-13T19:11:23.110765] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T19:11:23.618017] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-13T19:11:23.801099] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T19:11:24.418004] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-13T19:11:24.671095] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T19:11:24.673213] [INFO ] [REMOTE ] GHM: Full fetch complete (21997 records). [2025-10-13T19:11:24.673283] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-13T19:11:25.036254] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-13T19:11:25.036362] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-13T19:11:25.036892] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-13T19:11:25.036957] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-13T19:11:25.037514] [DEBUG] [LOCAL ] GHM: Trimmed 21997 records to 14248 (keeping 200 days of data) [2025-10-13T19:11:25.119870] [DEBUG] [LOCAL ] GHM: Primary data saved (14248 records). [2025-10-13T19:11:25.120005] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-13T19:11:25.120129] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GHM took 50.0s. Estimated remaining: 3h 21m 23s. Rate: 7.1 symbols/min [2025-10-13T19:11:25.218866] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-13T19:11:25.287547] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:25.338095] [DEBUG] [LOCAL ] GIS: Loaded 54452 existing records from primary storage. [2025-10-13T19:11:25.338460] [INFO ] [MAIN ] GIS: Loaded 54452 existing records. [2025-10-13T19:11:25.516137] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:25.516430] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-13T19:11:25.516492] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-13T19:11:25.518052] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-13T19:11:25.518136] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-13T19:11:25.871510] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:25.891603] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T19:11:26.017947] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-13T19:11:26.214757] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-13T19:11:26.817958] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-13T19:11:27.445896] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T19:11:27.617904] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-13T19:11:27.791860] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T19:11:28.418004] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-13T19:11:29.217909] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-13T19:11:29.470776] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T19:11:29.557347] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-13T19:11:30.017912] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-13T19:11:30.187099] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T19:11:30.817944] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-13T19:11:31.613022] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T19:11:31.621787] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-13T19:11:31.668313] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T19:11:32.417934] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-13T19:11:33.217898] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-13T19:11:33.416898] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T19:11:33.987176] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T19:11:34.019221] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-13T19:11:34.020958] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T19:11:34.817903] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-13T19:11:35.074026] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T19:11:35.076915] [INFO ] [REMOTE ] GHY: Full fetch complete (32345 records). [2025-10-13T19:11:35.076991] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-13T19:11:35.447848] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-13T19:11:35.447962] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-13T19:11:35.448610] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-13T19:11:35.448691] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-13T19:11:35.449715] [DEBUG] [LOCAL ] GHY: Trimmed 32345 records to 20868 (keeping 200 days of data) [2025-10-13T19:11:35.576979] [DEBUG] [LOCAL ] GHY: Primary data saved (20868 records). [2025-10-13T19:11:35.577099] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-13T19:11:35.577173] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GHY took 49.4s. Estimated remaining: 3h 21m 18s. Rate: 7.1 symbols/min [2025-10-13T19:11:35.623229] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-13T19:11:35.747083] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:35.789127] [DEBUG] [LOCAL ] GKOS: Loaded 43125 existing records from primary storage. [2025-10-13T19:11:35.789424] [INFO ] [MAIN ] GKOS: Loaded 43125 existing records. [2025-10-13T19:11:35.962009] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:35.962255] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-13T19:11:35.962301] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-13T19:11:35.963253] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-13T19:11:35.963309] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-13T19:11:36.322475] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:36.394988] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T19:11:36.417888] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-13T19:11:37.069467] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T19:11:37.217899] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-13T19:11:38.017981] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-13T19:11:38.333274] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-13T19:11:38.820256] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-13T19:11:38.840276] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-13T19:11:38.850837] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T19:11:39.617957] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-13T19:11:40.417945] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-13T19:11:40.776333] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T19:11:40.997098] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T19:11:41.217994] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-13T19:11:42.004209] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T19:11:42.017882] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-13T19:11:42.817964] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-13T19:11:43.262663] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-13T19:11:43.363862] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T19:11:43.368600] [INFO ] [REMOTE ] GIL: Full fetch complete (61936 records). [2025-10-13T19:11:43.368746] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-13T19:11:43.618722] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-13T19:11:43.589833] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T19:11:43.789120] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-13T19:11:43.789252] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-13T19:11:43.790082] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-13T19:11:43.790145] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-13T19:11:43.791409] [DEBUG] [LOCAL ] GIL: Trimmed 61936 records to 43786 (keeping 200 days of data) [2025-10-13T19:11:44.056185] [DEBUG] [LOCAL ] GIL: Primary data saved (43786 records). [2025-10-13T19:11:44.056328] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-13T19:11:44.056477] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GIL took 25.0s. Estimated remaining: 3h 21m 10s. Rate: 7.1 symbols/min [2025-10-13T19:11:44.223778] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:44.259268] [DEBUG] [LOCAL ] GL: Loaded 38358 existing records from primary storage. [2025-10-13T19:11:44.259583] [INFO ] [MAIN ] GL: Loaded 38358 existing records. [2025-10-13T19:11:44.432231] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-13T19:11:44.436816] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:44.437794] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-13T19:11:44.437847] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-13T19:11:44.438800] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-13T19:11:44.438856] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-13T19:11:44.792448] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:45.217898] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-13T19:11:45.410502] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T19:11:45.984929] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T19:11:46.017905] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-13T19:11:46.812681] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T19:11:46.820784] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-13T19:11:47.433221] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T19:11:47.617912] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-13T19:11:48.417900] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-13T19:11:48.475839] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T19:11:48.539150] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T19:11:49.217915] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-13T19:11:49.885112] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:11:50.003516] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-13T19:11:50.005148] [INFO ] [REMOTE ] GIC: Full fetch complete (19995 records). [2025-10-13T19:11:50.005217] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-13T19:11:50.025562] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-13T19:11:50.390639] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-13T19:11:50.390767] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-13T19:11:50.391343] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-13T19:11:50.391390] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-13T19:11:50.392203] [DEBUG] [LOCAL ] GIC: Trimmed 19995 records to 13429 (keeping 200 days of data) [2025-10-13T19:11:50.486358] [DEBUG] [LOCAL ] GIC: Primary data saved (13429 records). [2025-10-13T19:11:50.486527] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-13T19:11:50.486626] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GIC took 36.2s. Estimated remaining: 3h 20m 58s. Rate: 7.1 symbols/min [2025-10-13T19:11:50.653187] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:11:50.699154] [DEBUG] [LOCAL ] GLOB: Loaded 48507 existing records from primary storage. [2025-10-13T19:11:50.699495] [INFO ] [MAIN ] GLOB: Loaded 48507 existing records. [2025-10-13T19:11:50.823061] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-13T19:11:50.901784] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:11:50.902091] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-13T19:11:50.902138] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-13T19:11:50.903290] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-13T19:11:50.903347] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-13T19:11:51.247471] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:11:51.617950] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-13T19:11:52.164044] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-13T19:11:52.417952] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-13T19:11:52.976617] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-13T19:11:53.160089] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T19:11:53.217906] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-13T19:11:53.894935] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T19:11:54.017911] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-13T19:11:54.693906] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T19:11:54.817908] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-13T19:11:55.592185] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T19:11:55.617889] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-13T19:11:56.173444] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T19:11:56.417908] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-13T19:11:57.217947] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-13T19:11:57.339448] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T19:11:57.968151] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T19:11:58.017893] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-13T19:11:58.642320] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:11:58.817999] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-13T19:11:59.625130] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-13T19:11:59.627627] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T19:12:00.413003] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:12:00.421226] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-13T19:12:01.217950] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-13T19:12:01.310307] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T19:12:02.017975] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-13T19:12:02.507469] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-13T19:12:02.778940] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:12:02.817883] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-13T19:12:03.468138] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:12:03.617892] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-13T19:12:04.403562] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T19:12:04.417878] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-13T19:12:05.217901] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-13T19:12:05.292621] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T19:12:06.017907] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-13T19:12:06.110066] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:12:06.323807] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T19:12:06.329761] [INFO ] [REMOTE ] GIS: Full fetch complete (77657 records). [2025-10-13T19:12:06.329906] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-13T19:12:06.744489] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-13T19:12:06.744576] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-13T19:12:06.745482] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-13T19:12:06.745546] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-13T19:12:06.746972] [DEBUG] [LOCAL ] GIS: Trimmed 77657 records to 53672 (keeping 200 days of data) [2025-10-13T19:12:06.837372] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-13T19:12:07.084304] [DEBUG] [LOCAL ] GIS: Primary data saved (53672 records). [2025-10-13T19:12:07.084453] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-13T19:12:07.084533] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GIS took 42.0s. Estimated remaining: 3h 21m 2s. Rate: 7.1 symbols/min [2025-10-13T19:12:07.253326] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:07.264151] [DEBUG] [LOCAL ] GLP: Loaded 9370 existing records from primary storage. [2025-10-13T19:12:07.264383] [INFO ] [MAIN ] GLP: Loaded 9370 existing records. [2025-10-13T19:12:07.443180] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:07.443508] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-13T19:12:07.443576] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-13T19:12:07.443983] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-13T19:12:07.444078] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-13T19:12:07.632055] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-13T19:12:07.742091] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-13T19:12:07.843582] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:08.302266] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T19:12:08.306582] [INFO ] [REMOTE ] GKOS: Full fetch complete (60138 records). [2025-10-13T19:12:08.306721] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-13T19:12:08.423039] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-13T19:12:08.689528] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-13T19:12:08.689613] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-13T19:12:08.690400] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-13T19:12:08.690485] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-13T19:12:08.691637] [DEBUG] [LOCAL ] GKOS: Trimmed 60138 records to 42521 (keeping 200 days of data) [2025-10-13T19:12:08.939930] [DEBUG] [LOCAL ] GKOS: Primary data saved (42521 records). [2025-10-13T19:12:08.940073] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-13T19:12:08.940948] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GKOS took 33.4s. Estimated remaining: 3h 20m 44s. Rate: 7.1 symbols/min [2025-10-13T19:12:09.117235] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:09.170060] [DEBUG] [LOCAL ] GLW: Loaded 54416 existing records from primary storage. [2025-10-13T19:12:09.170535] [INFO ] [MAIN ] GLW: Loaded 54416 existing records. [2025-10-13T19:12:09.223100] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-13T19:12:09.332002] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T19:12:09.368268] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:09.371401] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-13T19:12:09.371541] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-13T19:12:09.383216] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-13T19:12:09.398047] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-13T19:12:09.452011] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T19:12:09.761781] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:10.018004] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-13T19:12:10.639227] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:12:10.817913] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-13T19:12:11.617903] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-13T19:12:11.890462] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T19:12:12.289692] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T19:12:12.417897] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-13T19:12:12.647443] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T19:12:13.206867] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:12:13.217870] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-13T19:12:14.017969] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-13T19:12:14.225212] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T19:12:14.817994] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-13T19:12:15.543590] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T19:12:15.617895] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-13T19:12:16.417991] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-13T19:12:16.925586] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-13T19:12:17.121222] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:12:17.217946] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-13T19:12:18.017911] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-13T19:12:18.057591] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T19:12:18.725832] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T19:12:18.747169] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T19:12:18.817888] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-13T19:12:19.618001] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-13T19:12:20.118750] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T19:12:20.123326] [INFO ] [REMOTE ] GL: Full fetch complete (55143 records). [2025-10-13T19:12:20.123424] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-13T19:12:20.423092] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-13T19:12:20.479787] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-13T19:12:20.518842] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-13T19:12:20.518904] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-13T19:12:20.519597] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-13T19:12:20.519635] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-13T19:12:20.520693] [DEBUG] [LOCAL ] GL: Trimmed 55143 records to 37661 (keeping 200 days of data) [2025-10-13T19:12:20.758518] [DEBUG] [LOCAL ] GL: Primary data saved (37661 records). [2025-10-13T19:12:20.758689] [INFO ] [MAIN ] GL: Full history saved. [2025-10-13T19:12:20.758782] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GL took 36.7s. Estimated remaining: 3h 20m 41s. Rate: 7.1 symbols/min [2025-10-13T19:12:20.926000] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:20.977609] [DEBUG] [LOCAL ] GM: Loaded 54509 existing records from primary storage. [2025-10-13T19:12:20.981140] [INFO ] [MAIN ] GM: Loaded 54509 existing records. [2025-10-13T19:12:21.156243] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:21.156460] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-13T19:12:21.156505] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-13T19:12:21.157267] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-13T19:12:21.157333] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-13T19:12:21.223192] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-13T19:12:21.504773] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:22.017898] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-13T19:12:22.103074] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T19:12:22.108130] [INFO ] [REMOTE ] GLOB: Full fetch complete (65026 records). [2025-10-13T19:12:22.108238] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-13T19:12:22.489221] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-13T19:12:22.489313] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-13T19:12:22.490132] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-13T19:12:22.490245] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-13T19:12:22.492107] [DEBUG] [LOCAL ] GLOB: Trimmed 65026 records to 47959 (keeping 200 days of data) [2025-10-13T19:12:22.779217] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-13T19:12:22.790151] [DEBUG] [LOCAL ] GLOB: Primary data saved (47959 records). [2025-10-13T19:12:22.790245] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-13T19:12:22.790410] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GLOB took 32.3s. Estimated remaining: 3h 20m 23s. Rate: 7.1 symbols/min [2025-10-13T19:12:22.823705] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-13T19:12:22.972839] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:23.001338] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-13T19:12:23.055954] [DEBUG] [LOCAL ] GME: Loaded 54563 existing records from primary storage. [2025-10-13T19:12:23.056324] [INFO ] [MAIN ] GME: Loaded 54563 existing records. [2025-10-13T19:12:23.232230] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:23.232464] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-13T19:12:23.232509] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-13T19:12:23.233598] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-13T19:12:23.233695] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-13T19:12:23.585430] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:23.617905] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-13T19:12:24.417946] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-13T19:12:25.084319] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-13T19:12:25.217944] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-13T19:12:26.023186] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-13T19:12:26.026585] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T19:12:26.402810] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-13T19:12:26.428424] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-13T19:12:26.817907] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-13T19:12:27.297693] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-13T19:12:27.617900] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-13T19:12:28.415474] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T19:12:28.418148] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-13T19:12:28.675382] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-13T19:12:29.217949] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-13T19:12:30.017948] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-13T19:12:30.817992] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-13T19:12:31.004635] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-13T19:12:31.204719] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T19:12:31.600906] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-13T19:12:31.617882] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-13T19:12:31.862039] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T19:12:32.375115] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-13T19:12:32.376533] [INFO ] [REMOTE ] GLP: Full fetch complete (14256 records). [2025-10-13T19:12:32.376600] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-13T19:12:32.428137] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-13T19:12:32.779867] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-13T19:12:32.779969] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-13T19:12:32.780543] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-13T19:12:32.780667] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-13T19:12:32.781239] [DEBUG] [LOCAL ] GLP: Trimmed 14256 records to 9245 (keeping 200 days of data) [2025-10-13T19:12:32.842748] [DEBUG] [LOCAL ] GLP: Primary data saved (9245 records). [2025-10-13T19:12:32.842907] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-13T19:12:32.842994] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GLP took 25.8s. Estimated remaining: 3h 20m 17s. Rate: 7.1 symbols/min [2025-10-13T19:12:33.019442] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:33.062172] [DEBUG] [LOCAL ] GMED: Loaded 49041 existing records from primary storage. [2025-10-13T19:12:33.062508] [INFO ] [MAIN ] GMED: Loaded 49041 existing records. [2025-10-13T19:12:33.226027] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-13T19:12:33.263201] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:33.263537] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-13T19:12:33.263591] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-13T19:12:33.264733] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-13T19:12:33.264818] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-13T19:12:33.636603] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:34.017996] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-13T19:12:34.817980] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-13T19:12:34.938251] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-13T19:12:35.510201] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-13T19:12:35.617881] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-13T19:12:35.827595] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-13T19:12:35.924855] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T19:12:36.417958] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-13T19:12:37.218036] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-13T19:12:37.351328] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T19:12:38.017983] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-13T19:12:38.072193] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:12:38.817915] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-13T19:12:39.093300] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T19:12:39.617966] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-13T19:12:40.421746] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-13T19:12:40.441388] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:12:40.519268] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-13T19:12:41.217900] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-13T19:12:41.625426] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-13T19:12:42.018010] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-13T19:12:42.456027] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T19:12:42.817954] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-13T19:12:43.571437] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-13T19:12:43.617986] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-13T19:12:43.674184] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:12:44.417999] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-13T19:12:45.095469] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-13T19:12:45.222192] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-13T19:12:45.594410] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-13T19:12:45.911329] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T19:12:45.918704] [INFO ] [REMOTE ] GLW: Full fetch complete (77622 records). [2025-10-13T19:12:45.918909] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-13T19:12:46.018146] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-13T19:12:46.359090] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T19:12:46.393815] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-13T19:12:46.394267] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-13T19:12:46.395766] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-13T19:12:46.395855] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-13T19:12:46.399564] [DEBUG] [LOCAL ] GLW: Trimmed 77622 records to 53636 (keeping 200 days of data) [2025-10-13T19:12:46.739257] [DEBUG] [LOCAL ] GLW: Primary data saved (53636 records). [2025-10-13T19:12:46.739404] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-13T19:12:46.740302] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GLW took 37.8s. Estimated remaining: 3h 20m 17s. Rate: 7.1 symbols/min [2025-10-13T19:12:46.823099] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-13T19:12:46.917372] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:46.957111] [DEBUG] [LOCAL ] GMRE: Loaded 37595 existing records from primary storage. [2025-10-13T19:12:46.957482] [INFO ] [MAIN ] GMRE: Loaded 37595 existing records. [2025-10-13T19:12:47.135839] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:47.136072] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-13T19:12:47.136121] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-13T19:12:47.136685] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-13T19:12:47.136757] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-13T19:12:47.500748] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:47.617947] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-13T19:12:48.417977] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-13T19:12:48.640068] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-13T19:12:48.723264] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-13T19:12:48.760747] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T19:12:49.217991] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-13T19:12:50.017912] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-13T19:12:50.115695] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T19:12:50.493087] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-13T19:12:50.817986] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-13T19:12:51.617977] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-13T19:12:52.094113] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T19:12:52.417912] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-13T19:12:52.457268] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-13T19:12:53.217951] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-13T19:12:53.641891] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-13T19:12:53.802009] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T19:12:54.018029] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-13T19:12:54.817913] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-13T19:12:55.290101] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-13T19:12:55.411725] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-13T19:12:55.617880] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-13T19:12:56.417916] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-13T19:12:56.895370] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-13T19:12:57.217982] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-13T19:12:57.998978] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T19:12:58.017881] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-13T19:12:58.087153] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-13T19:12:58.116538] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T19:12:58.123079] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-13T19:12:58.123316] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-13T19:12:58.555032] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-13T19:12:58.555155] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-13T19:12:58.556690] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-13T19:12:58.556769] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-13T19:12:58.560793] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53729 (keeping 200 days of data) [2025-10-13T19:12:58.826699] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-13T19:12:58.919309] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-13T19:12:58.919512] [INFO ] [MAIN ] GM: Full history saved. [2025-10-13T19:12:58.919670] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GM took 38.2s. Estimated remaining: 3h 20m 14s. Rate: 7.1 symbols/min [2025-10-13T19:12:59.093920] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:12:59.116053] [DEBUG] [LOCAL ] GNE: Loaded 18049 existing records from primary storage. [2025-10-13T19:12:59.116366] [INFO ] [MAIN ] GNE: Loaded 18049 existing records. [2025-10-13T19:12:59.315429] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:12:59.315747] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-13T19:12:59.315804] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-13T19:12:59.316157] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-13T19:12:59.316215] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-13T19:12:59.621427] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-13T19:12:59.695393] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:12:59.728274] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T19:13:00.417972] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-13T19:13:01.217985] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-13T19:13:01.357452] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:13:01.578929] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-13T19:13:01.734132] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T19:13:02.017916] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-13T19:13:02.245345] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T19:13:02.817958] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-13T19:13:03.617960] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-13T19:13:03.676774] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:13:03.749917] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T19:13:04.418002] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-13T19:13:05.098297] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:13:05.217892] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-13T19:13:06.018002] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-13T19:13:06.667865] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T19:13:06.813850] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T19:13:06.817945] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-13T19:13:06.874604] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-13T19:13:06.880485] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-13T19:13:06.880748] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-13T19:13:07.357668] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-13T19:13:07.357789] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-13T19:13:07.358912] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-13T19:13:07.358988] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-13T19:13:07.360781] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53783 (keeping 200 days of data) [2025-10-13T19:13:07.619419] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-13T19:13:07.790512] [DEBUG] [LOCAL ] GME: Primary data saved (53783 records). [2025-10-13T19:13:07.790754] [INFO ] [MAIN ] GME: Full history saved. [2025-10-13T19:13:07.790916] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GME took 45.0s. Estimated remaining: 3h 20m 6s. Rate: 7.1 symbols/min [2025-10-13T19:13:08.050784] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:08.097894] [DEBUG] [LOCAL ] GNK: Loaded 40846 existing records from primary storage. [2025-10-13T19:13:08.098364] [INFO ] [MAIN ] GNK: Loaded 40846 existing records. [2025-10-13T19:13:08.304443] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:08.304969] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-13T19:13:08.305110] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-13T19:13:08.313483] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-13T19:13:08.328051] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-13T19:13:08.382443] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T19:13:08.422908] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-13T19:13:08.725373] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:09.211362] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T19:13:09.217620] [INFO ] [REMOTE ] GMED: Full fetch complete (69722 records). [2025-10-13T19:13:09.217851] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-13T19:13:09.217974] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-13T19:13:09.345132] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-13T19:13:09.677210] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-13T19:13:09.677334] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-13T19:13:09.678605] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-13T19:13:09.678703] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-13T19:13:09.680346] [DEBUG] [LOCAL ] GMED: Trimmed 69722 records to 48340 (keeping 200 days of data) [2025-10-13T19:13:09.991100] [DEBUG] [LOCAL ] GMED: Primary data saved (48340 records). [2025-10-13T19:13:09.991256] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-13T19:13:09.991342] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GMED took 37.1s. Estimated remaining: 3h 19m 48s. Rate: 7.1 symbols/min [2025-10-13T19:13:10.023196] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-13T19:13:10.174320] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:10.215430] [DEBUG] [LOCAL ] GNL: Loaded 47438 existing records from primary storage. [2025-10-13T19:13:10.215818] [INFO ] [MAIN ] GNL: Loaded 47438 existing records. [2025-10-13T19:13:10.392438] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:10.393008] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-13T19:13:10.393067] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-13T19:13:10.394028] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-13T19:13:10.394088] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-13T19:13:10.759315] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:10.788354] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T19:13:10.817883] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-13T19:13:11.503671] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T19:13:11.617903] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-13T19:13:12.133315] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T19:13:12.136626] [INFO ] [REMOTE ] GMRE: Full fetch complete (52771 records). [2025-10-13T19:13:12.136770] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-13T19:13:12.423035] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-13T19:13:12.514552] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-13T19:13:12.514680] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-13T19:13:12.515474] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-13T19:13:12.515519] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-13T19:13:12.516702] [DEBUG] [LOCAL ] GMRE: Trimmed 52771 records to 37093 (keeping 200 days of data) [2025-10-13T19:13:12.756024] [DEBUG] [LOCAL ] GMRE: Primary data saved (37093 records). [2025-10-13T19:13:12.756177] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-13T19:13:12.756886] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GMRE took 26.0s. Estimated remaining: 3h 19m 31s. Rate: 7.1 symbols/min [2025-10-13T19:13:12.935717] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:12.987294] [DEBUG] [LOCAL ] GNRC: Loaded 45960 existing records from primary storage. [2025-10-13T19:13:12.987691] [INFO ] [MAIN ] GNRC: Loaded 45960 existing records. [2025-10-13T19:13:13.170759] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:13.171155] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-13T19:13:13.171315] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-13T19:13:13.172584] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-13T19:13:13.172684] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-13T19:13:13.221574] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-13T19:13:13.361694] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T19:13:13.437356] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T19:13:13.584754] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:14.018011] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-13T19:13:14.656301] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T19:13:14.817966] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-13T19:13:15.618165] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-13T19:13:15.620973] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:13:16.006838] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T19:13:16.417945] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-13T19:13:17.061023] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:13:17.217906] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-13T19:13:17.343363] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-13T19:13:18.017952] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-13T19:13:18.735187] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T19:13:18.809352] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T19:13:18.817875] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-13T19:13:19.617961] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-13T19:13:20.048404] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T19:13:20.418002] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-13T19:13:21.224548] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-13T19:13:21.228799] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T19:13:21.487565] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T19:13:22.017910] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-13T19:13:22.818030] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-13T19:13:22.820451] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T19:13:23.123677] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T19:13:23.618010] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-13T19:13:24.421073] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-13T19:13:24.423597] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T19:13:25.217951] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-13T19:13:25.280727] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:13:25.368176] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T19:13:26.017997] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-13T19:13:26.817893] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-13T19:13:26.932274] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T19:13:27.590693] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T19:13:27.617883] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-13T19:13:28.423076] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-13T19:13:28.444929] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T19:13:29.157626] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T19:13:29.217917] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-13T19:13:29.638465] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T19:13:30.017999] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-13T19:13:30.671613] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T19:13:30.817914] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-13T19:13:31.548088] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T19:13:31.617892] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-13T19:13:32.417904] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-13T19:13:32.453493] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:13:33.217915] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-13T19:13:33.263944] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:13:33.368938] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-13T19:13:33.371184] [INFO ] [REMOTE ] GNE: Full fetch complete (22460 records). [2025-10-13T19:13:33.371259] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-13T19:13:33.745677] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-13T19:13:33.745773] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-13T19:13:33.746673] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-13T19:13:33.746735] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-13T19:13:33.747326] [DEBUG] [LOCAL ] GNE: Trimmed 22460 records to 17941 (keeping 200 days of data) [2025-10-13T19:13:33.856562] [DEBUG] [LOCAL ] GNE: Primary data saved (17941 records). [2025-10-13T19:13:33.856754] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-13T19:13:33.856890] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNE took 34.9s. Estimated remaining: 3h 19m 42s. Rate: 7.1 symbols/min [2025-10-13T19:13:34.022928] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:34.023048] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-13T19:13:34.033578] [DEBUG] [LOCAL ] GNT: Loaded 8428 existing records from primary storage. [2025-10-13T19:13:34.033815] [INFO ] [MAIN ] GNT: Loaded 8428 existing records. [2025-10-13T19:13:34.220159] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:34.220436] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-13T19:13:34.220485] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-13T19:13:34.221027] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-13T19:13:34.221088] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-13T19:13:34.602410] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:34.629522] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T19:13:34.817971] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-13T19:13:35.625288] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-13T19:13:35.646223] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T19:13:35.678798] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T19:13:36.417969] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-13T19:13:37.217949] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-13T19:13:37.258846] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T19:13:38.017969] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-13T19:13:38.101771] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-13T19:13:38.712710] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T19:13:38.817961] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-13T19:13:39.436712] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:13:39.617979] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-13T19:13:40.248133] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-13T19:13:40.417963] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-13T19:13:41.218005] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-13T19:13:41.402241] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-13T19:13:41.406936] [INFO ] [REMOTE ] GNRC: Full fetch complete (65413 records). [2025-10-13T19:13:41.407076] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-13T19:13:41.794135] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-13T19:13:41.794278] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-13T19:13:41.795106] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-13T19:13:41.795210] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-13T19:13:41.796623] [DEBUG] [LOCAL ] GNRC: Trimmed 65413 records to 45346 (keeping 200 days of data) [2025-10-13T19:13:41.894136] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T19:13:41.901271] [INFO ] [REMOTE ] GNK: Full fetch complete (57244 records). [2025-10-13T19:13:41.902452] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-13T19:13:42.022457] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-13T19:13:42.322771] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-13T19:13:42.323266] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-13T19:13:42.325135] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-13T19:13:42.325576] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-13T19:13:42.332094] [DEBUG] [LOCAL ] GNK: Trimmed 57244 records to 40257 (keeping 200 days of data) [2025-10-13T19:13:42.590030] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T19:13:42.693451] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T19:13:42.772521] [DEBUG] [LOCAL ] GNRC: Primary data saved (45346 records). [2025-10-13T19:13:42.774010] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-13T19:13:42.775374] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNRC took 30.0s. Estimated remaining: 3h 19m 34s. Rate: 7.1 symbols/min [2025-10-13T19:13:42.819678] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-13T19:13:42.964902] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:42.976268] [DEBUG] [LOCAL ] GNK: Primary data saved (40257 records). [2025-10-13T19:13:42.976509] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-13T19:13:42.976625] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNK took 35.2s. Estimated remaining: 3h 19m 13s. Rate: 7.1 symbols/min [2025-10-13T19:13:43.176609] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:43.194390] [DEBUG] [LOCAL ] GNW: Loaded 52114 existing records from primary storage. [2025-10-13T19:13:43.194806] [INFO ] [MAIN ] GNW: Loaded 52114 existing records. [2025-10-13T19:13:43.391373] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:43.392248] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-13T19:13:43.392350] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-13T19:13:43.403286] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-13T19:13:43.404739] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-13T19:13:43.448953] [DEBUG] [LOCAL ] GOF: Loaded 43182 existing records from primary storage. [2025-10-13T19:13:43.486233] [INFO ] [MAIN ] GOF: Loaded 43182 existing records. [2025-10-13T19:13:43.621788] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-13T19:13:43.855301] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:43.874881] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-13T19:13:43.877002] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-13T19:13:43.883250] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-13T19:13:43.888525] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-13T19:13:44.066239] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:44.333209] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:44.375090] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T19:13:44.407573] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:13:44.417941] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-13T19:13:45.217916] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-13T19:13:45.866633] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-13T19:13:46.017874] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-13T19:13:46.108858] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T19:13:46.787837] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T19:13:46.817883] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-13T19:13:47.502802] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-13T19:13:47.617974] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-13T19:13:48.350988] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T19:13:48.417950] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-13T19:13:49.133912] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-13T19:13:49.217971] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-13T19:13:49.895910] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T19:13:50.017906] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-13T19:13:50.817947] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-13T19:13:51.487117] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T19:13:51.492744] [INFO ] [REMOTE ] GNL: Full fetch complete (68022 records). [2025-10-13T19:13:51.492920] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-13T19:13:51.623051] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-13T19:13:51.900686] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-13T19:13:51.900798] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-13T19:13:51.902016] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-13T19:13:51.902082] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-13T19:13:51.903865] [DEBUG] [LOCAL ] GNL: Trimmed 68022 records to 46678 (keeping 200 days of data) [2025-10-13T19:13:52.150568] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T19:13:52.242539] [DEBUG] [LOCAL ] GNL: Primary data saved (46678 records). [2025-10-13T19:13:52.242778] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-13T19:13:52.242897] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNL took 42.3s. Estimated remaining: 3h 19m 6s. Rate: 7.1 symbols/min [2025-10-13T19:13:52.426702] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-13T19:13:52.430730] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:52.462747] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T19:13:52.478150] [DEBUG] [LOCAL ] GOLF: Loaded 31437 existing records from primary storage. [2025-10-13T19:13:52.478560] [INFO ] [MAIN ] GOLF: Loaded 31437 existing records. [2025-10-13T19:13:52.667834] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:52.668150] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-13T19:13:52.668203] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-13T19:13:52.669159] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-13T19:13:52.669221] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-13T19:13:53.023879] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:53.217955] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-13T19:13:53.942886] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:13:54.017893] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-13T19:13:54.040517] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:13:54.042078] [INFO ] [REMOTE ] GNT: Full fetch complete (11080 records). [2025-10-13T19:13:54.042145] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-13T19:13:54.402956] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-13T19:13:54.403037] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-13T19:13:54.403319] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-13T19:13:54.403358] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-13T19:13:54.403859] [DEBUG] [LOCAL ] GNT: Trimmed 11080 records to 8395 (keeping 200 days of data) [2025-10-13T19:13:54.453135] [DEBUG] [LOCAL ] GNT: Primary data saved (8395 records). [2025-10-13T19:13:54.453273] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-13T19:13:54.453365] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GNT took 20.6s. Estimated remaining: 3h 18m 49s. Rate: 7.1 symbols/min [2025-10-13T19:13:54.625258] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:13:54.671167] [DEBUG] [LOCAL ] GOOS: Loaded 45406 existing records from primary storage. [2025-10-13T19:13:54.671571] [INFO ] [MAIN ] GOOS: Loaded 45406 existing records. [2025-10-13T19:13:54.822638] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-13T19:13:54.845802] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:13:54.846629] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-13T19:13:54.846713] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-13T19:13:54.847133] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-13T19:13:54.847171] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-13T19:13:55.196911] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:13:55.617950] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-13T19:13:55.990968] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T19:13:56.418032] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-13T19:13:56.633223] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-13T19:13:56.747406] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T19:13:57.217991] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-13T19:13:57.663731] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T19:13:58.018042] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-13T19:13:58.775474] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T19:13:58.817965] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-13T19:13:59.444860] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T19:13:59.617952] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-13T19:14:00.417912] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-13T19:14:00.569775] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T19:14:01.218265] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-13T19:14:01.667190] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-13T19:14:02.010398] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T19:14:02.019260] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-13T19:14:02.817950] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-13T19:14:02.855405] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:14:03.250525] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-13T19:14:03.618014] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-13T19:14:04.417958] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-13T19:14:04.554015] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:14:04.625773] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T19:14:05.217963] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-13T19:14:06.027121] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-13T19:14:06.029373] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T19:14:06.817985] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-13T19:14:06.945231] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-13T19:14:07.617904] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-13T19:14:07.677467] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T19:14:08.247176] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T19:14:08.417886] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-13T19:14:09.217910] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-13T19:14:09.346771] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-13T19:14:10.017988] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-13T19:14:10.180416] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T19:14:10.817909] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-13T19:14:10.878526] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T19:14:11.526933] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:14:11.617903] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-13T19:14:12.129072] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T19:14:12.417942] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-13T19:14:13.220471] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-13T19:14:13.222599] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T19:14:14.017992] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-13T19:14:14.069926] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T19:14:14.074588] [INFO ] [REMOTE ] GOF: Full fetch complete (62109 records). [2025-10-13T19:14:14.074727] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-13T19:14:14.489627] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-13T19:14:14.489751] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-13T19:14:14.490584] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-13T19:14:14.490631] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-13T19:14:14.491945] [DEBUG] [LOCAL ] GOF: Trimmed 62109 records to 42577 (keeping 200 days of data) [2025-10-13T19:14:14.759117] [DEBUG] [LOCAL ] GOF: Primary data saved (42577 records). [2025-10-13T19:14:14.759259] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-13T19:14:14.759340] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GOF took 31.8s. Estimated remaining: 3h 18m 58s. Rate: 7.1 symbols/min [2025-10-13T19:14:14.825940] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-13T19:14:14.972736] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:14.969974] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T19:14:15.016174] [DEBUG] [LOCAL ] GOTU: Loaded 38292 existing records from primary storage. [2025-10-13T19:14:15.016516] [INFO ] [MAIN ] GOTU: Loaded 38292 existing records. [2025-10-13T19:14:15.189935] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:15.190237] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-13T19:14:15.190299] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-13T19:14:15.191168] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-13T19:14:15.191227] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-13T19:14:15.573748] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:15.607587] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T19:14:15.617894] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-13T19:14:16.306366] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T19:14:16.417905] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-13T19:14:17.092065] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T19:14:17.217892] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-13T19:14:18.024745] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-13T19:14:18.030283] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:14:18.817910] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-13T19:14:18.863788] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:14:19.617904] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-13T19:14:19.775345] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-13T19:14:20.099705] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T19:14:20.417914] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-13T19:14:20.949302] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-13T19:14:21.217986] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-13T19:14:22.018021] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-13T19:14:22.059145] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:14:22.474912] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-13T19:14:22.818006] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-13T19:14:23.617904] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-13T19:14:23.725284] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T19:14:24.107158] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-13T19:14:24.417920] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-13T19:14:24.738117] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T19:14:25.217991] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-13T19:14:26.017903] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-13T19:14:26.204936] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T19:14:26.648546] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:14:26.652906] [INFO ] [REMOTE ] GOOS: Full fetch complete (64873 records). [2025-10-13T19:14:26.653022] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-13T19:14:26.825543] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-13T19:14:27.066462] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-13T19:14:27.066621] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-13T19:14:27.067494] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-13T19:14:27.067545] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-13T19:14:27.068810] [DEBUG] [LOCAL ] GOOS: Trimmed 64873 records to 44767 (keeping 200 days of data) [2025-10-13T19:14:27.297321] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-13T19:14:27.363910] [DEBUG] [LOCAL ] GOOS: Primary data saved (44767 records). [2025-10-13T19:14:27.364064] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-13T19:14:27.364146] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOOS took 32.9s. Estimated remaining: 3h 18m 56s. Rate: 7.1 symbols/min [2025-10-13T19:14:27.527812] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:27.570154] [DEBUG] [LOCAL ] GPC: Loaded 46854 existing records from primary storage. [2025-10-13T19:14:27.570536] [INFO ] [MAIN ] GPC: Loaded 46854 existing records. [2025-10-13T19:14:27.630885] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-13T19:14:27.744805] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:27.745163] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-13T19:14:27.745213] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-13T19:14:27.746616] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-13T19:14:27.746701] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-13T19:14:28.096507] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:28.141528] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T19:14:28.417983] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-13T19:14:29.217891] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-13T19:14:29.418597] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T19:14:29.629510] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T19:14:29.632697] [INFO ] [REMOTE ] GOLF: Full fetch complete (45136 records). [2025-10-13T19:14:29.632812] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-13T19:14:30.025613] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-13T19:14:30.028815] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-13T19:14:30.029812] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-13T19:14:30.030563] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-13T19:14:30.030611] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-13T19:14:30.031696] [DEBUG] [LOCAL ] GOLF: Trimmed 45136 records to 31005 (keeping 200 days of data) [2025-10-13T19:14:30.241932] [DEBUG] [LOCAL ] GOLF: Primary data saved (31005 records). [2025-10-13T19:14:30.242182] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-13T19:14:30.242422] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOLF took 38.0s. Estimated remaining: 3h 18m 39s. Rate: 7.1 symbols/min [2025-10-13T19:14:30.818001] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-13T19:14:30.896831] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T19:14:30.902404] [INFO ] [REMOTE ] GNW: Full fetch complete (73679 records). [2025-10-13T19:14:30.902592] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-13T19:14:31.327209] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-13T19:14:31.327308] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-13T19:14:31.328217] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-13T19:14:31.328306] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-13T19:14:31.329905] [DEBUG] [LOCAL ] GNW: Trimmed 73679 records to 51406 (keeping 200 days of data) [2025-10-13T19:14:31.626745] [DEBUG] [LOCAL ] GNW: Primary data saved (51406 records). [2025-10-13T19:14:31.626908] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-13T19:14:31.627809] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GNW took 48.9s. Estimated remaining: 3h 18m 20s. Rate: 7.1 symbols/min [2025-10-13T19:14:31.797261] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T19:14:31.809126] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-13T19:14:32.276567] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T19:14:32.417968] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-13T19:14:33.576324] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T19:14:33.586755] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-13T19:14:33.644215] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T19:14:34.017952] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-13T19:14:35.144353] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T19:14:35.156441] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-13T19:14:35.343005] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T19:14:35.617947] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-13T19:14:36.921290] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:14:36.932903] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-13T19:14:36.959079] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T19:14:37.217959] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-13T19:14:38.710078] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T19:14:38.748600] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T19:14:38.746493] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-13T19:14:38.818014] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-13T19:14:39.957126] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-13T19:14:39.965143] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-13T19:14:40.532246] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T19:14:40.548639] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-13T19:14:41.305450] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:14:41.309282] [INFO ] [REMOTE ] GOTU: Full fetch complete (58682 records). [2025-10-13T19:14:41.309383] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-13T19:14:41.691368] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-13T19:14:41.691462] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-13T19:14:41.692248] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-13T19:14:41.692326] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-13T19:14:41.695728] [DEBUG] [LOCAL ] GOTU: Trimmed 58682 records to 37454 (keeping 200 days of data) [2025-10-13T19:14:41.921894] [DEBUG] [LOCAL ] GOTU: Primary data saved (37454 records). [2025-10-13T19:14:41.922056] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-13T19:14:41.922143] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GOTU took 27.2s. Estimated remaining: 3h 18m 14s. Rate: 7.1 symbols/min [2025-10-13T19:14:42.312346] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T19:14:42.322345] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-13T19:14:43.931936] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:14:43.942947] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-13T19:14:45.644722] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T19:14:45.653947] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-13T19:14:47.310449] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T19:14:47.321725] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-13T19:14:48.832991] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T19:14:48.837846] [INFO ] [REMOTE ] GPC: Full fetch complete (68694 records). [2025-10-13T19:14:48.837986] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-13T19:14:49.227626] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-13T19:14:49.227753] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-13T19:14:49.228616] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-13T19:14:49.228705] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-13T19:14:49.230144] [DEBUG] [LOCAL ] GPC: Trimmed 68694 records to 46150 (keeping 200 days of data) [2025-10-13T19:14:49.515775] [DEBUG] [LOCAL ] GPC: Primary data saved (46150 records). [2025-10-13T19:14:49.515916] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-13T19:14:49.515992] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPC took 22.2s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-10-13T19:14:50.142886] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:50.184962] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:50.227798] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:50.250214] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:14:50.256157] [DEBUG] [LOCAL ] GPJA: Loaded 4306 existing records from primary storage. [2025-10-13T19:14:50.257677] [INFO ] [MAIN ] GPJA: Loaded 4306 existing records. [2025-10-13T19:14:50.352280] [DEBUG] [LOCAL ] GPI: Loaded 14872 existing records from primary storage. [2025-10-13T19:14:50.372853] [INFO ] [MAIN ] GPI: Loaded 14872 existing records. [2025-10-13T19:14:50.490082] [DEBUG] [LOCAL ] GPMT: Loaded 26136 existing records from primary storage. [2025-10-13T19:14:50.515278] [INFO ] [MAIN ] GPMT: Loaded 26136 existing records. [2025-10-13T19:14:50.556048] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:50.626170] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-13T19:14:50.640608] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-13T19:14:50.670896] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-13T19:14:50.671021] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-13T19:14:50.785908] [DEBUG] [LOCAL ] GPK: Loaded 53446 existing records from primary storage. [2025-10-13T19:14:50.858850] [INFO ] [MAIN ] GPK: Loaded 53446 existing records. [2025-10-13T19:14:50.843355] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:50.895934] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-13T19:14:50.939683] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-13T19:14:51.030975] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-13T19:14:51.076955] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:51.091254] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-13T19:14:51.120517] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-13T19:14:51.175212] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-13T19:14:51.199082] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-13T19:14:51.199206] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-13T19:14:51.424957] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:14:51.514842] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-13T19:14:51.545255] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-13T19:14:51.688686] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-13T19:14:51.808792] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-13T19:14:51.854867] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:51.925862] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-13T19:14:52.168943] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:52.249296] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-13T19:14:52.415111] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:52.433198] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-13T19:14:52.559678] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:14:52.560142] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-13T19:14:52.676886] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T19:14:52.678900] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-13T19:14:53.333623] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T19:14:53.338292] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-13T19:14:53.540960] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:14:53.566787] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-13T19:14:53.580548] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T19:14:53.591623] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-13T19:14:53.970487] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-13T19:14:53.976973] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-13T19:14:54.066430] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T19:14:54.076437] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-13T19:14:54.122277] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T19:14:54.124705] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-13T19:14:54.600804] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T19:14:54.602435] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-13T19:14:54.677092] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T19:14:54.683551] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-13T19:14:54.838542] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T19:14:54.841745] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-13T19:14:55.164730] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-13T19:14:55.590755] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T19:14:55.623025] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-13T19:14:55.634003] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T19:14:55.798888] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T19:14:56.102847] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-13T19:14:56.418004] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-13T19:14:57.217977] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-13T19:14:57.532715] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T19:14:58.017913] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-13T19:14:58.390290] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T19:14:58.663391] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-13T19:14:58.817995] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-13T19:14:59.390054] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T19:14:59.617988] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-13T19:15:00.173510] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T19:15:00.418047] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-13T19:15:01.076356] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-13T19:15:01.217981] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-13T19:15:01.932517] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T19:15:02.018031] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-13T19:15:02.818015] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-13T19:15:02.826568] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:15:02.828207] [INFO ] [REMOTE ] GPJA: Full fetch complete (7129 records). [2025-10-13T19:15:02.828371] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-13T19:15:03.263956] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-13T19:15:03.264075] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-13T19:15:03.264470] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-13T19:15:03.264514] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-13T19:15:03.265314] [DEBUG] [LOCAL ] GPJA: Trimmed 7129 records to 4251 (keeping 200 days of data) [2025-10-13T19:15:03.300843] [DEBUG] [LOCAL ] GPJA: Primary data saved (4251 records). [2025-10-13T19:15:03.301044] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-13T19:15:03.301216] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPJA took 13.8s. Estimated remaining: 3h 18m 4s. Rate: 7.1 symbols/min [2025-10-13T19:15:03.489000] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:03.547465] [DEBUG] [LOCAL ] GPN: Loaded 52784 existing records from primary storage. [2025-10-13T19:15:03.547995] [INFO ] [MAIN ] GPN: Loaded 52784 existing records. [2025-10-13T19:15:03.622413] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-13T19:15:03.736415] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:03.736807] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-13T19:15:03.736909] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-13T19:15:03.737779] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-13T19:15:03.737841] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-13T19:15:03.897457] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T19:15:04.129817] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:04.418014] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-13T19:15:05.099764] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T19:15:05.217982] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-13T19:15:06.018039] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-13T19:15:06.213947] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-13T19:15:06.480168] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-13T19:15:06.818003] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-13T19:15:07.264911] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T19:15:07.621447] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-13T19:15:07.658568] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:15:08.418049] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-13T19:15:09.187392] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T19:15:09.217991] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-13T19:15:09.319629] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T19:15:10.017950] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-13T19:15:10.653150] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T19:15:10.817967] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-13T19:15:11.019887] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T19:15:11.617976] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-13T19:15:12.417991] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-13T19:15:12.560064] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T19:15:12.925938] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T19:15:13.217911] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-13T19:15:13.474591] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-13T19:15:13.476710] [INFO ] [REMOTE ] GPI: Full fetch complete (21296 records). [2025-10-13T19:15:13.476780] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-13T19:15:13.836693] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-13T19:15:13.836811] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-13T19:15:13.837236] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-13T19:15:13.837278] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-13T19:15:13.837867] [DEBUG] [LOCAL ] GPI: Trimmed 21296 records to 14798 (keeping 200 days of data) [2025-10-13T19:15:13.931101] [DEBUG] [LOCAL ] GPI: Primary data saved (14798 records). [2025-10-13T19:15:13.931238] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-13T19:15:13.931347] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPI took 24.4s. Estimated remaining: 3h 17m 59s. Rate: 7.1 symbols/min [2025-10-13T19:15:14.020221] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-13T19:15:14.124071] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:14.154283] [DEBUG] [LOCAL ] GPOR: Loaded 23651 existing records from primary storage. [2025-10-13T19:15:14.154547] [INFO ] [MAIN ] GPOR: Loaded 23651 existing records. [2025-10-13T19:15:14.332268] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:14.344511] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-13T19:15:14.345101] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-13T19:15:14.345519] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T19:15:14.347262] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-13T19:15:14.350668] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-13T19:15:14.700338] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:14.817904] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-13T19:15:15.617902] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-13T19:15:15.653764] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T19:15:15.709639] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T19:15:16.417908] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-13T19:15:16.616138] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T19:15:17.217990] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-13T19:15:17.807388] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T19:15:18.017996] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-13T19:15:18.818132] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-13T19:15:18.997858] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T19:15:19.112867] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T19:15:19.617955] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-13T19:15:19.994244] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-13T19:15:20.417902] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-13T19:15:20.629515] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:15:20.631878] [INFO ] [REMOTE ] GPMT: Full fetch complete (36821 records). [2025-10-13T19:15:20.631955] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-13T19:15:21.021522] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-13T19:15:21.021618] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-13T19:15:21.022236] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-13T19:15:21.022291] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-13T19:15:21.023230] [DEBUG] [LOCAL ] GPMT: Trimmed 36821 records to 25859 (keeping 200 days of data) [2025-10-13T19:15:21.176254] [DEBUG] [LOCAL ] GPMT: Primary data saved (25859 records). [2025-10-13T19:15:21.176395] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-13T19:15:21.176490] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPMT took 31.6s. Estimated remaining: 3h 17m 49s. Rate: 7.1 symbols/min [2025-10-13T19:15:21.223065] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-13T19:15:21.359116] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:21.397797] [DEBUG] [LOCAL ] GPRK: Loaded 40024 existing records from primary storage. [2025-10-13T19:15:21.398204] [INFO ] [MAIN ] GPRK: Loaded 40024 existing records. [2025-10-13T19:15:21.585968] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:21.586204] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-13T19:15:21.586253] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-13T19:15:21.586610] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-13T19:15:21.586707] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-13T19:15:21.914440] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:15:21.985697] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:22.017890] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-13T19:15:22.817911] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-13T19:15:23.021055] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:15:23.323535] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:15:23.618022] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-13T19:15:24.237616] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T19:15:24.417967] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-13T19:15:24.803000] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-13T19:15:25.217955] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-13T19:15:25.956500] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T19:15:26.017915] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-13T19:15:26.275060] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T19:15:26.817968] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-13T19:15:27.477681] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T19:15:27.617899] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-13T19:15:27.863140] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T19:15:28.418014] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-13T19:15:29.217964] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-13T19:15:29.435871] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T19:15:29.512394] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T19:15:30.018004] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-13T19:15:30.817907] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-13T19:15:30.972509] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:15:31.418908] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T19:15:31.617982] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-13T19:15:32.260017] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:15:32.417946] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-13T19:15:33.217948] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-13T19:15:33.418755] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T19:15:33.870887] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T19:15:34.017994] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-13T19:15:34.817971] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-13T19:15:35.010838] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T19:15:35.164612] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T19:15:35.617963] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-13T19:15:36.418000] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-13T19:15:36.570737] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T19:15:37.217917] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-13T19:15:37.349862] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:15:37.899394] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T19:15:38.017917] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-13T19:15:38.618214] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T19:15:38.623460] [INFO ] [REMOTE ] GPN: Full fetch complete (74930 records). [2025-10-13T19:15:38.623612] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-13T19:15:38.826795] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-13T19:15:39.011611] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-13T19:15:39.011732] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-13T19:15:39.012636] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-13T19:15:39.012719] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-13T19:15:39.014170] [DEBUG] [LOCAL ] GPN: Trimmed 74930 records to 52044 (keeping 200 days of data) [2025-10-13T19:15:39.349521] [DEBUG] [LOCAL ] GPN: Primary data saved (52044 records). [2025-10-13T19:15:39.349701] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-13T19:15:39.350510] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 36.0s. Estimated remaining: 3h 17m 55s. Rate: 7.1 symbols/min [2025-10-13T19:15:39.523913] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:39.549168] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T19:15:39.582860] [DEBUG] [LOCAL ] GRBK: Loaded 27490 existing records from primary storage. [2025-10-13T19:15:39.583159] [INFO ] [MAIN ] GRBK: Loaded 27490 existing records. [2025-10-13T19:15:39.627214] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-13T19:15:39.770894] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:39.771148] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-13T19:15:39.771206] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-13T19:15:39.771518] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-13T19:15:39.771559] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-13T19:15:40.146855] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:40.417904] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-13T19:15:40.723052] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-13T19:15:40.928127] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T19:15:41.217990] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-13T19:15:41.842236] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:15:42.017985] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-13T19:15:42.549249] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T19:15:42.817915] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-13T19:15:43.311334] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T19:15:43.314256] [INFO ] [REMOTE ] GPOR: Full fetch complete (35072 records). [2025-10-13T19:15:43.314334] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-13T19:15:43.623184] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-13T19:15:43.683407] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-13T19:15:43.683752] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-13T19:15:43.684512] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-13T19:15:43.684573] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-13T19:15:43.685579] [DEBUG] [LOCAL ] GPOR: Trimmed 35072 records to 23188 (keeping 200 days of data) [2025-10-13T19:15:43.824459] [DEBUG] [LOCAL ] GPOR: Primary data saved (23188 records). [2025-10-13T19:15:43.824614] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-13T19:15:43.824728] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPOR took 29.9s. Estimated remaining: 3h 17m 40s. Rate: 7.1 symbols/min [2025-10-13T19:15:43.999523] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:44.012530] [DEBUG] [LOCAL ] GRC: Loaded 9381 existing records from primary storage. [2025-10-13T19:15:44.012796] [INFO ] [MAIN ] GRC: Loaded 9381 existing records. [2025-10-13T19:15:44.144808] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T19:15:44.239458] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:44.239752] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-13T19:15:44.239806] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-13T19:15:44.240025] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-13T19:15:44.240097] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-13T19:15:44.426671] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-13T19:15:44.636415] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:45.172167] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T19:15:45.217893] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-13T19:15:46.017913] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-13T19:15:46.152928] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T19:15:46.158412] [INFO ] [REMOTE ] GPK: Full fetch complete (75648 records). [2025-10-13T19:15:46.158572] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-13T19:15:46.549163] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-13T19:15:46.549523] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-13T19:15:46.550573] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-13T19:15:46.550635] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-13T19:15:46.552209] [DEBUG] [LOCAL ] GPK: Trimmed 75648 records to 52741 (keeping 200 days of data) [2025-10-13T19:15:46.797571] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T19:15:46.818210] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-13T19:15:46.912399] [DEBUG] [LOCAL ] GPK: Primary data saved (52741 records). [2025-10-13T19:15:46.912617] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-13T19:15:46.912863] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GPK took 57.4s. Estimated remaining: 3h 17m 24s. Rate: 7.1 symbols/min [2025-10-13T19:15:47.035705] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T19:15:47.112413] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:47.134887] [DEBUG] [LOCAL ] GRDN: Loaded 21246 existing records from primary storage. [2025-10-13T19:15:47.135173] [INFO ] [MAIN ] GRDN: Loaded 21246 existing records. [2025-10-13T19:15:47.313595] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:47.313948] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-13T19:15:47.313997] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-13T19:15:47.314318] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-13T19:15:47.314379] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-13T19:15:47.620043] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-13T19:15:47.674503] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T19:15:47.695702] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:48.417921] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-13T19:15:48.935972] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-13T19:15:49.217913] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-13T19:15:49.265523] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T19:15:50.017920] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-13T19:15:50.440046] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T19:15:50.444533] [INFO ] [REMOTE ] GPRK: Full fetch complete (57802 records). [2025-10-13T19:15:50.444639] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-13T19:15:50.822677] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-13T19:15:50.833193] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-13T19:15:50.833358] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-13T19:15:50.836358] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-13T19:15:50.837213] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-13T19:15:50.837276] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-13T19:15:50.838882] [DEBUG] [LOCAL ] GPRK: Trimmed 57802 records to 39556 (keeping 200 days of data) [2025-10-13T19:15:51.061680] [DEBUG] [LOCAL ] GPRK: Primary data saved (39556 records). [2025-10-13T19:15:51.061822] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-13T19:15:51.061898] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GPRK took 29.9s. Estimated remaining: 3h 17m 10s. Rate: 7.1 symbols/min [2025-10-13T19:15:51.228705] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:15:51.265497] [DEBUG] [LOCAL ] GRMN: Loaded 41183 existing records from primary storage. [2025-10-13T19:15:51.265873] [INFO ] [MAIN ] GRMN: Loaded 41183 existing records. [2025-10-13T19:15:51.442424] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:15:51.442678] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-13T19:15:51.442746] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-13T19:15:51.443299] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-13T19:15:51.443360] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-13T19:15:51.623005] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-13T19:15:51.804134] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:15:52.158675] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T19:15:52.418080] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-13T19:15:52.709169] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T19:15:53.217888] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-13T19:15:53.626101] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T19:15:54.017916] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-13T19:15:54.042871] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T19:15:54.817978] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-13T19:15:55.256519] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-13T19:15:55.611994] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-13T19:15:55.617875] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-13T19:15:56.358341] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-13T19:15:56.417989] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-13T19:15:57.217903] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-13T19:15:57.280915] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-13T19:15:58.017901] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-13T19:15:58.164579] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-13T19:15:58.817966] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-13T19:15:58.835431] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-13T19:15:59.617948] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-13T19:15:59.982577] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T19:16:00.327953] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-13T19:16:00.417945] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-13T19:16:01.217908] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-13T19:16:01.282022] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T19:16:02.018034] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-13T19:16:02.820476] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-13T19:16:02.831260] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:16:03.055816] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T19:16:03.617985] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-13T19:16:03.798063] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T19:16:04.417949] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-13T19:16:05.217997] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-13T19:16:05.271614] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:16:05.325418] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T19:16:05.990215] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T19:16:06.017963] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-13T19:16:06.817904] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-13T19:16:07.205263] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T19:16:07.541279] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-13T19:16:07.617963] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-13T19:16:08.377159] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T19:16:08.417891] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-13T19:16:09.217912] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-13T19:16:09.291623] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-13T19:16:09.293790] [INFO ] [REMOTE ] GRC: Full fetch complete (13252 records). [2025-10-13T19:16:09.293899] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-13T19:16:09.708227] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-13T19:16:09.708310] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-13T19:16:09.708601] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-13T19:16:09.708639] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-13T19:16:09.709162] [DEBUG] [LOCAL ] GRC: Trimmed 13252 records to 9233 (keeping 200 days of data) [2025-10-13T19:16:09.769711] [DEBUG] [LOCAL ] GRC: Primary data saved (9233 records). [2025-10-13T19:16:09.769888] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-13T19:16:09.769987] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRC took 25.9s. Estimated remaining: 3h 17m 16s. Rate: 7.1 symbols/min [2025-10-13T19:16:09.942764] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:09.993805] [DEBUG] [LOCAL ] GRND: Loaded 50718 existing records from primary storage. [2025-10-13T19:16:09.994178] [INFO ] [MAIN ] GRND: Loaded 50718 existing records. [2025-10-13T19:16:10.023214] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-13T19:16:10.173543] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:10.173885] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-13T19:16:10.173933] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-13T19:16:10.174434] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-13T19:16:10.174489] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-13T19:16:10.460473] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T19:16:10.543116] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:10.818002] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-13T19:16:11.617913] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-13T19:16:11.751525] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-13T19:16:12.417958] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-13T19:16:12.449278] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T19:16:12.980846] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T19:16:12.984272] [INFO ] [REMOTE ] GRBK: Full fetch complete (40500 records). [2025-10-13T19:16:12.984353] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-13T19:16:13.228849] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-13T19:16:13.369682] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-13T19:16:13.369781] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-13T19:16:13.370546] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-13T19:16:13.370606] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-13T19:16:13.371565] [DEBUG] [LOCAL ] GRBK: Trimmed 40500 records to 27134 (keeping 200 days of data) [2025-10-13T19:16:13.472149] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T19:16:13.550949] [DEBUG] [LOCAL ] GRBK: Primary data saved (27134 records). [2025-10-13T19:16:13.551104] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-13T19:16:13.551190] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRBK took 34.2s. Estimated remaining: 3h 17m 1s. Rate: 7.1 symbols/min [2025-10-13T19:16:13.725159] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:13.760111] [DEBUG] [LOCAL ] GRNT: Loaded 34422 existing records from primary storage. [2025-10-13T19:16:13.760393] [INFO ] [MAIN ] GRNT: Loaded 34422 existing records. [2025-10-13T19:16:13.949864] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:13.950142] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-13T19:16:13.950190] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-13T19:16:13.950552] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-13T19:16:13.950611] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-13T19:16:14.025137] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-13T19:16:14.309706] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:14.823939] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-13T19:16:14.845432] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-13T19:16:15.060636] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T19:16:15.617960] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-13T19:16:16.258748] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T19:16:16.417969] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-13T19:16:17.154996] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T19:16:17.218010] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-13T19:16:17.712777] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T19:16:18.017974] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-13T19:16:18.817903] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-13T19:16:18.966420] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T19:16:19.352184] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:16:19.617961] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-13T19:16:20.427882] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-13T19:16:20.433156] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:16:20.778945] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T19:16:21.217958] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-13T19:16:21.646847] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T19:16:21.649814] [INFO ] [REMOTE ] GRDN: Full fetch complete (26217 records). [2025-10-13T19:16:21.649908] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-13T19:16:22.023720] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-13T19:16:22.026526] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-13T19:16:22.026617] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-13T19:16:22.027245] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-13T19:16:22.027412] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-13T19:16:22.028212] [DEBUG] [LOCAL ] GRDN: Trimmed 26217 records to 20887 (keeping 200 days of data) [2025-10-13T19:16:22.151326] [DEBUG] [LOCAL ] GRDN: Primary data saved (20887 records). [2025-10-13T19:16:22.151465] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-13T19:16:22.151543] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRDN took 35.2s. Estimated remaining: 3h 16m 53s. Rate: 7.1 symbols/min [2025-10-13T19:16:22.320477] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:22.331529] [DEBUG] [LOCAL ] GROV: Loaded 8934 existing records from primary storage. [2025-10-13T19:16:22.331771] [INFO ] [MAIN ] GROV: Loaded 8934 existing records. [2025-10-13T19:16:22.509618] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:22.509862] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-13T19:16:22.509908] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-13T19:16:22.510145] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-13T19:16:22.510197] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-13T19:16:22.823081] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-13T19:16:22.904305] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:22.990133] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T19:16:23.617984] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-13T19:16:23.699436] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T19:16:24.238815] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-13T19:16:24.254430] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-13T19:16:24.417969] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-13T19:16:25.217997] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-13T19:16:25.826442] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T19:16:26.017973] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-13T19:16:26.704202] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:16:26.817972] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-13T19:16:26.917856] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T19:16:27.618029] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-13T19:16:28.288251] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-13T19:16:28.319549] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T19:16:28.417914] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-13T19:16:29.217985] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-13T19:16:30.017987] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-13T19:16:30.189076] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T19:16:30.470230] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T19:16:30.817896] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-13T19:16:31.255227] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-13T19:16:31.617911] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-13T19:16:32.202323] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T19:16:32.417965] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-13T19:16:32.624942] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T19:16:33.217955] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-13T19:16:33.678403] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T19:16:34.018149] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-13T19:16:34.054443] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T19:16:34.817950] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-13T19:16:35.534395] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:16:35.600588] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T19:16:35.617897] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-13T19:16:36.417893] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-13T19:16:36.803269] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-13T19:16:37.217913] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-13T19:16:38.020104] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-13T19:16:38.022882] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:16:38.094510] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T19:16:38.813603] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T19:16:38.817889] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-13T19:16:39.617960] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-13T19:16:40.345265] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T19:16:40.368296] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T19:16:40.417943] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-13T19:16:41.217982] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-13T19:16:41.528348] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T19:16:42.017971] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-13T19:16:42.759074] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T19:16:42.763106] [INFO ] [REMOTE ] GRMN: Full fetch complete (59599 records). [2025-10-13T19:16:42.763277] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-13T19:16:42.824945] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-13T19:16:43.212467] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-13T19:16:43.212350] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T19:16:43.212680] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-13T19:16:43.220424] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-13T19:16:43.220681] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-13T19:16:43.222989] [DEBUG] [LOCAL ] GRMN: Trimmed 59599 records to 40513 (keeping 200 days of data) [2025-10-13T19:16:43.476561] [DEBUG] [LOCAL ] GRMN: Primary data saved (40513 records). [2025-10-13T19:16:43.476725] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-13T19:16:43.476879] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRMN took 52.4s. Estimated remaining: 3h 17m 3s. Rate: 7.1 symbols/min [2025-10-13T19:16:43.623097] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-13T19:16:43.705834] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:43.714448] [DEBUG] [LOCAL ] GRX: Loaded 4825 existing records from primary storage. [2025-10-13T19:16:43.714724] [INFO ] [MAIN ] GRX: Loaded 4825 existing records. [2025-10-13T19:16:43.924029] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:43.924293] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-13T19:16:43.924343] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-13T19:16:43.924801] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-13T19:16:43.924862] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-13T19:16:44.298060] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:44.417967] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-13T19:16:44.511479] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T19:16:45.010942] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T19:16:45.051030] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:16:45.054725] [INFO ] [REMOTE ] GRNT: Full fetch complete (48252 records). [2025-10-13T19:16:45.054815] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-13T19:16:45.221423] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-13T19:16:45.443040] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-13T19:16:45.443127] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-13T19:16:45.443825] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-13T19:16:45.443887] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-13T19:16:45.445012] [DEBUG] [LOCAL ] GRNT: Trimmed 48252 records to 33945 (keeping 200 days of data) [2025-10-13T19:16:45.641259] [DEBUG] [LOCAL ] GRNT: Primary data saved (33945 records). [2025-10-13T19:16:45.641407] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-13T19:16:45.642195] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRNT took 32.1s. Estimated remaining: 3h 16m 45s. Rate: 7.1 symbols/min [2025-10-13T19:16:45.812458] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:45.869327] [DEBUG] [LOCAL ] GS: Loaded 52532 existing records from primary storage. [2025-10-13T19:16:45.869811] [INFO ] [MAIN ] GS: Loaded 52532 existing records. [2025-10-13T19:16:46.018555] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-13T19:16:46.058411] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:46.067063] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-13T19:16:46.067291] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-13T19:16:46.069977] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-13T19:16:46.069904] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T19:16:46.070329] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-13T19:16:46.426268] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:46.707516] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T19:16:46.817895] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-13T19:16:47.460046] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T19:16:47.617975] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-13T19:16:48.269612] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T19:16:48.271431] [INFO ] [REMOTE ] GROV: Full fetch complete (14078 records). [2025-10-13T19:16:48.271511] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-13T19:16:48.428074] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-13T19:16:48.655058] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-13T19:16:48.655151] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-13T19:16:48.655761] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-13T19:16:48.655827] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-13T19:16:48.656381] [DEBUG] [LOCAL ] GROV: Trimmed 14078 records to 8755 (keeping 200 days of data) [2025-10-13T19:16:48.712097] [DEBUG] [LOCAL ] GROV: Primary data saved (8755 records). [2025-10-13T19:16:48.712262] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-13T19:16:48.712359] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GROV took 26.6s. Estimated remaining: 3h 16m 29s. Rate: 7.1 symbols/min [2025-10-13T19:16:48.885698] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:48.931189] [DEBUG] [LOCAL ] GSBD: Loaded 40105 existing records from primary storage. [2025-10-13T19:16:48.931583] [INFO ] [MAIN ] GSBD: Loaded 40105 existing records. [2025-10-13T19:16:49.110184] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:49.110450] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-13T19:16:49.110501] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-13T19:16:49.111004] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-13T19:16:49.111063] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-13T19:16:49.223070] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-13T19:16:49.482825] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:49.764457] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T19:16:50.017982] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-13T19:16:50.271091] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T19:16:50.276826] [INFO ] [REMOTE ] GRND: Full fetch complete (71247 records). [2025-10-13T19:16:50.276954] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-13T19:16:50.592282] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T19:16:50.687030] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-13T19:16:50.687118] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-13T19:16:50.688283] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-13T19:16:50.688350] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-13T19:16:50.690848] [DEBUG] [LOCAL ] GRND: Trimmed 71247 records to 50041 (keeping 200 days of data) [2025-10-13T19:16:50.862617] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-13T19:16:51.018496] [DEBUG] [LOCAL ] GRND: Primary data saved (50041 records). [2025-10-13T19:16:51.018699] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-13T19:16:51.018826] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GRND took 41.2s. Estimated remaining: 3h 16m 12s. Rate: 7.1 symbols/min [2025-10-13T19:16:51.188969] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:16:51.245034] [DEBUG] [LOCAL ] GSK: Loaded 54280 existing records from primary storage. [2025-10-13T19:16:51.245444] [INFO ] [MAIN ] GSK: Loaded 54280 existing records. [2025-10-13T19:16:51.428370] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:16:51.428621] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-13T19:16:51.428702] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-13T19:16:51.429455] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-13T19:16:51.429518] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-13T19:16:51.624325] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-13T19:16:51.801766] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:16:52.296697] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-13T19:16:52.417901] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-13T19:16:52.490686] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T19:16:53.217967] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-13T19:16:54.017951] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-13T19:16:54.175618] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T19:16:54.574912] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-13T19:16:54.675918] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T19:16:54.818028] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-13T19:16:55.618035] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-13T19:16:56.228354] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T19:16:56.417968] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-13T19:16:56.702080] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-13T19:16:57.013178] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T19:16:57.217957] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-13T19:16:58.017986] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-13T19:16:58.817919] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-13T19:16:58.983848] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-13T19:16:59.617952] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-13T19:16:59.916638] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T19:17:00.335136] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:17:00.417958] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-13T19:17:01.217981] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-13T19:17:01.425260] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T19:17:01.836412] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-13T19:17:02.018015] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-13T19:17:02.154374] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:17:02.817990] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-13T19:17:03.617952] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-13T19:17:04.282880] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-13T19:17:04.417984] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-13T19:17:04.677537] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T19:17:05.180323] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T19:17:05.184381] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T19:17:05.217885] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-13T19:17:06.017910] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-13T19:17:06.595883] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T19:17:06.818007] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-13T19:17:07.487782] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:17:07.617993] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-13T19:17:08.116056] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:17:08.418002] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-13T19:17:09.217918] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-13T19:17:09.617864] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T19:17:10.017975] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-13T19:17:10.414087] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T19:17:10.451759] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T19:17:10.817980] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-13T19:17:11.617969] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-13T19:17:12.287550] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:17:12.291517] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-13T19:17:12.291660] [INFO ] [REMOTE ] GRX: Full fetch complete (6525 records). [2025-10-13T19:17:12.291842] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-13T19:17:12.420326] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-13T19:17:12.678803] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-13T19:17:12.679025] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-13T19:17:12.679284] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-13T19:17:12.679364] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-13T19:17:12.680013] [DEBUG] [LOCAL ] GRX: Trimmed 6525 records to 4762 (keeping 200 days of data) [2025-10-13T19:17:12.709455] [DEBUG] [LOCAL ] GRX: Primary data saved (4762 records). [2025-10-13T19:17:12.709577] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-13T19:17:12.709723] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GRX took 29.2s. Estimated remaining: 3h 16m 23s. Rate: 7.1 symbols/min [2025-10-13T19:17:12.883151] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:12.919237] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-13T19:17:12.963795] [DEBUG] [LOCAL ] GSL: Loaded 33733 existing records from primary storage. [2025-10-13T19:17:12.964123] [INFO ] [MAIN ] GSL: Loaded 33733 existing records. [2025-10-13T19:17:13.140275] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:13.140525] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-13T19:17:13.140578] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-13T19:17:13.141097] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-13T19:17:13.141173] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-13T19:17:13.223022] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-13T19:17:13.507748] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:14.017972] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-13T19:17:14.051383] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T19:17:14.817961] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-13T19:17:15.169157] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-13T19:17:15.304536] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T19:17:15.617972] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-13T19:17:16.417914] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-13T19:17:16.755387] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-13T19:17:17.217907] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-13T19:17:17.739289] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-13T19:17:17.776770] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T19:17:18.017997] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-13T19:17:18.817981] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-13T19:17:19.239739] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-13T19:17:19.289039] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T19:17:19.618049] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-13T19:17:20.417907] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-13T19:17:20.852059] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-13T19:17:21.012364] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T19:17:21.217906] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-13T19:17:21.666104] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T19:17:22.018020] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-13T19:17:22.817984] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-13T19:17:23.617963] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-13T19:17:23.745701] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-13T19:17:24.071920] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-13T19:17:24.261072] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T19:17:24.266482] [INFO ] [REMOTE ] GSBD: Full fetch complete (58567 records). [2025-10-13T19:17:24.266637] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-13T19:17:24.423994] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-13T19:17:24.665032] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-13T19:17:24.665144] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-13T19:17:24.666019] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-13T19:17:24.666083] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-13T19:17:24.667420] [DEBUG] [LOCAL ] GSBD: Trimmed 58567 records to 39619 (keeping 200 days of data) [2025-10-13T19:17:24.926095] [DEBUG] [LOCAL ] GSBD: Primary data saved (39619 records). [2025-10-13T19:17:24.926280] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-13T19:17:24.926395] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GSBD took 36.2s. Estimated remaining: 3h 16m 20s. Rate: 7.1 symbols/min [2025-10-13T19:17:25.112309] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:25.136955] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-13T19:17:25.196149] [DEBUG] [LOCAL ] GTES: Loaded 51168 existing records from primary storage. [2025-10-13T19:17:25.196545] [INFO ] [MAIN ] GTES: Loaded 51168 existing records. [2025-10-13T19:17:25.227575] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-13T19:17:25.383104] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:25.383388] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-13T19:17:25.383439] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-13T19:17:25.384109] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-13T19:17:25.384169] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-13T19:17:25.746256] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:26.018042] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-13T19:17:26.373240] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T19:17:26.382004] [INFO ] [REMOTE ] GSK: Full fetch complete (77473 records). [2025-10-13T19:17:26.382239] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-13T19:17:26.821357] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-13T19:17:26.840165] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T19:17:26.843668] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-13T19:17:26.865458] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-13T19:17:26.867898] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-13T19:17:26.868204] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-13T19:17:26.871554] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T19:17:26.878587] [INFO ] [REMOTE ] GS: Full fetch complete (75646 records). [2025-10-13T19:17:26.878950] [DEBUG] [LOCAL ] GSK: Trimmed 77473 records to 53502 (keeping 200 days of data) [2025-10-13T19:17:26.879077] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-13T19:17:27.434275] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-13T19:17:27.435811] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-13T19:17:27.437439] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-13T19:17:27.438683] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-13T19:17:27.451305] [DEBUG] [LOCAL ] GS: Trimmed 75646 records to 51775 (keeping 200 days of data) [2025-10-13T19:17:27.635851] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-13T19:17:27.924520] [DEBUG] [LOCAL ] GSK: Primary data saved (53502 records). [2025-10-13T19:17:27.925851] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-13T19:17:27.926281] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSK took 36.9s. Estimated remaining: 3h 16m 3s. Rate: 7.1 symbols/min [2025-10-13T19:17:28.115332] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:28.236345] [DEBUG] [LOCAL ] GTLS: Loaded 43640 existing records from primary storage. [2025-10-13T19:17:28.238845] [INFO ] [MAIN ] GTLS: Loaded 43640 existing records. [2025-10-13T19:17:28.265989] [DEBUG] [LOCAL ] GS: Primary data saved (51775 records). [2025-10-13T19:17:28.281726] [INFO ] [MAIN ] GS: Full history saved. [2025-10-13T19:17:28.304877] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GS took 42.7s. Estimated remaining: 3h 15m 43s. Rate: 7.1 symbols/min [2025-10-13T19:17:28.603042] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:28.613694] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-13T19:17:28.640826] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:28.632975] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-13T19:17:28.642019] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-13T19:17:28.642336] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-13T19:17:28.777884] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-13T19:17:28.820102] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-13T19:17:29.038597] [DEBUG] [LOCAL ] GTN: Loaded 45885 existing records from primary storage. [2025-10-13T19:17:29.061985] [INFO ] [MAIN ] GTN: Loaded 45885 existing records. [2025-10-13T19:17:29.190974] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:29.224439] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-13T19:17:29.364499] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:29.364971] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-13T19:17:29.365514] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-13T19:17:29.367285] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T19:17:29.374446] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-13T19:17:29.374977] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-13T19:17:29.739466] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:30.017951] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-13T19:17:30.441763] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:17:30.532630] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:17:30.817970] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-13T19:17:31.533621] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T19:17:31.617949] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-13T19:17:32.412263] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T19:17:32.420919] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-13T19:17:32.905965] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T19:17:33.217988] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-13T19:17:33.874629] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T19:17:34.017977] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-13T19:17:34.359140] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T19:17:34.818005] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-13T19:17:35.263820] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-13T19:17:35.617963] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-13T19:17:36.320402] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:17:36.417962] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-13T19:17:36.927098] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T19:17:37.217969] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-13T19:17:37.651867] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T19:17:38.017977] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-13T19:17:38.235147] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T19:17:38.817944] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-13T19:17:39.412902] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T19:17:39.617971] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-13T19:17:40.412189] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T19:17:40.422583] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-13T19:17:41.274183] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-13T19:17:41.299320] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:17:41.772244] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T19:17:42.017975] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-13T19:17:42.785176] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T19:17:42.817887] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-13T19:17:42.854118] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T19:17:42.858182] [INFO ] [REMOTE ] GSL: Full fetch complete (48074 records). [2025-10-13T19:17:42.858311] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-13T19:17:43.250011] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-13T19:17:43.250128] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-13T19:17:43.251168] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-13T19:17:43.251232] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-13T19:17:43.252664] [DEBUG] [LOCAL ] GSL: Trimmed 48074 records to 33280 (keeping 200 days of data) [2025-10-13T19:17:43.471710] [DEBUG] [LOCAL ] GSL: Primary data saved (33280 records). [2025-10-13T19:17:43.471907] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-13T19:17:43.472011] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GSL took 30.8s. Estimated remaining: 3h 15m 45s. Rate: 7.1 symbols/min [2025-10-13T19:17:43.623909] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-13T19:17:43.654085] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:43.690232] [DEBUG] [LOCAL ] GTY: Loaded 30692 existing records from primary storage. [2025-10-13T19:17:43.690637] [INFO ] [MAIN ] GTY: Loaded 30692 existing records. [2025-10-13T19:17:43.878360] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:43.878681] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-13T19:17:43.878748] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-13T19:17:43.879064] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-13T19:17:43.879105] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-13T19:17:44.260191] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:44.324553] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T19:17:44.417965] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-13T19:17:44.935405] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T19:17:45.217942] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-13T19:17:45.863747] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T19:17:46.017961] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-13T19:17:46.820004] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-13T19:17:46.822753] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:17:47.614388] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-13T19:17:47.625185] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-13T19:17:48.431980] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-13T19:17:48.465401] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:17:48.773772] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T19:17:49.217948] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-13T19:17:50.023858] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-13T19:17:50.042895] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:17:50.747626] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T19:17:50.818016] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-13T19:17:51.291090] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T19:17:51.617982] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-13T19:17:52.418019] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-13T19:17:52.482305] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T19:17:52.941531] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T19:17:53.221904] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-13T19:17:54.020325] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-13T19:17:54.023875] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T19:17:54.807085] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T19:17:54.812755] [INFO ] [REMOTE ] GTES: Full fetch complete (73745 records). [2025-10-13T19:17:54.812904] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-13T19:17:54.825804] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-13T19:17:55.232635] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-13T19:17:55.232778] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-13T19:17:55.234248] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-13T19:17:55.234328] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-13T19:17:55.236351] [DEBUG] [LOCAL ] GTES: Trimmed 73745 records to 50407 (keeping 200 days of data) [2025-10-13T19:17:55.555231] [DEBUG] [LOCAL ] GTES: Primary data saved (50407 records). [2025-10-13T19:17:55.555421] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-13T19:17:55.555527] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTES took 30.6s. Estimated remaining: 3h 15m 41s. Rate: 7.1 symbols/min [2025-10-13T19:17:55.621217] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-13T19:17:55.740248] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:17:55.777858] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T19:17:55.796342] [DEBUG] [LOCAL ] GUG: Loaded 12355 existing records from primary storage. [2025-10-13T19:17:55.796724] [INFO ] [MAIN ] GUG: Loaded 12355 existing records. [2025-10-13T19:17:55.986713] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:17:55.987205] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-13T19:17:55.987372] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-13T19:17:55.987710] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-13T19:17:55.987769] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-13T19:17:56.236097] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T19:17:56.409453] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:17:56.417896] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-13T19:17:57.217920] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-13T19:17:57.242424] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:17:57.322747] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T19:17:58.017986] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-13T19:17:58.551771] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T19:17:58.818002] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-13T19:17:59.610974] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T19:17:59.622683] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-13T19:18:00.417976] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-13T19:18:00.483619] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T19:18:00.622434] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T19:18:01.217923] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-13T19:18:02.018007] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-13T19:18:02.127005] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-13T19:18:02.133411] [INFO ] [REMOTE ] GTLS: Full fetch complete (61412 records). [2025-10-13T19:18:02.133683] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-13T19:18:02.552176] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-13T19:18:02.552395] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-13T19:18:02.553592] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-13T19:18:02.553684] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-13T19:18:02.555438] [DEBUG] [LOCAL ] GTLS: Trimmed 61412 records to 43230 (keeping 200 days of data) [2025-10-13T19:18:02.822616] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-13T19:18:02.827839] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T19:18:02.872021] [DEBUG] [LOCAL ] GTLS: Primary data saved (43230 records). [2025-10-13T19:18:02.872183] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-13T19:18:02.872272] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTLS took 34.9s. Estimated remaining: 3h 15m 31s. Rate: 7.1 symbols/min [2025-10-13T19:18:03.041731] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:03.059278] [DEBUG] [LOCAL ] GUT: Loaded 15771 existing records from primary storage. [2025-10-13T19:18:03.059532] [INFO ] [MAIN ] GUT: Loaded 15771 existing records. [2025-10-13T19:18:03.238002] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:03.238362] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-13T19:18:03.238414] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-13T19:18:03.238721] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-13T19:18:03.238778] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-13T19:18:03.607208] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:03.623238] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-13T19:18:03.637877] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:18:03.668458] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T19:18:04.417914] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-13T19:18:04.442366] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:18:05.065842] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-13T19:18:05.217916] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-13T19:18:05.913392] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-13T19:18:06.018016] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-13T19:18:06.817956] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-13T19:18:07.110695] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T19:18:07.617922] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-13T19:18:08.103077] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T19:18:08.417896] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-13T19:18:08.482634] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T19:18:09.217924] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-13T19:18:09.570199] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T19:18:10.017984] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-13T19:18:10.740572] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T19:18:10.745309] [INFO ] [REMOTE ] GTN: Full fetch complete (66100 records). [2025-10-13T19:18:10.745426] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-13T19:18:10.828132] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-13T19:18:10.865890] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-13T19:18:11.153448] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-13T19:18:11.153538] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-13T19:18:11.154406] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-13T19:18:11.154469] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-13T19:18:11.155876] [DEBUG] [LOCAL ] GTN: Trimmed 66100 records to 45242 (keeping 200 days of data) [2025-10-13T19:18:11.420661] [DEBUG] [LOCAL ] GTN: Primary data saved (45242 records). [2025-10-13T19:18:11.420810] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-13T19:18:11.420894] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GTN took 43.1s. Estimated remaining: 3h 15m 23s. Rate: 7.1 symbols/min [2025-10-13T19:18:11.610143] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:11.617970] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-13T19:18:11.647247] [DEBUG] [LOCAL ] GVA: Loaded 33295 existing records from primary storage. [2025-10-13T19:18:11.647590] [INFO ] [MAIN ] GVA: Loaded 33295 existing records. [2025-10-13T19:18:11.848951] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:11.849189] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-13T19:18:11.849233] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-13T19:18:11.849545] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-13T19:18:11.849603] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-13T19:18:12.210370] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:12.232562] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T19:18:12.417960] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-13T19:18:12.449601] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T19:18:13.217920] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-13T19:18:13.807799] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-13T19:18:13.855982] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-13T19:18:14.017923] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-13T19:18:14.817972] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-13T19:18:15.387348] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T19:18:15.617962] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-13T19:18:15.698527] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T19:18:16.418025] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-13T19:18:16.770031] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-13T19:18:17.217921] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-13T19:18:17.719156] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T19:18:18.017996] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-13T19:18:18.176793] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T19:18:18.817955] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-13T19:18:19.523375] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:18:19.617953] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-13T19:18:19.888709] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T19:18:20.417920] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-13T19:18:20.465697] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-13T19:18:21.218001] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-13T19:18:21.710586] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-13T19:18:21.714139] [INFO ] [REMOTE ] GTY: Full fetch complete (43768 records). [2025-10-13T19:18:21.714258] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-13T19:18:22.023120] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-13T19:18:22.088771] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-13T19:18:22.088883] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-13T19:18:22.089581] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-13T19:18:22.089625] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-13T19:18:22.090785] [DEBUG] [LOCAL ] GTY: Trimmed 43768 records to 30265 (keeping 200 days of data) [2025-10-13T19:18:22.280478] [DEBUG] [LOCAL ] GTY: Primary data saved (30265 records). [2025-10-13T19:18:22.280625] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-13T19:18:22.280738] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GTY took 38.8s. Estimated remaining: 3h 15m 18s. Rate: 7.1 symbols/min [2025-10-13T19:18:22.449695] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:22.474165] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T19:18:22.496036] [DEBUG] [LOCAL ] GWH: Loaded 17652 existing records from primary storage. [2025-10-13T19:18:22.496297] [INFO ] [MAIN ] GWH: Loaded 17652 existing records. [2025-10-13T19:18:22.669390] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:22.669682] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-13T19:18:22.669739] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-13T19:18:22.670022] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-13T19:18:22.670077] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-13T19:18:22.818602] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-13T19:18:22.930175] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-13T19:18:23.039755] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:23.617969] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-13T19:18:24.284349] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-13T19:18:24.415846] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T19:18:24.418602] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-13T19:18:25.217915] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-13T19:18:25.713858] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:18:26.017967] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-13T19:18:26.027057] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:18:26.028764] [INFO ] [REMOTE ] GUG: Full fetch complete (19325 records). [2025-10-13T19:18:26.028837] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-13T19:18:26.396086] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-13T19:18:26.396208] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-13T19:18:26.396726] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-13T19:18:26.396787] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-13T19:18:26.397330] [DEBUG] [LOCAL ] GUG: Trimmed 19325 records to 12212 (keeping 200 days of data) [2025-10-13T19:18:26.474639] [DEBUG] [LOCAL ] GUG: Primary data saved (12212 records). [2025-10-13T19:18:26.474811] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-13T19:18:26.474993] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GUG took 30.9s. Estimated remaining: 3h 15m 4s. Rate: 7.1 symbols/min [2025-10-13T19:18:26.640830] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:26.681279] [DEBUG] [LOCAL ] GWRE: Loaded 40700 existing records from primary storage. [2025-10-13T19:18:26.682696] [INFO ] [MAIN ] GWRE: Loaded 40700 existing records. [2025-10-13T19:18:26.823973] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-13T19:18:26.869801] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:26.871395] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-13T19:18:26.871489] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-13T19:18:26.872036] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-13T19:18:26.872104] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-13T19:18:27.176670] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T19:18:27.257676] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:27.617979] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-13T19:18:28.309023] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T19:18:28.335748] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-13T19:18:28.417990] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-13T19:18:29.217909] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-13T19:18:29.352948] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T19:18:30.017955] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-13T19:18:30.817905] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-13T19:18:30.854623] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T19:18:30.887413] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-13T19:18:30.924841] [DEBUG] [REMOTE ] GVA: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-13T19:18:30.925441] [WARN ] [REMOTE ] GVA: No data returned for month 2025-08 [2025-10-13T19:18:30.925547] [FATAL] [REMOTE ] GVA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:18:30.925698] [FATAL] [MAIN ] GVA: Failed to fetch primary data. [2025-10-13T19:18:30.925779] [WARN ] [MAIN ] GVA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:18:30.925863] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-13T19:18:30.925949] [DEBUG] [LOCAL ] GVA: No primary data file found to delete. [2025-10-13T19:18:30.926043] [INFO ] [LOCAL ] GVA: Starting deletion of derivative data. [2025-10-13T19:18:30.926274] [DEBUG] [LOCAL ] GVA: Deleted derivative data file. [2025-10-13T19:18:30.927189] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GVA took 19.5s. Estimated remaining: 3h 14m 49s. Rate: 7.1 symbols/min [2025-10-13T19:18:31.095886] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:31.124394] [DEBUG] [LOCAL ] GWW: Loaded 19737 existing records from primary storage. [2025-10-13T19:18:31.125490] [INFO ] [MAIN ] GWW: Loaded 19737 existing records. [2025-10-13T19:18:31.306397] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:31.307222] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-13T19:18:31.307317] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-13T19:18:31.308258] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-13T19:18:31.308320] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-13T19:18:31.625974] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-13T19:18:31.669147] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:32.417948] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-13T19:18:32.519251] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T19:18:33.217987] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-13T19:18:33.303828] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T19:18:34.010827] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:18:34.017875] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-13T19:18:34.793320] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-13T19:18:34.817880] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-13T19:18:35.567508] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T19:18:35.617978] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-13T19:18:36.417908] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-13T19:18:36.528503] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T19:18:37.217896] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-13T19:18:37.446507] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T19:18:38.017911] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-13T19:18:38.183608] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T19:18:38.817904] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-13T19:18:39.049937] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T19:18:39.617925] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-13T19:18:39.738506] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T19:18:39.741129] [INFO ] [REMOTE ] GUT: Full fetch complete (22592 records). [2025-10-13T19:18:39.741222] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-13T19:18:40.115780] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-13T19:18:40.115891] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-13T19:18:40.116882] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-13T19:18:40.116951] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-13T19:18:40.117777] [DEBUG] [LOCAL ] GUT: Trimmed 22592 records to 15567 (keeping 200 days of data) [2025-10-13T19:18:40.220838] [DEBUG] [LOCAL ] GUT: Primary data saved (15567 records). [2025-10-13T19:18:40.221044] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-13T19:18:40.221174] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GUT took 37.3s. Estimated remaining: 3h 14m 42s. Rate: 7.1 symbols/min [2025-10-13T19:18:40.398966] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:40.417980] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-13T19:18:40.462981] [DEBUG] [LOCAL ] GXO: Loaded 47741 existing records from primary storage. [2025-10-13T19:18:40.463380] [INFO ] [MAIN ] GXO: Loaded 47741 existing records. [2025-10-13T19:18:40.653941] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:40.654256] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-13T19:18:40.654310] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-13T19:18:40.654931] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-13T19:18:40.654992] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-13T19:18:41.060108] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:41.231459] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-13T19:18:41.268702] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:18:41.516514] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T19:18:42.017958] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-13T19:18:42.817966] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-13T19:18:43.023210] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T19:18:43.539170] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:18:43.617970] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-13T19:18:44.033690] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T19:18:44.417957] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-13T19:18:45.217920] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-13T19:18:45.301297] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T19:18:45.720887] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-13T19:18:46.016914] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T19:18:46.023243] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-13T19:18:46.817951] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-13T19:18:47.548714] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T19:18:47.617909] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-13T19:18:47.967994] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T19:18:48.417975] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-13T19:18:49.217910] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-13T19:18:49.229153] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:18:49.285834] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T19:18:50.017905] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-13T19:18:50.173313] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-13T19:18:50.817959] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-13T19:18:51.095765] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T19:18:51.617978] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-13T19:18:51.657545] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T19:18:52.417953] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-13T19:18:53.217906] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-13T19:18:53.359776] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:18:53.953441] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-13T19:18:54.017958] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-13T19:18:54.202364] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T19:18:54.206207] [INFO ] [REMOTE ] GWH: Full fetch complete (22697 records). [2025-10-13T19:18:54.206283] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-13T19:18:54.565453] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-13T19:18:54.565533] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-13T19:18:54.565964] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-13T19:18:54.566023] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-13T19:18:54.566632] [DEBUG] [LOCAL ] GWH: Trimmed 22697 records to 17922 (keeping 200 days of data) [2025-10-13T19:18:54.664426] [DEBUG] [LOCAL ] GWH: Primary data saved (17922 records). [2025-10-13T19:18:54.664562] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-13T19:18:54.664697] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWH took 32.4s. Estimated remaining: 3h 14m 42s. Rate: 7.1 symbols/min [2025-10-13T19:18:54.829964] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-13T19:18:54.833754] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:18:54.838839] [DEBUG] [LOCAL ] GYLD: Loaded 1575 existing records from primary storage. [2025-10-13T19:18:54.838982] [INFO ] [MAIN ] GYLD: Loaded 1575 existing records. [2025-10-13T19:18:55.039506] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:18:55.039786] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-13T19:18:55.039838] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-13T19:18:55.039990] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-13T19:18:55.040027] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-13T19:18:55.386284] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:18:55.617914] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-13T19:18:55.675692] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T19:18:56.002392] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T19:18:56.418032] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-13T19:18:57.210856] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T19:18:57.219770] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-13T19:18:58.017923] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-13T19:18:58.083600] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:18:58.143933] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T19:18:58.817964] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-13T19:18:59.560065] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T19:18:59.617962] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-13T19:19:00.332179] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T19:19:00.417958] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-13T19:19:01.215672] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T19:19:01.224291] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-13T19:19:01.550387] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-13T19:19:01.568438] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T19:19:02.018027] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-13T19:19:02.817990] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-13T19:19:03.536479] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T19:19:03.617951] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-13T19:19:04.425393] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-13T19:19:04.442265] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T19:19:04.793784] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-13T19:19:05.219870] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-13T19:19:05.217923] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-13T19:19:06.017959] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-13T19:19:06.312890] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-13T19:19:06.328355] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-13T19:19:06.332810] [INFO ] [REMOTE ] GWRE: Full fetch complete (60372 records). [2025-10-13T19:19:06.332950] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-13T19:19:06.733752] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-13T19:19:06.733865] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-13T19:19:06.735112] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-13T19:19:06.735178] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-13T19:19:06.736818] [DEBUG] [LOCAL ] GWRE: Trimmed 60372 records to 40055 (keeping 200 days of data) [2025-10-13T19:19:06.828932] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-13T19:19:07.002977] [DEBUG] [LOCAL ] GWRE: Primary data saved (40055 records). [2025-10-13T19:19:07.003164] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-13T19:19:07.003282] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GWRE took 40.5s. Estimated remaining: 3h 14m 39s. Rate: 7.1 symbols/min [2025-10-13T19:19:07.179673] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:07.233959] [DEBUG] [LOCAL ] H: Loaded 45165 existing records from primary storage. [2025-10-13T19:19:07.234374] [INFO ] [MAIN ] H: Loaded 45165 existing records. [2025-10-13T19:19:07.433683] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:07.434003] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-13T19:19:07.434083] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-13T19:19:07.434512] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-13T19:19:07.434555] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-13T19:19:07.623149] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-13T19:19:07.802999] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:07.972474] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T19:19:07.975328] [INFO ] [REMOTE ] GWW: Full fetch complete (29072 records). [2025-10-13T19:19:07.975404] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-13T19:19:08.229354] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T19:19:08.356414] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-13T19:19:08.356516] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-13T19:19:08.357553] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-13T19:19:08.357622] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-13T19:19:08.358506] [DEBUG] [LOCAL ] GWW: Trimmed 29072 records to 19568 (keeping 200 days of data) [2025-10-13T19:19:08.429538] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-13T19:19:08.500356] [DEBUG] [LOCAL ] GWW: Primary data saved (19568 records). [2025-10-13T19:19:08.500561] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-13T19:19:08.500715] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GWW took 37.6s. Estimated remaining: 3h 14m 21s. Rate: 7.1 symbols/min [2025-10-13T19:19:08.678867] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:08.722011] [DEBUG] [LOCAL ] HAE: Loaded 40041 existing records from primary storage. [2025-10-13T19:19:08.722317] [INFO ] [MAIN ] HAE: Loaded 40041 existing records. [2025-10-13T19:19:08.900541] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:08.900870] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-13T19:19:08.900934] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-13T19:19:08.901395] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-13T19:19:08.901454] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-13T19:19:09.222557] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-13T19:19:09.307061] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:09.932933] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T19:19:10.018047] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-13T19:19:10.801137] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T19:19:10.817883] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-13T19:19:10.951368] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-13T19:19:11.617971] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-13T19:19:12.363339] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T19:19:12.368615] [INFO ] [REMOTE ] GXO: Full fetch complete (69630 records). [2025-10-13T19:19:12.368809] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-13T19:19:12.423051] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-13T19:19:12.814489] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-13T19:19:12.814629] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-13T19:19:12.815730] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-13T19:19:12.815808] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-13T19:19:12.817270] [DEBUG] [LOCAL ] GXO: Trimmed 69630 records to 46910 (keeping 200 days of data) [2025-10-13T19:19:13.067589] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T19:19:13.133433] [DEBUG] [LOCAL ] GXO: Primary data saved (46910 records). [2025-10-13T19:19:13.133593] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-13T19:19:13.133703] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GXO took 32.9s. Estimated remaining: 3h 14m 7s. Rate: 7.1 symbols/min [2025-10-13T19:19:13.224808] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-13T19:19:13.309366] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:13.351572] [DEBUG] [LOCAL ] HAFN: Loaded 43736 existing records from primary storage. [2025-10-13T19:19:13.352063] [INFO ] [MAIN ] HAFN: Loaded 43736 existing records. [2025-10-13T19:19:13.556272] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:13.556745] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-13T19:19:13.556880] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-13T19:19:13.557878] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-13T19:19:13.557958] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-13T19:19:13.917878] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:13.940474] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T19:19:14.017904] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-13T19:19:14.669064] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T19:19:14.817956] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-13T19:19:15.262736] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-13T19:19:15.587449] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T19:19:15.617895] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-13T19:19:16.418000] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-13T19:19:17.217971] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-13T19:19:17.530143] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T19:19:17.582079] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-13T19:19:18.017923] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-13T19:19:18.105706] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:19:18.818009] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-13T19:19:19.617961] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-13T19:19:20.309266] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T19:19:20.417980] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-13T19:19:20.778248] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-13T19:19:20.871334] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-13T19:19:21.217922] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-13T19:19:22.018021] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-13T19:19:22.772410] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-13T19:19:22.817922] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-13T19:19:23.233386] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (5.22 seconds). [2025-10-13T19:19:23.511032] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:19:23.618005] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-13T19:19:24.417900] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-13T19:19:24.489678] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T19:19:24.721063] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-13T19:19:25.226521] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-13T19:19:25.244532] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T19:19:25.686447] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T19:19:26.017972] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-13T19:19:26.817989] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-13T19:19:27.617988] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-13T19:19:27.650235] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T19:19:28.192118] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T19:19:28.417979] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-13T19:19:29.217974] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-13T19:19:29.385342] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-13T19:19:29.690055] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T19:19:30.023221] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-13T19:19:30.029156] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T19:19:30.817993] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-13T19:19:31.617992] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-13T19:19:31.671737] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T19:19:32.298530] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-13T19:19:32.303803] [INFO ] [REMOTE ] H: Full fetch complete (62671 records). [2025-10-13T19:19:32.303991] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-13T19:19:32.423049] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-13T19:19:32.711443] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-13T19:19:32.711570] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-13T19:19:32.712728] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-13T19:19:32.712797] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-13T19:19:32.714739] [DEBUG] [LOCAL ] H: Trimmed 62671 records to 44516 (keeping 200 days of data) [2025-10-13T19:19:32.914370] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T19:19:32.915866] [INFO ] [REMOTE ] GYLD: Full fetch complete (2107 records). [2025-10-13T19:19:32.928431] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-13T19:19:33.235930] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-13T19:19:33.410524] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-13T19:19:33.413396] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-13T19:19:33.414625] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-13T19:19:33.414329] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T19:19:33.415318] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-13T19:19:33.426157] [DEBUG] [LOCAL ] GYLD: Trimmed 2107 records to 1541 (keeping 200 days of data) [2025-10-13T19:19:33.442884] [DEBUG] [LOCAL ] GYLD: Primary data saved (1541 records). [2025-10-13T19:19:33.443583] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-13T19:19:33.443819] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. GYLD took 38.8s. Estimated remaining: 3h 14m 15s. Rate: 7.1 symbols/min [2025-10-13T19:19:33.636920] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:33.684054] [DEBUG] [LOCAL ] H: Primary data saved (44516 records). [2025-10-13T19:19:33.684243] [INFO ] [MAIN ] H: Full history saved. [2025-10-13T19:19:33.684353] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. H took 26.7s. Estimated remaining: 3h 13m 56s. Rate: 7.1 symbols/min [2025-10-13T19:19:33.903678] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:33.905859] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-10-13T19:19:33.906792] [INFO ] [MAIN ] HAL: Loaded 54498 existing records. [2025-10-13T19:19:34.023198] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-13T19:19:34.130272] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:34.143099] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-13T19:19:34.143202] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-13T19:19:34.144527] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-13T19:19:34.144594] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-13T19:19:34.292737] [DEBUG] [LOCAL ] HASI: Loaded 47989 existing records from primary storage. [2025-10-13T19:19:34.330312] [INFO ] [MAIN ] HASI: Loaded 47989 existing records. [2025-10-13T19:19:34.667283] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:34.678927] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-13T19:19:34.684286] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-13T19:19:34.705296] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-13T19:19:34.705526] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-13T19:19:34.791220] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:34.821486] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-13T19:19:35.073971] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T19:19:35.189853] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:35.617923] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-13T19:19:35.955474] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T19:19:36.417957] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-13T19:19:36.941023] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-13T19:19:37.073837] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:19:37.217971] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-13T19:19:37.995205] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T19:19:38.017979] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-13T19:19:38.817916] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-13T19:19:39.172829] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-13T19:19:39.617987] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-13T19:19:39.653907] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:19:40.198975] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-13T19:19:40.417970] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-13T19:19:41.218002] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-13T19:19:41.470091] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-13T19:19:41.958575] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T19:19:42.017925] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-13T19:19:42.517083] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:19:42.817984] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-13T19:19:43.617996] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-13T19:19:43.943107] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T19:19:44.241936] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T19:19:44.418002] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-13T19:19:45.223034] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-13T19:19:45.237901] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-13T19:19:45.971149] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T19:19:46.017909] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-13T19:19:46.817977] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-13T19:19:47.234149] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-13T19:19:47.618044] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-13T19:19:47.690461] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T19:19:48.316812] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:19:48.417889] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-13T19:19:49.217922] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-13T19:19:49.750546] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-13T19:19:50.017926] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-13T19:19:50.136740] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T19:19:50.818044] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-13T19:19:51.041720] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T19:19:51.047192] [INFO ] [REMOTE ] HAE: Full fetch complete (58605 records). [2025-10-13T19:19:51.047346] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-13T19:19:51.443629] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-13T19:19:51.443741] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-13T19:19:51.444502] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-13T19:19:51.444544] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-13T19:19:51.445767] [DEBUG] [LOCAL ] HAE: Trimmed 58605 records to 39430 (keeping 200 days of data) [2025-10-13T19:19:51.639100] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-13T19:19:51.680161] [DEBUG] [LOCAL ] HAE: Primary data saved (39430 records). [2025-10-13T19:19:51.680349] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-13T19:19:51.681390] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAE took 43.2s. Estimated remaining: 3h 14m 0s. Rate: 7.1 symbols/min [2025-10-13T19:19:51.852732] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:51.904818] [DEBUG] [LOCAL ] HAYW: Loaded 49473 existing records from primary storage. [2025-10-13T19:19:51.905162] [INFO ] [MAIN ] HAYW: Loaded 49473 existing records. [2025-10-13T19:19:52.087025] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:52.087495] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-13T19:19:52.087580] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-13T19:19:52.088314] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-13T19:19:52.088437] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-13T19:19:52.380581] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-13T19:19:52.422287] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-13T19:19:52.514911] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:52.549349] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T19:19:53.180138] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T19:19:53.185327] [INFO ] [REMOTE ] HAFN: Full fetch complete (65036 records). [2025-10-13T19:19:53.185520] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-13T19:19:53.223109] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-13T19:19:53.607125] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-13T19:19:53.607257] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-13T19:19:53.608833] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-13T19:19:53.608913] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-13T19:19:53.611012] [DEBUG] [LOCAL ] HAFN: Trimmed 65036 records to 43057 (keeping 200 days of data) [2025-10-13T19:19:53.879380] [DEBUG] [LOCAL ] HAFN: Primary data saved (43057 records). [2025-10-13T19:19:53.879896] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-13T19:19:53.880032] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAFN took 40.7s. Estimated remaining: 3h 13m 43s. Rate: 7.1 symbols/min [2025-10-13T19:19:54.029901] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-13T19:19:54.066287] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:19:54.075952] [DEBUG] [LOCAL ] HBB: Loaded 6551 existing records from primary storage. [2025-10-13T19:19:54.076564] [INFO ] [MAIN ] HBB: Loaded 6551 existing records. [2025-10-13T19:19:54.259237] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:19:54.259590] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-13T19:19:54.259926] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-13T19:19:54.260431] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-13T19:19:54.260559] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-13T19:19:54.711906] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:19:54.717958] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-13T19:19:54.817885] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-13T19:19:55.014475] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T19:19:55.617926] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-13T19:19:55.739858] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T19:19:56.417992] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-13T19:19:56.522426] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-13T19:19:56.696180] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-13T19:19:57.217925] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-13T19:19:57.682476] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-13T19:19:58.017913] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-13T19:19:58.022419] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:19:58.817962] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-13T19:19:59.617904] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-13T19:20:00.012122] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-13T19:20:00.412586] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T19:20:00.421940] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-13T19:20:00.844685] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-13T19:20:00.985837] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T19:20:01.217927] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-13T19:20:01.977592] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T19:20:02.017959] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-13T19:20:02.823100] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-13T19:20:02.832241] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:20:02.838473] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-10-13T19:20:02.838688] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-13T19:20:03.242324] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-13T19:20:03.242407] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-13T19:20:03.243329] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-13T19:20:03.243392] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-13T19:20:03.245000] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-10-13T19:20:03.570412] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-13T19:20:03.570550] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-13T19:20:03.570634] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HAL took 30.1s. Estimated remaining: 3h 13m 37s. Rate: 7.1 symbols/min [2025-10-13T19:20:03.624557] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-13T19:20:03.739429] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:03.786349] [DEBUG] [LOCAL ] HBI: Loaded 53755 existing records from primary storage. [2025-10-13T19:20:03.786740] [INFO ] [MAIN ] HBI: Loaded 53755 existing records. [2025-10-13T19:20:03.961837] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:03.962069] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-13T19:20:03.962117] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-13T19:20:03.963136] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-13T19:20:03.963194] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-13T19:20:04.318011] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:04.358010] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T19:20:04.417900] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-13T19:20:05.217967] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-13T19:20:05.267597] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T19:20:05.765045] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T19:20:05.931500] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T19:20:06.017962] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-13T19:20:06.781083] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T19:20:06.817969] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-13T19:20:07.617923] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-13T19:20:08.267975] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-13T19:20:08.417897] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-13T19:20:08.598821] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T19:20:09.217905] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-13T19:20:10.017293] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T19:20:10.026679] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-13T19:20:10.793320] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T19:20:10.798732] [INFO ] [REMOTE ] HASI: Full fetch complete (68039 records). [2025-10-13T19:20:10.798947] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-13T19:20:10.823118] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-13T19:20:11.183832] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-13T19:20:11.183925] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-13T19:20:11.184924] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-13T19:20:11.184989] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-13T19:20:11.186485] [DEBUG] [LOCAL ] HASI: Trimmed 68039 records to 47474 (keeping 200 days of data) [2025-10-13T19:20:11.477952] [DEBUG] [LOCAL ] HASI: Primary data saved (47474 records). [2025-10-13T19:20:11.478264] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-13T19:20:11.478384] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HASI took 37.8s. Estimated remaining: 3h 13m 27s. Rate: 7.1 symbols/min [2025-10-13T19:20:11.559158] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-13T19:20:11.627354] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-13T19:20:11.659515] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:11.688913] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T19:20:11.743835] [DEBUG] [LOCAL ] HBM: Loaded 53708 existing records from primary storage. [2025-10-13T19:20:11.744168] [INFO ] [MAIN ] HBM: Loaded 53708 existing records. [2025-10-13T19:20:11.919726] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:11.919994] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-13T19:20:11.920043] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-13T19:20:11.921064] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-13T19:20:11.921123] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-13T19:20:12.279376] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:12.417989] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-13T19:20:12.505199] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-13T19:20:13.217925] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-13T19:20:14.018689] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-13T19:20:14.034181] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:20:14.594508] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T19:20:14.817926] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-13T19:20:14.923121] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T19:20:15.617991] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-13T19:20:16.300479] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-13T19:20:16.301695] [INFO ] [REMOTE ] HBB: Full fetch complete (9411 records). [2025-10-13T19:20:16.301771] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-13T19:20:16.422370] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-13T19:20:16.693229] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T19:20:16.724949] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-13T19:20:16.725077] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-13T19:20:16.725367] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-13T19:20:16.725408] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-13T19:20:16.725859] [DEBUG] [LOCAL ] HBB: Trimmed 9411 records to 6478 (keeping 200 days of data) [2025-10-13T19:20:16.763993] [DEBUG] [LOCAL ] HBB: Primary data saved (6478 records). [2025-10-13T19:20:16.764080] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-13T19:20:16.764156] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HBB took 22.9s. Estimated remaining: 3h 13m 15s. Rate: 7.1 symbols/min [2025-10-13T19:20:17.217967] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-13T19:20:18.018014] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-13T19:20:18.202543] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-13T19:20:18.817897] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-13T19:20:18.902508] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T19:20:19.122546] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T19:20:19.617901] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-13T19:20:20.417967] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-13T19:20:20.612960] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:20:20.722192] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T19:20:21.217995] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-13T19:20:22.022747] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-13T19:20:22.025501] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T19:20:22.797208] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T19:20:22.817889] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-13T19:20:23.593461] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T19:20:23.617881] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-13T19:20:24.417983] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-13T19:20:24.556439] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T19:20:25.221423] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-13T19:20:25.227379] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:20:25.977632] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T19:20:26.018021] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-13T19:20:26.731594] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T19:20:26.817890] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-13T19:20:27.536578] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T19:20:27.617954] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-13T19:20:28.174311] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T19:20:28.417920] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-13T19:20:29.217903] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-13T19:20:29.415155] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:20:29.997420] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-13T19:20:30.017887] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-13T19:20:30.818045] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-13T19:20:31.172266] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-13T19:20:31.178174] [INFO ] [REMOTE ] HBI: Full fetch complete (76867 records). [2025-10-13T19:20:31.178347] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-13T19:20:31.453073] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T19:20:31.495380] [INFO ] [REMOTE ] HAYW: Full fetch complete (70728 records). [2025-10-13T19:20:31.498330] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-13T19:20:31.734304] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-13T19:20:31.753011] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-13T19:20:31.770348] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-13T19:20:31.804757] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-13T19:20:31.914635] [DEBUG] [LOCAL ] HBI: Trimmed 76867 records to 52982 (keeping 200 days of data) [2025-10-13T19:20:32.057905] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-13T19:20:32.067919] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-13T19:20:32.098588] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-13T19:20:32.105747] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-13T19:20:32.128712] [DEBUG] [LOCAL ] HAYW: Trimmed 70728 records to 48879 (keeping 200 days of data) [2025-10-13T19:20:32.568404] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:20:32.582677] [DEBUG] [LOCAL ] HBI: Primary data saved (52982 records). [2025-10-13T19:20:32.583866] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-13T19:20:32.584095] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 29.0s. Estimated remaining: 3h 13m 16s. Rate: 7.1 symbols/min [2025-10-13T19:20:32.588315] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-13T19:20:32.660950] [DEBUG] [LOCAL ] HAYW: Primary data saved (48879 records). [2025-10-13T19:20:32.661092] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-13T19:20:32.661731] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HAYW took 41.0s. Estimated remaining: 3h 12m 56s. Rate: 7.1 symbols/min [2025-10-13T19:20:34.402919] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T19:20:34.414828] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-13T19:20:36.213906] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T19:20:36.225211] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-13T19:20:38.084050] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T19:20:38.095427] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-13T19:20:39.977515] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T19:20:39.983130] [INFO ] [REMOTE ] HBM: Full fetch complete (76399 records). [2025-10-13T19:20:39.983262] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-13T19:20:40.379156] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-13T19:20:40.379281] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-13T19:20:40.380231] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-13T19:20:40.380328] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-13T19:20:40.382273] [DEBUG] [LOCAL ] HBM: Trimmed 76399 records to 52941 (keeping 200 days of data) [2025-10-13T19:20:40.690281] [DEBUG] [LOCAL ] HBM: Primary data saved (52941 records). [2025-10-13T19:20:40.690381] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-13T19:20:40.690475] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HBM took 29.2s. Estimated remaining: 3h 12m 47s. Rate: 7.1 symbols/min [2025-10-13T19:20:41.296475] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:41.386099] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-13T19:20:41.387238] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:41.389453] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-13T19:20:41.394535] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:41.409721] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-13T19:20:41.413107] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:41.413440] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-13T19:20:41.414276] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-13T19:20:41.414428] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-13T19:20:41.620171] [DEBUG] [LOCAL ] HCI: Loaded 14343 existing records from primary storage. [2025-10-13T19:20:41.660721] [INFO ] [MAIN ] HCI: Loaded 14343 existing records. [2025-10-13T19:20:41.848240] [DEBUG] [LOCAL ] HCC: Loaded 45904 existing records from primary storage. [2025-10-13T19:20:41.911266] [INFO ] [MAIN ] HCC: Loaded 45904 existing records. [2025-10-13T19:20:41.952914] [DEBUG] [LOCAL ] HCA: Loaded 47601 existing records from primary storage. [2025-10-13T19:20:41.975147] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:42.010362] [INFO ] [MAIN ] HCA: Loaded 47601 existing records. [2025-10-13T19:20:42.010702] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-13T19:20:42.173528] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:42.240080] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-13T19:20:42.259327] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-13T19:20:42.268497] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-13T19:20:42.268689] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-13T19:20:42.450671] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:42.461844] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-13T19:20:42.507797] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:42.534005] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-13T19:20:42.526938] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-13T19:20:42.535316] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-13T19:20:42.534308] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-13T19:20:42.536546] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-13T19:20:42.536911] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-13T19:20:42.552663] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-13T19:20:42.597788] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-13T19:20:42.672515] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-13T19:20:42.888582] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-13T19:20:42.982237] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-13T19:20:43.317440] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:43.354877] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-13T19:20:43.381831] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-13T19:20:43.433183] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-13T19:20:43.700797] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:43.706505] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-13T19:20:43.787778] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:43.788198] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-13T19:20:43.790944] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-13T19:20:43.791941] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-13T19:20:44.021807] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-13T19:20:44.022667] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-13T19:20:44.253953] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-13T19:20:44.254829] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-13T19:20:44.490521] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T19:20:44.494721] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-13T19:20:44.499476] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-13T19:20:44.500529] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-13T19:20:44.727310] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-13T19:20:44.728353] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-13T19:20:44.995196] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-13T19:20:45.029686] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T19:20:45.217909] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-13T19:20:45.388190] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T19:20:45.450888] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-13T19:20:45.494488] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T19:20:46.017955] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-13T19:20:46.342377] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-13T19:20:46.343104] [INFO ] [REMOTE ] HCXY: Full fetch complete (517 records). [2025-10-13T19:20:46.343198] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-13T19:20:46.343555] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T19:20:46.343660] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:20:46.343720] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:20:46.343785] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-13T19:20:46.343843] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-13T19:20:46.343878] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-13T19:20:46.343917] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-13T19:20:46.344035] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 5.6s. Estimated remaining: 3h 12m 35s. Rate: 7.1 symbols/min [2025-10-13T19:20:46.517771] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:20:46.579761] [DEBUG] [LOCAL ] HD: Loaded 54268 existing records from primary storage. [2025-10-13T19:20:46.580129] [INFO ] [MAIN ] HD: Loaded 54268 existing records. [2025-10-13T19:20:46.765889] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:20:46.766061] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-13T19:20:46.766107] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-13T19:20:46.766614] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-13T19:20:46.766703] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-13T19:20:46.823060] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-13T19:20:47.137997] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:20:47.617919] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-13T19:20:48.403718] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T19:20:48.417885] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-13T19:20:48.464016] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T19:20:49.217927] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-13T19:20:49.718316] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T19:20:50.017971] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-13T19:20:50.149861] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T19:20:50.817988] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-13T19:20:51.410465] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T19:20:51.618022] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-13T19:20:52.385146] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-13T19:20:52.417917] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-13T19:20:53.217907] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-13T19:20:53.291503] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T19:20:53.729574] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-13T19:20:54.017913] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-13T19:20:54.817908] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-13T19:20:55.365195] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T19:20:55.475601] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T19:20:55.617906] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-13T19:20:55.816895] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T19:20:56.417918] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-13T19:20:57.217916] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-13T19:20:57.287104] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T19:20:57.521803] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:20:58.018007] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-13T19:20:58.490408] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T19:20:58.817906] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-13T19:20:59.617917] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-13T19:21:00.243235] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-13T19:21:00.417960] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-13T19:21:00.463975] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:21:00.639286] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T19:21:01.217962] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-13T19:21:02.018009] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-13T19:21:02.656808] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-13T19:21:02.818042] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-13T19:21:02.954596] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:21:03.629808] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-13T19:21:03.652242] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T19:21:03.849427] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T19:21:04.421634] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-13T19:21:05.217927] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-13T19:21:05.856351] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-13T19:21:05.922272] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:21:06.017925] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-13T19:21:06.139310] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T19:21:06.817920] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-13T19:21:07.618002] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-13T19:21:07.904299] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T19:21:08.417927] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-13T19:21:09.087278] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-13T19:21:09.217900] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-13T19:21:09.466408] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T19:21:10.017953] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-13T19:21:10.240954] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T19:21:10.818000] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-13T19:21:10.959276] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T19:21:11.357391] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-13T19:21:11.617913] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-13T19:21:12.417904] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-13T19:21:12.537686] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T19:21:13.217889] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-13T19:21:13.652048] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T19:21:13.656762] [INFO ] [REMOTE ] HCC: Full fetch complete (64592 records). [2025-10-13T19:21:13.656880] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-13T19:21:14.020141] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-13T19:21:14.074773] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-13T19:21:14.105631] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-13T19:21:14.105728] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-13T19:21:14.106745] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-13T19:21:14.107055] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-13T19:21:14.108799] [DEBUG] [LOCAL ] HCC: Trimmed 64592 records to 45223 (keeping 200 days of data) [2025-10-13T19:21:14.380805] [DEBUG] [LOCAL ] HCC: Primary data saved (45223 records). [2025-10-13T19:21:14.380942] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-13T19:21:14.382114] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCC took 33.7s. Estimated remaining: 3h 12m 54s. Rate: 7.1 symbols/min [2025-10-13T19:21:14.553795] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:14.609807] [DEBUG] [LOCAL ] HDB: Loaded 52716 existing records from primary storage. [2025-10-13T19:21:14.610123] [INFO ] [MAIN ] HDB: Loaded 52716 existing records. [2025-10-13T19:21:14.787034] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:21:14.787905] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-13T19:21:14.788123] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-13T19:21:14.788416] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-13T19:21:14.788463] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-13T19:21:14.827202] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-13T19:21:15.032249] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:21:15.090305] [INFO ] [REMOTE ] HCI: Full fetch complete (19490 records). [2025-10-13T19:21:15.128419] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-13T19:21:15.141125] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T19:21:15.304573] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:15.615853] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-13T19:21:15.615953] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-13T19:21:15.616609] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-13T19:21:15.616731] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-13T19:21:15.617918] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-13T19:21:15.619044] [DEBUG] [LOCAL ] HCI: Trimmed 19490 records to 14057 (keeping 200 days of data) [2025-10-13T19:21:15.714693] [DEBUG] [LOCAL ] HCI: Primary data saved (14057 records). [2025-10-13T19:21:15.714871] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-13T19:21:15.714962] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HCI took 35.0s. Estimated remaining: 3h 12m 35s. Rate: 7.1 symbols/min [2025-10-13T19:21:15.881800] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:15.930178] [DEBUG] [LOCAL ] HE: Loaded 49673 existing records from primary storage. [2025-10-13T19:21:15.930566] [INFO ] [MAIN ] HE: Loaded 49673 existing records. [2025-10-13T19:21:16.120202] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:21:16.120436] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-13T19:21:16.120529] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-13T19:21:16.121050] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-13T19:21:16.121108] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-13T19:21:16.423220] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-13T19:21:16.503078] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:17.040427] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-13T19:21:17.217879] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-13T19:21:17.292846] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-13T19:21:17.298889] [INFO ] [REMOTE ] HCA: Full fetch complete (68718 records). [2025-10-13T19:21:17.299003] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-13T19:21:17.678444] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-13T19:21:17.678553] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-13T19:21:17.679604] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-13T19:21:17.679746] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-13T19:21:17.681354] [DEBUG] [LOCAL ] HCA: Trimmed 68718 records to 46919 (keeping 200 days of data) [2025-10-13T19:21:17.945944] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T19:21:18.016427] [DEBUG] [LOCAL ] HCA: Primary data saved (46919 records). [2025-10-13T19:21:18.016571] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-13T19:21:18.016680] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HCA took 37.3s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-13T19:21:18.022684] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-13T19:21:18.183737] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:18.214520] [DEBUG] [LOCAL ] HEI: Loaded 32017 existing records from primary storage. [2025-10-13T19:21:18.214833] [INFO ] [MAIN ] HEI: Loaded 32017 existing records. [2025-10-13T19:21:18.390024] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:21:18.390223] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-13T19:21:18.390270] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-13T19:21:18.391077] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-13T19:21:18.391135] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-13T19:21:18.740715] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:18.817976] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-13T19:21:19.313601] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-13T19:21:19.617928] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-13T19:21:19.889600] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T19:21:20.417978] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-13T19:21:20.541325] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T19:21:21.217894] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-13T19:21:21.720694] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-13T19:21:21.762251] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T19:21:22.017926] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-13T19:21:22.799341] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T19:21:22.817896] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-13T19:21:23.617904] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-13T19:21:23.822152] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T19:21:24.418038] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-13T19:21:24.508338] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-13T19:21:24.658590] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T19:21:25.218029] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-13T19:21:26.017906] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-13T19:21:26.131171] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-13T19:21:26.817922] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-13T19:21:27.042926] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-13T19:21:27.457618] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:21:27.617912] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-13T19:21:28.417910] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-13T19:21:28.603567] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-13T19:21:28.731729] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-13T19:21:28.738568] [INFO ] [REMOTE ] HD: Full fetch complete (77444 records). [2025-10-13T19:21:28.738722] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-13T19:21:29.158576] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-13T19:21:29.158870] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-13T19:21:29.160800] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-13T19:21:29.160916] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-13T19:21:29.183311] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:21:29.192292] [DEBUG] [LOCAL ] HD: Trimmed 77444 records to 53493 (keeping 200 days of data) [2025-10-13T19:21:29.265581] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-13T19:21:29.576732] [DEBUG] [LOCAL ] HD: Primary data saved (53493 records). [2025-10-13T19:21:29.577031] [INFO ] [MAIN ] HD: Full history saved. [2025-10-13T19:21:29.577255] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HD took 43.2s. Estimated remaining: 3h 12m 14s. Rate: 7.1 symbols/min [2025-10-13T19:21:29.751602] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:29.761255] [DEBUG] [LOCAL ] HEQ: Loaded 6748 existing records from primary storage. [2025-10-13T19:21:29.761506] [INFO ] [MAIN ] HEQ: Loaded 6748 existing records. [2025-10-13T19:21:29.955268] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:21:29.955509] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-13T19:21:29.955558] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-13T19:21:29.955782] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-13T19:21:29.955840] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-13T19:21:30.023175] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-13T19:21:30.323734] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:30.710951] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T19:21:30.817952] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-13T19:21:31.617994] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-13T19:21:31.768384] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T19:21:32.010541] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-13T19:21:32.418002] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-13T19:21:33.055899] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T19:21:33.217918] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-13T19:21:33.803083] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T19:21:34.017980] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-13T19:21:34.817979] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-13T19:21:34.960485] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:21:35.304764] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T19:21:35.617979] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-13T19:21:36.418013] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-13T19:21:36.570405] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:21:37.032214] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T19:21:37.218008] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-13T19:21:37.278982] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T19:21:37.697196] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-13T19:21:38.017929] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-13T19:21:38.817925] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-13T19:21:39.429577] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-13T19:21:39.617925] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-13T19:21:39.758315] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T19:21:40.206160] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T19:21:40.417926] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-13T19:21:41.217968] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-13T19:21:42.017903] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-13T19:21:42.144235] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:21:42.818036] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-13T19:21:42.905532] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T19:21:43.439563] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T19:21:43.617925] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-13T19:21:44.417911] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-13T19:21:44.559842] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-13T19:21:44.844773] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T19:21:45.217955] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-13T19:21:46.018037] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-13T19:21:46.234736] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T19:21:46.817905] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-13T19:21:46.861380] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T19:21:46.864281] [INFO ] [REMOTE ] HEI: Full fetch complete (47746 records). [2025-10-13T19:21:46.864409] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-13T19:21:47.140092] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-13T19:21:47.183686] [INFO ] [REMOTE ] HDB: Full fetch complete (75343 records). [2025-10-13T19:21:47.183851] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-13T19:21:47.392099] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-13T19:21:47.392339] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-13T19:21:47.393164] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-13T19:21:47.393447] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-13T19:21:47.451536] [DEBUG] [LOCAL ] HEI: Trimmed 47746 records to 31410 (keeping 200 days of data) [2025-10-13T19:21:47.594389] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T19:21:47.633834] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-13T19:21:47.816988] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-13T19:21:47.817820] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-13T19:21:47.819486] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-13T19:21:47.819986] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-13T19:21:47.825876] [DEBUG] [LOCAL ] HDB: Trimmed 75343 records to 51946 (keeping 200 days of data) [2025-10-13T19:21:48.019357] [DEBUG] [LOCAL ] HEI: Primary data saved (31410 records). [2025-10-13T19:21:48.022933] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-13T19:21:48.023758] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEI took 30.0s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-13T19:21:48.226818] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:48.383885] [DEBUG] [LOCAL ] HESM: Loaded 49040 existing records from primary storage. [2025-10-13T19:21:48.385718] [INFO ] [MAIN ] HESM: Loaded 49040 existing records. [2025-10-13T19:21:48.424712] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-13T19:21:48.661144] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:21:48.664893] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-13T19:21:48.665555] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-13T19:21:48.667462] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-13T19:21:48.667910] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-13T19:21:48.843163] [DEBUG] [LOCAL ] HDB: Primary data saved (51946 records). [2025-10-13T19:21:48.886717] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-13T19:21:48.909735] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HDB took 34.5s. Estimated remaining: 3h 12m 1s. Rate: 7.1 symbols/min [2025-10-13T19:21:49.174816] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T19:21:49.232003] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:49.241204] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-13T19:21:49.242674] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-13T19:21:49.238608] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:49.242815] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-13T19:21:49.243275] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-13T19:21:49.243593] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-13T19:21:49.243794] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-13T19:21:49.243951] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-13T19:21:49.560209] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-13T19:21:49.648713] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:49.843968] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-13T19:21:50.018009] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-13T19:21:50.817927] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-13T19:21:51.625128] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-13T19:21:51.627150] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T19:21:51.632386] [INFO ] [REMOTE ] HE: Full fetch complete (72151 records). [2025-10-13T19:21:51.632505] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-13T19:21:52.047048] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-13T19:21:52.066304] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-13T19:21:52.066384] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-13T19:21:52.067360] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-13T19:21:52.067427] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-13T19:21:52.069104] [DEBUG] [LOCAL ] HE: Trimmed 72151 records to 48960 (keeping 200 days of data) [2025-10-13T19:21:52.386985] [DEBUG] [LOCAL ] HE: Primary data saved (48960 records). [2025-10-13T19:21:52.387134] [INFO ] [MAIN ] HE: Full history saved. [2025-10-13T19:21:52.387784] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HE took 36.7s. Estimated remaining: 3h 11m 46s. Rate: 7.1 symbols/min [2025-10-13T19:21:52.420084] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-13T19:21:52.427907] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:21:52.576331] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:21:52.576545] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-13T19:21:52.576584] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-13T19:21:52.576731] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-13T19:21:52.576777] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-13T19:21:52.576819] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-13T19:21:52.576852] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-13T19:21:52.839105] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-13T19:21:52.945000] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:21:53.217925] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-13T19:21:53.457583] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-13T19:21:54.018028] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-13T19:21:54.818013] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-13T19:21:55.513289] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-13T19:21:55.602873] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T19:21:55.617881] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-13T19:21:56.417907] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-13T19:21:56.861784] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-13T19:21:57.152805] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:21:57.217896] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-13T19:21:57.800703] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-13T19:21:58.017978] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-13T19:21:58.437816] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T19:21:58.817979] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-13T19:21:59.065316] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-13T19:21:59.617923] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-13T19:22:00.417997] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-13T19:22:01.165994] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-13T19:22:01.207728] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-13T19:22:01.217999] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-13T19:22:01.980536] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-13T19:22:02.018022] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-13T19:22:02.451937] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-13T19:22:02.817947] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-13T19:22:03.060139] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-13T19:22:03.617966] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-13T19:22:04.035156] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-13T19:22:04.417911] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-13T19:22:05.217982] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-13T19:22:05.473788] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-13T19:22:05.534952] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-13T19:22:06.018003] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-13T19:22:06.817928] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-13T19:22:07.585529] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-13T19:22:07.586847] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:22:07.597377] [INFO ] [REMOTE ] HEQ: Full fetch complete (9550 records). [2025-10-13T19:22:07.597670] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-13T19:22:07.626790] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-13T19:22:07.961101] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-13T19:22:07.960907] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-13T19:22:07.961288] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-13T19:22:07.962628] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-13T19:22:07.962723] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-13T19:22:07.963212] [DEBUG] [LOCAL ] HEQ: Trimmed 9550 records to 6723 (keeping 200 days of data) [2025-10-13T19:22:08.002730] [DEBUG] [LOCAL ] HEQ: Primary data saved (6723 records). [2025-10-13T19:22:08.002849] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-13T19:22:08.002943] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HEQ took 38.4s. Estimated remaining: 3h 11m 47s. Rate: 7.1 symbols/min [2025-10-13T19:22:08.168623] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:08.185266] [DEBUG] [LOCAL ] HFRO: Loaded 17645 existing records from primary storage. [2025-10-13T19:22:08.185512] [INFO ] [MAIN ] HFRO: Loaded 17645 existing records. [2025-10-13T19:22:08.372849] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:08.373075] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-13T19:22:08.373123] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-13T19:22:08.373779] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-13T19:22:08.373842] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-13T19:22:08.423097] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-13T19:22:08.756008] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:08.898074] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-13T19:22:09.217962] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-13T19:22:10.017965] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-13T19:22:10.379143] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-13T19:22:10.396962] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T19:22:10.817975] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-13T19:22:11.617926] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-13T19:22:11.869499] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-13T19:22:12.417909] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-13T19:22:12.485631] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-13T19:22:13.217902] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-13T19:22:13.530367] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T19:22:13.617121] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-13T19:22:13.618170] [INFO ] [REMOTE ] HF: Full fetch complete (438 records). [2025-10-13T19:22:13.618240] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-13T19:22:13.818370] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-13T19:22:13.818635] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:22:13.818734] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:22:13.818811] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-13T19:22:13.818879] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-13T19:22:13.818916] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-13T19:22:13.818958] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-13T19:22:13.819030] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HF took 24.9s. Estimated remaining: 3h 11m 35s. Rate: 7.1 symbols/min [2025-10-13T19:22:13.990221] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:14.004873] [DEBUG] [LOCAL ] HGER: Loaded 14757 existing records from primary storage. [2025-10-13T19:22:14.005179] [INFO ] [MAIN ] HGER: Loaded 14757 existing records. [2025-10-13T19:22:14.025065] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-13T19:22:14.186616] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:14.186921] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-13T19:22:14.186975] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-13T19:22:14.187407] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-13T19:22:14.187496] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-13T19:22:14.562138] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:14.817930] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-13T19:22:15.617904] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-13T19:22:15.797767] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T19:22:15.918048] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:22:15.918255] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-13T19:22:16.418037] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-13T19:22:17.217906] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-13T19:22:17.529254] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T19:22:17.898754] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T19:22:18.017955] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-13T19:22:18.817909] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-13T19:22:19.130296] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:22:19.617924] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-13T19:22:19.866852] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-13T19:22:20.417910] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-13T19:22:20.554527] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T19:22:20.822849] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-13T19:22:21.217952] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-13T19:22:21.515839] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-13T19:22:22.017971] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-13T19:22:22.412136] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-13T19:22:22.818009] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-13T19:22:23.617899] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-13T19:22:23.653841] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:22:24.418003] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-13T19:22:25.123549] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-13T19:22:25.217923] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-13T19:22:25.367670] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T19:22:26.017980] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-13T19:22:26.295556] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T19:22:26.616849] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T19:22:26.817925] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-13T19:22:27.538322] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T19:22:27.617969] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-13T19:22:28.417996] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-13T19:22:28.463089] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T19:22:29.217970] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-13T19:22:29.520304] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-13T19:22:29.565056] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-13T19:22:29.566208] [INFO ] [REMOTE ] HFND: Full fetch complete (1791 records). [2025-10-13T19:22:29.566299] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-13T19:22:29.763743] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-13T19:22:29.764023] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:22:29.764100] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:22:29.764180] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-13T19:22:29.764255] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-13T19:22:29.764294] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-13T19:22:29.764335] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-13T19:22:29.764402] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFND took 37.4s. Estimated remaining: 3h 11m 36s. Rate: 7.1 symbols/min [2025-10-13T19:22:29.949736] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:29.961409] [DEBUG] [LOCAL ] HGLB: Loaded 9807 existing records from primary storage. [2025-10-13T19:22:29.961676] [INFO ] [MAIN ] HGLB: Loaded 9807 existing records. [2025-10-13T19:22:30.023096] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-13T19:22:30.147233] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:30.147474] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-13T19:22:30.147521] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-13T19:22:30.147738] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-13T19:22:30.147793] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-13T19:22:30.499473] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:30.817893] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-13T19:22:31.135072] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T19:22:31.617956] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-13T19:22:32.358328] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T19:22:32.363633] [INFO ] [REMOTE ] HESM: Full fetch complete (69470 records). [2025-10-13T19:22:32.363796] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-13T19:22:32.425936] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-13T19:22:32.754835] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T19:22:32.780985] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-13T19:22:32.781417] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-13T19:22:32.782339] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-13T19:22:32.782402] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-13T19:22:32.783701] [DEBUG] [LOCAL ] HESM: Trimmed 69470 records to 48421 (keeping 200 days of data) [2025-10-13T19:22:33.076103] [DEBUG] [LOCAL ] HESM: Primary data saved (48421 records). [2025-10-13T19:22:33.076232] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-13T19:22:33.076307] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HESM took 45.1s. Estimated remaining: 3h 11m 21s. Rate: 7.1 symbols/min [2025-10-13T19:22:33.218923] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-13T19:22:33.244768] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:33.263833] [DEBUG] [LOCAL ] HGTY: Loaded 13389 existing records from primary storage. [2025-10-13T19:22:33.264138] [INFO ] [MAIN ] HGTY: Loaded 13389 existing records. [2025-10-13T19:22:33.446177] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-13T19:22:33.449800] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:33.452888] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-13T19:22:33.453211] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-13T19:22:33.453592] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-13T19:22:33.453677] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-13T19:22:33.797593] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:34.017914] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-13T19:22:34.031196] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:22:34.033138] [INFO ] [REMOTE ] HFRO: Full fetch complete (28184 records). [2025-10-13T19:22:34.033236] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-13T19:22:34.388032] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-13T19:22:34.388119] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-13T19:22:34.388718] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-13T19:22:34.388778] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-13T19:22:34.389440] [DEBUG] [LOCAL ] HFRO: Trimmed 28184 records to 17162 (keeping 200 days of data) [2025-10-13T19:22:34.493463] [DEBUG] [LOCAL ] HFRO: Primary data saved (17162 records). [2025-10-13T19:22:34.493610] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-13T19:22:34.493732] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HFRO took 26.5s. Estimated remaining: 3h 11m 3s. Rate: 7.1 symbols/min [2025-10-13T19:22:34.666732] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:34.710552] [DEBUG] [LOCAL ] HGV: Loaded 46989 existing records from primary storage. [2025-10-13T19:22:34.710891] [INFO ] [MAIN ] HGV: Loaded 46989 existing records. [2025-10-13T19:22:34.823078] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-13T19:22:34.902363] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T19:22:34.907803] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:34.911718] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-13T19:22:34.911803] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-13T19:22:34.912221] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-13T19:22:34.912275] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-13T19:22:35.275935] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:35.617973] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-13T19:22:35.740677] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T19:22:36.417968] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-13T19:22:36.427425] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T19:22:37.217947] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-13T19:22:37.337279] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-13T19:22:38.017944] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-13T19:22:38.677132] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:22:38.817895] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-13T19:22:38.948893] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T19:22:39.617972] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-13T19:22:40.037548] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T19:22:40.418016] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-13T19:22:40.683093] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T19:22:41.177493] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T19:22:41.217882] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-13T19:22:42.017911] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-13T19:22:42.076222] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:22:42.817977] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-13T19:22:42.998545] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-13T19:22:43.001636] [INFO ] [REMOTE ] HGER: Full fetch complete (18005 records). [2025-10-13T19:22:43.001746] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-13T19:22:43.364591] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-13T19:22:43.364716] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-13T19:22:43.365112] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-13T19:22:43.365151] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-13T19:22:43.365761] [DEBUG] [LOCAL ] HGER: Trimmed 18005 records to 14728 (keeping 200 days of data) [2025-10-13T19:22:43.453999] [DEBUG] [LOCAL ] HGER: Primary data saved (14728 records). [2025-10-13T19:22:43.454134] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-13T19:22:43.454214] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGER took 29.6s. Estimated remaining: 3h 10m 56s. Rate: 7.1 symbols/min [2025-10-13T19:22:43.619372] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-13T19:22:43.620847] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:22:43.655384] [DEBUG] [LOCAL ] HHH: Loaded 33400 existing records from primary storage. [2025-10-13T19:22:43.655689] [INFO ] [MAIN ] HHH: Loaded 33400 existing records. [2025-10-13T19:22:43.839197] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:22:43.839452] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-13T19:22:43.839521] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-13T19:22:43.840017] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-13T19:22:43.840088] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-13T19:22:43.963938] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T19:22:44.182292] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-13T19:22:44.234791] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:22:44.417919] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-13T19:22:45.217970] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-13T19:22:45.485060] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T19:22:46.005156] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:22:46.017871] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-13T19:22:46.817908] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-13T19:22:46.854993] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-13T19:22:47.594094] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-13T19:22:47.617891] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-13T19:22:48.305995] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-13T19:22:48.417966] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-13T19:22:49.182637] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T19:22:49.217918] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-13T19:22:49.887120] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-13T19:22:50.018009] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-13T19:22:50.817914] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-13T19:22:51.512573] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-13T19:22:51.617998] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-13T19:22:52.418007] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-13T19:22:53.217970] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-13T19:23:06.404729] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (15.59 seconds). [2025-10-13T19:23:06.408538] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-13T19:23:06.523110] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (14.91 seconds). [2025-10-13T19:23:06.534902] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-13T19:23:07.136146] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T19:23:07.141090] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-13T19:23:07.420056] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (14.20 seconds). [2025-10-13T19:23:07.423374] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-13T19:23:07.815484] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T19:23:07.825407] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-13T19:23:08.005394] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (15.59 seconds). [2025-10-13T19:23:08.011310] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-13T19:23:08.143226] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T19:23:08.148070] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-13T19:23:08.853125] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T19:23:08.854799] [INFO ] [REMOTE ] HGTY: Full fetch complete (17235 records). [2025-10-13T19:23:08.854875] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-13T19:23:09.089685] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:23:09.147431] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-13T19:23:09.183449] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T19:23:09.219184] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-13T19:23:09.279298] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-13T19:23:09.279485] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-13T19:23:09.279937] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-13T19:23:09.280074] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-13T19:23:09.289796] [DEBUG] [LOCAL ] HGTY: Trimmed 17235 records to 13154 (keeping 200 days of data) [2025-10-13T19:23:09.305935] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:23:09.315808] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-13T19:23:09.392387] [DEBUG] [LOCAL ] HGTY: Primary data saved (13154 records). [2025-10-13T19:23:09.392548] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-13T19:23:09.392632] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HGTY took 36.3s. Estimated remaining: 3h 11m 10s. Rate: 7.1 symbols/min [2025-10-13T19:23:09.555364] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:09.589710] [DEBUG] [LOCAL ] HI: Loaded 35881 existing records from primary storage. [2025-10-13T19:23:09.590002] [INFO ] [MAIN ] HI: Loaded 35881 existing records. [2025-10-13T19:23:09.765625] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:09.765851] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-13T19:23:09.765897] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-13T19:23:09.766272] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-13T19:23:09.766327] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-13T19:23:09.943687] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T19:23:10.018743] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-13T19:23:10.128826] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:10.129135] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-13T19:23:10.582393] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-13T19:23:10.589270] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-13T19:23:10.892282] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-13T19:23:10.895472] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-13T19:23:11.042897] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T19:23:11.054567] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-13T19:23:11.589435] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:23:11.596927] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-13T19:23:11.633972] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-13T19:23:11.636582] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-13T19:23:11.843061] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T19:23:11.849040] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-13T19:23:12.447171] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T19:23:12.450138] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-13T19:23:12.557341] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:23:12.582898] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-13T19:23:12.583692] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:23:12.591115] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-13T19:23:13.034219] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-13T19:23:13.036017] [INFO ] [REMOTE ] HGLB: Full fetch complete (14779 records). [2025-10-13T19:23:13.036085] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-13T19:23:13.417358] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-13T19:23:13.417576] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-13T19:23:13.418469] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-13T19:23:13.418556] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-13T19:23:13.429014] [DEBUG] [LOCAL ] HGLB: Trimmed 14779 records to 9724 (keeping 200 days of data) [2025-10-13T19:23:13.445734] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-13T19:23:13.497190] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-13T19:23:13.516740] [DEBUG] [LOCAL ] HGLB: Primary data saved (9724 records). [2025-10-13T19:23:13.516863] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-13T19:23:13.517014] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HGLB took 43.8s. Estimated remaining: 3h 10m 56s. Rate: 7.1 symbols/min [2025-10-13T19:23:13.682497] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:13.736793] [DEBUG] [LOCAL ] HIG: Loaded 51891 existing records from primary storage. [2025-10-13T19:23:13.737136] [INFO ] [MAIN ] HIG: Loaded 51891 existing records. [2025-10-13T19:23:13.916740] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:13.917029] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-13T19:23:13.917112] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-13T19:23:13.917914] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-13T19:23:13.918004] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-13T19:23:14.041955] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T19:23:14.097594] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-13T19:23:14.347272] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:14.347758] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-13T19:23:14.376237] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-13T19:23:14.389542] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-13T19:23:15.047852] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:23:15.055370] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-13T19:23:15.472482] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T19:23:15.480060] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-13T19:23:15.781156] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T19:23:15.791406] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-13T19:23:15.936868] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T19:23:15.942254] [INFO ] [REMOTE ] HGV: Full fetch complete (65811 records). [2025-10-13T19:23:15.942394] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-13T19:23:16.338042] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-13T19:23:16.338147] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-13T19:23:16.339028] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-13T19:23:16.339091] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-13T19:23:16.340535] [DEBUG] [LOCAL ] HGV: Trimmed 65811 records to 46369 (keeping 200 days of data) [2025-10-13T19:23:16.628134] [DEBUG] [LOCAL ] HGV: Primary data saved (46369 records). [2025-10-13T19:23:16.628545] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-13T19:23:16.628678] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HGV took 42.1s. Estimated remaining: 3h 10m 41s. Rate: 7.1 symbols/min [2025-10-13T19:23:16.823272] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:16.824462] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T19:23:16.833616] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-13T19:23:16.865470] [DEBUG] [LOCAL ] HII: Loaded 34485 existing records from primary storage. [2025-10-13T19:23:16.865760] [INFO ] [MAIN ] HII: Loaded 34485 existing records. [2025-10-13T19:23:17.048616] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:17.048935] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-13T19:23:17.049009] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-13T19:23:17.057408] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-13T19:23:17.064684] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-13T19:23:17.148164] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-13T19:23:17.219853] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-13T19:23:17.486135] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:17.516909] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:23:17.945479] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-13T19:23:18.017949] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-13T19:23:18.664249] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T19:23:18.817967] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-13T19:23:19.592467] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T19:23:19.617895] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-13T19:23:20.200744] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T19:23:20.417942] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-13T19:23:20.683754] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T19:23:21.217984] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-13T19:23:22.017995] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-13T19:23:22.158586] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T19:23:22.769499] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T19:23:22.817901] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-13T19:23:23.310457] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T19:23:23.617973] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-13T19:23:24.418000] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-13T19:23:24.687768] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T19:23:25.000602] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-13T19:23:25.217963] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-13T19:23:25.771284] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T19:23:25.775633] [INFO ] [REMOTE ] HHH: Full fetch complete (45718 records). [2025-10-13T19:23:25.775856] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-13T19:23:26.023994] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-13T19:23:26.220278] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-13T19:23:26.220384] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-13T19:23:26.221415] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-13T19:23:26.221514] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-13T19:23:26.222909] [DEBUG] [LOCAL ] HHH: Trimmed 45718 records to 33136 (keeping 200 days of data) [2025-10-13T19:23:26.432679] [DEBUG] [LOCAL ] HHH: Primary data saved (33136 records). [2025-10-13T19:23:26.432887] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-13T19:23:26.432989] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HHH took 43.0s. Estimated remaining: 3h 10m 34s. Rate: 7.1 symbols/min [2025-10-13T19:23:26.613976] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:26.643155] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T19:23:26.706355] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-10-13T19:23:26.706870] [INFO ] [MAIN ] HIMS: Loaded 54597 existing records. [2025-10-13T19:23:26.822842] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-13T19:23:26.912329] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:26.912864] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-13T19:23:26.912930] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-13T19:23:26.913452] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-13T19:23:26.913511] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-13T19:23:27.291551] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:27.617904] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-13T19:23:27.930567] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T19:23:28.360919] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T19:23:28.417911] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-13T19:23:29.217968] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-13T19:23:29.828047] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T19:23:30.023454] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-13T19:23:30.037039] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-13T19:23:30.555309] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-13T19:23:30.817904] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-13T19:23:31.406401] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T19:23:31.617961] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-13T19:23:32.418022] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-13T19:23:32.982376] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T19:23:32.987390] [INFO ] [REMOTE ] HI: Full fetch complete (50113 records). [2025-10-13T19:23:32.987593] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-13T19:23:33.233319] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-13T19:23:33.372036] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-13T19:23:33.372134] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-13T19:23:33.372994] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-13T19:23:33.373067] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-13T19:23:33.404803] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-13T19:23:33.404975] [DEBUG] [LOCAL ] HI: Trimmed 50113 records to 35572 (keeping 200 days of data) [2025-10-13T19:23:33.628785] [DEBUG] [LOCAL ] HI: Primary data saved (35572 records). [2025-10-13T19:23:33.628936] [INFO ] [MAIN ] HI: Full history saved. [2025-10-13T19:23:33.629017] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HI took 24.2s. Estimated remaining: 3h 10m 24s. Rate: 7.1 symbols/min [2025-10-13T19:23:33.798434] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:33.820792] [DEBUG] [LOCAL ] HIO: Loaded 24411 existing records from primary storage. [2025-10-13T19:23:33.821045] [INFO ] [MAIN ] HIO: Loaded 24411 existing records. [2025-10-13T19:23:33.998021] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:33.998256] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-13T19:23:33.998302] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-13T19:23:33.998607] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-13T19:23:33.998701] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-13T19:23:34.028942] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-13T19:23:34.357467] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:34.403435] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-13T19:23:34.715418] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T19:23:34.817896] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-13T19:23:35.617926] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-13T19:23:36.417899] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-13T19:23:36.528351] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-13T19:23:36.632966] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T19:23:37.190181] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T19:23:37.217897] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-13T19:23:37.330552] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-13T19:23:38.017913] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-13T19:23:38.625974] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T19:23:38.818193] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-13T19:23:39.487968] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T19:23:39.618090] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-13T19:23:40.417949] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-13T19:23:41.113296] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T19:23:41.116598] [INFO ] [REMOTE ] HII: Full fetch complete (52301 records). [2025-10-13T19:23:41.116709] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-13T19:23:41.222332] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-13T19:23:41.513936] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-13T19:23:41.514223] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-13T19:23:41.515108] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-13T19:23:41.515261] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-13T19:23:41.516759] [DEBUG] [LOCAL ] HII: Trimmed 52301 records to 33833 (keeping 200 days of data) [2025-10-13T19:23:41.671095] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-10-13T19:23:41.708929] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-13T19:23:41.827997] [DEBUG] [LOCAL ] HII: Primary data saved (33833 records). [2025-10-13T19:23:41.828565] [INFO ] [MAIN ] HII: Full history saved. [2025-10-13T19:23:41.828889] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HII took 25.2s. Estimated remaining: 3h 10m 15s. Rate: 7.1 symbols/min [2025-10-13T19:23:41.995560] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:23:42.016183] [DEBUG] [LOCAL ] HIPO: Loaded 22218 existing records from primary storage. [2025-10-13T19:23:42.016434] [INFO ] [MAIN ] HIPO: Loaded 22218 existing records. [2025-10-13T19:23:42.027549] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-13T19:23:42.207172] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:23:42.207355] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-13T19:23:42.207401] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-13T19:23:42.207712] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-13T19:23:42.207771] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-13T19:23:42.556364] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:23:42.818001] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-13T19:23:43.166581] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-13T19:23:43.245189] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T19:23:43.617951] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-13T19:23:44.417968] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-13T19:23:44.748140] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T19:23:45.217908] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-13T19:23:45.388672] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-13T19:23:45.685917] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T19:23:46.018021] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-13T19:23:46.473069] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-13T19:23:46.817971] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-13T19:23:47.617977] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-13T19:23:48.417925] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-13T19:23:48.550509] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T19:23:48.598939] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-13T19:23:48.764390] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-13T19:23:49.217944] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-13T19:23:49.267425] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T19:23:50.017966] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-13T19:23:50.100104] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-13T19:23:50.818027] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-13T19:23:51.392225] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T19:23:51.617925] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-13T19:23:51.782433] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T19:23:52.417975] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-13T19:23:52.671867] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T19:23:53.217951] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-13T19:23:54.018004] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-13T19:23:54.309935] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T19:23:54.817911] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-13T19:23:55.004495] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-10-13T19:23:55.074994] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T19:23:55.617895] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-13T19:23:55.936604] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-13T19:23:56.417918] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-13T19:23:56.845003] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T19:23:57.217907] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-13T19:23:57.614614] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T19:23:58.017973] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-13T19:23:58.817897] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-13T19:23:59.218502] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-13T19:23:59.478165] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T19:23:59.483593] [INFO ] [REMOTE ] HIG: Full fetch complete (73169 records). [2025-10-13T19:23:59.483754] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-13T19:23:59.635693] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-13T19:23:59.893134] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-13T19:23:59.893503] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-13T19:23:59.895152] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-13T19:23:59.895826] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-13T19:23:59.934429] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-13T19:23:59.931875] [DEBUG] [LOCAL ] HIG: Trimmed 73169 records to 51154 (keeping 200 days of data) [2025-10-13T19:24:00.289334] [DEBUG] [LOCAL ] HIG: Primary data saved (51154 records). [2025-10-13T19:24:00.289539] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-13T19:24:00.290861] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIG took 46.8s. Estimated remaining: 3h 10m 20s. Rate: 7.1 symbols/min [2025-10-13T19:24:00.431932] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-13T19:24:00.467793] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:00.524771] [DEBUG] [LOCAL ] HIW: Loaded 45116 existing records from primary storage. [2025-10-13T19:24:00.525165] [INFO ] [MAIN ] HIW: Loaded 45116 existing records. [2025-10-13T19:24:00.720225] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:00.720725] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-13T19:24:00.720811] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-13T19:24:00.726542] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-13T19:24:00.734121] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-13T19:24:00.810505] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T19:24:01.111784] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:01.217982] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-13T19:24:02.017980] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-13T19:24:02.735858] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T19:24:02.817886] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-13T19:24:03.232183] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-13T19:24:03.350723] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T19:24:03.354471] [INFO ] [REMOTE ] HIO: Full fetch complete (37736 records). [2025-10-13T19:24:03.354546] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-13T19:24:03.625082] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-13T19:24:03.722470] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-13T19:24:03.722549] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-13T19:24:03.723244] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-13T19:24:03.723306] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-13T19:24:03.724120] [DEBUG] [LOCAL ] HIO: Trimmed 37736 records to 24076 (keeping 200 days of data) [2025-10-13T19:24:03.861569] [DEBUG] [LOCAL ] HIO: Primary data saved (24076 records). [2025-10-13T19:24:03.861724] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-13T19:24:03.861809] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIO took 30.2s. Estimated remaining: 3h 10m 5s. Rate: 7.1 symbols/min [2025-10-13T19:24:04.034937] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:04.054894] [DEBUG] [LOCAL ] HIX: Loaded 20859 existing records from primary storage. [2025-10-13T19:24:04.055149] [INFO ] [MAIN ] HIX: Loaded 20859 existing records. [2025-10-13T19:24:04.249287] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:04.250008] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-13T19:24:04.250134] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-13T19:24:04.250619] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-13T19:24:04.250716] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-13T19:24:04.436460] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:24:04.432923] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-13T19:24:04.682877] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:05.217956] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-13T19:24:05.508409] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T19:24:06.017958] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-13T19:24:06.095577] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-13T19:24:06.817953] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-13T19:24:06.873446] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T19:24:07.220346] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T19:24:07.618066] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-13T19:24:07.900896] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T19:24:08.418033] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-13T19:24:08.811033] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T19:24:09.217970] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-13T19:24:10.017956] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-13T19:24:10.178410] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:24:10.305629] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T19:24:10.308045] [INFO ] [REMOTE ] HIPO: Full fetch complete (31333 records). [2025-10-13T19:24:10.308134] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-13T19:24:10.688109] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-13T19:24:10.688225] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-13T19:24:10.689499] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-13T19:24:10.689567] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-13T19:24:10.690630] [DEBUG] [LOCAL ] HIPO: Trimmed 31333 records to 21977 (keeping 200 days of data) [2025-10-13T19:24:10.825618] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-13T19:24:10.833063] [DEBUG] [LOCAL ] HIPO: Primary data saved (21977 records). [2025-10-13T19:24:10.834476] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-13T19:24:10.834624] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIPO took 29.0s. Estimated remaining: 3h 9m 55s. Rate: 7.1 symbols/min [2025-10-13T19:24:11.007433] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:11.029846] [DEBUG] [LOCAL ] HKD: Loaded 18878 existing records from primary storage. [2025-10-13T19:24:11.030112] [INFO ] [MAIN ] HKD: Loaded 18878 existing records. [2025-10-13T19:24:11.160903] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T19:24:11.230738] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:11.230967] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-13T19:24:11.231019] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-13T19:24:11.231383] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-13T19:24:11.231442] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-13T19:24:11.574120] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:11.617890] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-13T19:24:12.418002] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-13T19:24:12.887802] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T19:24:13.217918] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-13T19:24:13.497986] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T19:24:13.595485] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-13T19:24:13.602080] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-10-13T19:24:13.602308] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-13T19:24:14.061364] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-13T19:24:14.088591] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-13T19:24:14.088731] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-13T19:24:14.090024] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-13T19:24:14.090093] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-13T19:24:14.091952] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-10-13T19:24:14.459932] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-13T19:24:14.460154] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-13T19:24:14.460262] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIMS took 48.0s. Estimated remaining: 3h 9m 40s. Rate: 7.1 symbols/min [2025-10-13T19:24:14.651426] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:14.735335] [DEBUG] [LOCAL ] HL: Loaded 54452 existing records from primary storage. [2025-10-13T19:24:14.739276] [INFO ] [MAIN ] HL: Loaded 54452 existing records. [2025-10-13T19:24:14.788389] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T19:24:14.828803] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-13T19:24:14.954086] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:14.954366] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-13T19:24:14.954418] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-13T19:24:14.955088] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-13T19:24:14.955159] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-13T19:24:15.369508] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-13T19:24:15.383424] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:15.617947] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-13T19:24:16.266572] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T19:24:16.417957] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-13T19:24:16.731913] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T19:24:17.217973] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-13T19:24:17.685249] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-13T19:24:18.018008] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-13T19:24:18.220308] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T19:24:18.817988] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-13T19:24:19.066962] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T19:24:19.617996] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-13T19:24:20.417991] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-13T19:24:20.699383] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T19:24:20.729531] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:24:21.217973] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-13T19:24:22.017988] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-13T19:24:22.152016] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T19:24:22.199242] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T19:24:22.817969] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-13T19:24:23.618001] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-13T19:24:23.775940] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T19:24:24.267589] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T19:24:24.417973] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-13T19:24:24.914100] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:24:25.217957] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-13T19:24:25.948203] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T19:24:26.017899] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-13T19:24:26.755799] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T19:24:26.817948] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-13T19:24:27.623927] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-13T19:24:27.644525] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-13T19:24:27.704580] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-13T19:24:28.417966] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-13T19:24:29.217983] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-13T19:24:29.582455] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T19:24:29.582984] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T19:24:30.017950] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-13T19:24:30.434067] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-13T19:24:30.817967] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-13T19:24:31.617999] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-13T19:24:31.805271] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T19:24:32.261847] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-13T19:24:32.418054] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-13T19:24:33.217916] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-13T19:24:33.250623] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T19:24:33.689767] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T19:24:34.017922] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-13T19:24:34.817957] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-13T19:24:35.031409] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:24:35.033800] [INFO ] [REMOTE ] HIX: Full fetch complete (30138 records). [2025-10-13T19:24:35.033899] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-13T19:24:35.439336] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-13T19:24:35.477160] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-13T19:24:35.477359] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-13T19:24:35.478158] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-13T19:24:35.478241] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-13T19:24:35.479459] [DEBUG] [LOCAL ] HIX: Trimmed 30138 records to 20501 (keeping 200 days of data) [2025-10-13T19:24:35.605159] [DEBUG] [LOCAL ] HIX: Primary data saved (20501 records). [2025-10-13T19:24:35.605330] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-13T19:24:35.605424] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HIX took 31.7s. Estimated remaining: 3h 9m 48s. Rate: 7.1 symbols/min [2025-10-13T19:24:35.628231] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-13T19:24:35.786620] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:35.841278] [DEBUG] [LOCAL ] HLF: Loaded 49122 existing records from primary storage. [2025-10-13T19:24:35.856492] [INFO ] [MAIN ] HLF: Loaded 49122 existing records. [2025-10-13T19:24:35.857028] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-13T19:24:36.045802] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:36.046089] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-13T19:24:36.046146] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-13T19:24:36.046768] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-13T19:24:36.046826] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-13T19:24:36.418264] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:36.418384] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-13T19:24:37.149879] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-13T19:24:37.154565] [INFO ] [REMOTE ] HIW: Full fetch complete (64723 records). [2025-10-13T19:24:37.154719] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-13T19:24:37.227817] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-13T19:24:37.555019] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-13T19:24:37.555142] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-13T19:24:37.556380] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-13T19:24:37.556458] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-13T19:24:37.558442] [DEBUG] [LOCAL ] HIW: Trimmed 64723 records to 44556 (keeping 200 days of data) [2025-10-13T19:24:37.822528] [DEBUG] [LOCAL ] HIW: Primary data saved (44556 records). [2025-10-13T19:24:37.822697] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-13T19:24:37.823581] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HIW took 37.5s. Estimated remaining: 3h 9m 31s. Rate: 7.1 symbols/min [2025-10-13T19:24:37.990505] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:38.025912] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-13T19:24:38.027515] [DEBUG] [LOCAL ] HLI: Loaded 31364 existing records from primary storage. [2025-10-13T19:24:38.029168] [INFO ] [MAIN ] HLI: Loaded 31364 existing records. [2025-10-13T19:24:38.206292] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:38.206593] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-13T19:24:38.206683] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-13T19:24:38.207101] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-13T19:24:38.207156] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-13T19:24:38.546087] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-13T19:24:38.629342] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:38.817968] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-13T19:24:38.961833] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T19:24:39.037212] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:24:39.040022] [INFO ] [REMOTE ] HKD: Full fetch complete (28356 records). [2025-10-13T19:24:39.040116] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-13T19:24:39.414287] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-13T19:24:39.414375] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-13T19:24:39.414960] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-13T19:24:39.415020] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-13T19:24:39.415748] [DEBUG] [LOCAL ] HKD: Trimmed 28356 records to 18625 (keeping 200 days of data) [2025-10-13T19:24:39.518745] [DEBUG] [LOCAL ] HKD: Primary data saved (18625 records). [2025-10-13T19:24:39.518887] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-13T19:24:39.518965] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HKD took 28.7s. Estimated remaining: 3h 9m 14s. Rate: 7.1 symbols/min [2025-10-13T19:24:39.623320] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-13T19:24:39.698621] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:39.728289] [DEBUG] [LOCAL ] HLIO: Loaded 28206 existing records from primary storage. [2025-10-13T19:24:39.728569] [INFO ] [MAIN ] HLIO: Loaded 28206 existing records. [2025-10-13T19:24:39.909609] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:39.909890] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-13T19:24:39.909948] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-13T19:24:39.910313] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-13T19:24:39.910377] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-13T19:24:40.265293] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:40.417912] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-13T19:24:40.887675] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T19:24:41.033802] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T19:24:41.217949] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-13T19:24:41.420905] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T19:24:42.017947] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-13T19:24:42.817955] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-13T19:24:43.205836] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T19:24:43.617947] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-13T19:24:43.727948] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T19:24:43.833435] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T19:24:44.417952] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-13T19:24:45.217968] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-13T19:24:45.769281] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T19:24:45.814356] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-13T19:24:46.017960] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-13T19:24:46.817906] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-13T19:24:46.898916] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:24:46.975128] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T19:24:47.617993] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-13T19:24:48.029429] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-13T19:24:48.417903] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-13T19:24:48.645149] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T19:24:49.218012] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-13T19:24:50.018017] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-13T19:24:50.551212] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T19:24:50.617405] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-13T19:24:50.622977] [INFO ] [REMOTE ] HL: Full fetch complete (77666 records). [2025-10-13T19:24:50.623091] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-13T19:24:50.828311] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-13T19:24:51.016531] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-13T19:24:51.016638] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-13T19:24:51.017706] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-13T19:24:51.017851] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-13T19:24:51.019575] [DEBUG] [LOCAL ] HL: Trimmed 77666 records to 53672 (keeping 200 days of data) [2025-10-13T19:24:51.254549] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-13T19:24:51.355142] [DEBUG] [LOCAL ] HL: Primary data saved (53672 records). [2025-10-13T19:24:51.355280] [INFO ] [MAIN ] HL: Full history saved. [2025-10-13T19:24:51.355357] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HL took 36.9s. Estimated remaining: 3h 9m 10s. Rate: 7.1 symbols/min [2025-10-13T19:24:51.521808] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:24:51.551973] [DEBUG] [LOCAL ] HLLY: Loaded 34004 existing records from primary storage. [2025-10-13T19:24:51.552240] [INFO ] [MAIN ] HLLY: Loaded 34004 existing records. [2025-10-13T19:24:51.626590] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-13T19:24:51.737745] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:24:51.741152] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-13T19:24:51.741213] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-13T19:24:51.741549] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-13T19:24:51.741605] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-13T19:24:52.088851] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:24:52.333865] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:24:52.417881] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-13T19:24:52.966058] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-13T19:24:53.217960] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-13T19:24:53.367775] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-13T19:24:54.017949] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-13T19:24:54.824685] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-13T19:24:54.830587] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T19:24:55.379911] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:24:55.617915] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-13T19:24:56.237072] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T19:24:56.417950] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-13T19:24:57.217907] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-13T19:24:57.298083] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:24:57.595223] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T19:24:58.017966] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-13T19:24:58.036233] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T19:24:58.817971] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-13T19:24:59.076556] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T19:24:59.617977] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-13T19:25:00.229339] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T19:25:00.418000] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-13T19:25:01.217957] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-13T19:25:01.261168] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T19:25:01.950819] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T19:25:02.018030] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-13T19:25:02.702287] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T19:25:02.817985] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-13T19:25:03.531762] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T19:25:03.618016] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-13T19:25:04.335842] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T19:25:04.417984] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-13T19:25:05.008820] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T19:25:05.217980] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-13T19:25:05.283589] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T19:25:06.017967] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-13T19:25:06.817952] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-13T19:25:06.886606] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:25:07.331312] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-13T19:25:07.617903] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-13T19:25:08.087505] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T19:25:08.417940] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-13T19:25:09.217947] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-13T19:25:09.314875] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T19:25:09.510987] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-13T19:25:10.018065] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-13T19:25:10.383578] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:25:10.387295] [INFO ] [REMOTE ] HLI: Full fetch complete (45136 records). [2025-10-13T19:25:10.387416] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-13T19:25:10.778062] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-13T19:25:10.778165] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-13T19:25:10.778964] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-13T19:25:10.779024] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-13T19:25:10.780062] [DEBUG] [LOCAL ] HLI: Trimmed 45136 records to 30937 (keeping 200 days of data) [2025-10-13T19:25:10.835845] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-13T19:25:10.974606] [DEBUG] [LOCAL ] HLI: Primary data saved (30937 records). [2025-10-13T19:25:10.974779] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-13T19:25:10.975975] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLI took 33.2s. Estimated remaining: 3h 9m 16s. Rate: 7.1 symbols/min [2025-10-13T19:25:11.141704] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:11.202557] [DEBUG] [LOCAL ] HLN: Loaded 53870 existing records from primary storage. [2025-10-13T19:25:11.203116] [INFO ] [MAIN ] HLN: Loaded 53870 existing records. [2025-10-13T19:25:11.380846] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:11.381137] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-13T19:25:11.381192] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-13T19:25:11.381938] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-13T19:25:11.382000] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-13T19:25:11.636567] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-13T19:25:11.767403] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:11.786787] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:25:11.935001] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T19:25:12.418000] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-13T19:25:12.958051] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T19:25:13.217962] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-13T19:25:13.270954] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T19:25:13.273933] [INFO ] [REMOTE ] HLIO: Full fetch complete (36522 records). [2025-10-13T19:25:13.274049] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-13T19:25:13.657195] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-13T19:25:13.657340] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-13T19:25:13.658272] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-13T19:25:13.658340] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-13T19:25:13.659332] [DEBUG] [LOCAL ] HLIO: Trimmed 36522 records to 28073 (keeping 200 days of data) [2025-10-13T19:25:13.840194] [DEBUG] [LOCAL ] HLIO: Primary data saved (28073 records). [2025-10-13T19:25:13.840350] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-13T19:25:13.840589] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLIO took 34.3s. Estimated remaining: 3h 9m 0s. Rate: 7.1 symbols/min [2025-10-13T19:25:14.011860] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:14.018032] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-13T19:25:14.066976] [DEBUG] [LOCAL ] HLT: Loaded 51350 existing records from primary storage. [2025-10-13T19:25:14.067327] [INFO ] [MAIN ] HLT: Loaded 51350 existing records. [2025-10-13T19:25:14.245966] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:14.246186] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-13T19:25:14.246233] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-13T19:25:14.246784] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-13T19:25:14.246853] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-13T19:25:14.598632] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:14.817897] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-13T19:25:15.035863] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T19:25:15.466781] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:25:15.617909] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-13T19:25:16.358126] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T19:25:16.417886] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-13T19:25:16.566356] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-13T19:25:17.217952] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-13T19:25:17.779808] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T19:25:18.017983] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-13T19:25:18.631478] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:25:18.635804] [INFO ] [REMOTE ] HLLY: Full fetch complete (46214 records). [2025-10-13T19:25:18.635889] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-13T19:25:18.823033] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-13T19:25:19.055855] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-13T19:25:19.055935] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-13T19:25:19.056635] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-13T19:25:19.056783] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-13T19:25:19.057771] [DEBUG] [LOCAL ] HLLY: Trimmed 46214 records to 33620 (keeping 200 days of data) [2025-10-13T19:25:19.247413] [DEBUG] [LOCAL ] HLLY: Primary data saved (33620 records). [2025-10-13T19:25:19.247556] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-13T19:25:19.247696] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLLY took 27.9s. Estimated remaining: 3h 8m 48s. Rate: 7.1 symbols/min [2025-10-13T19:25:19.426955] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:19.475770] [DEBUG] [LOCAL ] HLX: Loaded 48235 existing records from primary storage. [2025-10-13T19:25:19.476112] [INFO ] [MAIN ] HLX: Loaded 48235 existing records. [2025-10-13T19:25:19.638314] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-13T19:25:19.661681] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:19.663070] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-13T19:25:19.663225] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-13T19:25:19.663939] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-13T19:25:19.664002] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-13T19:25:19.947977] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-13T19:25:20.061068] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:20.418008] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-13T19:25:20.582532] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-13T19:25:21.217912] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-13T19:25:21.271007] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T19:25:21.277028] [INFO ] [REMOTE ] HLF: Full fetch complete (70872 records). [2025-10-13T19:25:21.277201] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-13T19:25:21.702207] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-13T19:25:21.702487] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-13T19:25:21.704086] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-13T19:25:21.704159] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-13T19:25:21.706832] [DEBUG] [LOCAL ] HLF: Trimmed 70872 records to 48470 (keeping 200 days of data) [2025-10-13T19:25:21.844999] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T19:25:22.017977] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-13T19:25:22.052844] [DEBUG] [LOCAL ] HLF: Primary data saved (48470 records). [2025-10-13T19:25:22.053770] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-13T19:25:22.053921] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLF took 46.4s. Estimated remaining: 3h 8m 32s. Rate: 7.1 symbols/min [2025-10-13T19:25:22.224573] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:22.270224] [DEBUG] [LOCAL ] HMC: Loaded 47231 existing records from primary storage. [2025-10-13T19:25:22.270526] [INFO ] [MAIN ] HMC: Loaded 47231 existing records. [2025-10-13T19:25:22.442937] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:22.443179] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-13T19:25:22.443225] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-13T19:25:22.443699] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-13T19:25:22.443754] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-13T19:25:22.799866] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:22.836211] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-13T19:25:22.856840] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T19:25:23.617914] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-13T19:25:23.660692] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:25:24.418000] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-13T19:25:24.872008] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-13T19:25:25.217973] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-13T19:25:25.484258] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T19:25:25.976542] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T19:25:26.017986] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-13T19:25:26.817989] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-13T19:25:26.936273] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T19:25:27.617953] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-13T19:25:27.786829] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T19:25:28.418010] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-13T19:25:28.731532] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T19:25:29.150496] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:25:29.217876] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-13T19:25:29.712135] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-13T19:25:30.017970] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-13T19:25:30.817957] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-13T19:25:31.025184] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T19:25:31.617971] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-13T19:25:32.018766] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T19:25:32.136256] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-13T19:25:32.417982] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-13T19:25:33.217969] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-13T19:25:33.642441] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-13T19:25:33.995327] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:25:34.017875] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-13T19:25:34.123204] [DEBUG] [REMOTE ] HLX: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-13T19:25:34.123361] [WARN ] [REMOTE ] HLX: No data returned for month 2025-04 [2025-10-13T19:25:34.123467] [FATAL] [REMOTE ] HLX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:25:34.123526] [FATAL] [MAIN ] HLX: Failed to fetch primary data. [2025-10-13T19:25:34.123562] [WARN ] [MAIN ] HLX: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:25:34.123597] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-13T19:25:34.123682] [DEBUG] [LOCAL ] HLX: No primary data file found to delete. [2025-10-13T19:25:34.123739] [INFO ] [LOCAL ] HLX: Starting deletion of derivative data. [2025-10-13T19:25:34.123928] [DEBUG] [LOCAL ] HLX: Deleted derivative data file. [2025-10-13T19:25:34.124011] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLX took 14.9s. Estimated remaining: 3h 8m 28s. Rate: 7.1 symbols/min [2025-10-13T19:25:34.291747] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:34.314525] [DEBUG] [LOCAL ] HMN: Loaded 23715 existing records from primary storage. [2025-10-13T19:25:34.314782] [INFO ] [MAIN ] HMN: Loaded 23715 existing records. [2025-10-13T19:25:34.485513] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:34.485709] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-13T19:25:34.485763] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-13T19:25:34.486037] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-13T19:25:34.486079] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-13T19:25:34.818048] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-13T19:25:34.841076] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:35.054564] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T19:25:35.617950] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-13T19:25:36.417909] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-13T19:25:36.451941] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T19:25:37.217901] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-13T19:25:37.493091] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T19:25:38.023077] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-13T19:25:38.039755] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-13T19:25:38.670037] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T19:25:38.817885] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-13T19:25:39.057066] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T19:25:39.617967] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-13T19:25:40.417895] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-13T19:25:40.618567] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-13T19:25:41.217969] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-13T19:25:41.428933] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T19:25:41.452116] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T19:25:42.018031] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-13T19:25:42.817950] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-13T19:25:42.995407] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T19:25:43.617894] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-13T19:25:43.701209] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-13T19:25:43.923155] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T19:25:44.418008] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-13T19:25:45.217969] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-13T19:25:45.307742] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T19:25:45.402873] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T19:25:46.017912] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-13T19:25:46.817913] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-13T19:25:46.985206] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:25:47.617989] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-13T19:25:47.669209] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T19:25:48.416877] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-13T19:25:48.426675] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-13T19:25:48.488848] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T19:25:48.761266] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-13T19:25:48.767815] [INFO ] [REMOTE ] HLT: Full fetch complete (73526 records). [2025-10-13T19:25:48.768006] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-13T19:25:49.173771] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-13T19:25:49.173891] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-13T19:25:49.175368] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-13T19:25:49.175438] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-13T19:25:49.177480] [DEBUG] [LOCAL ] HLT: Trimmed 73526 records to 50609 (keeping 200 days of data) [2025-10-13T19:25:49.234508] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-13T19:25:49.516893] [DEBUG] [LOCAL ] HLT: Primary data saved (50609 records). [2025-10-13T19:25:49.517104] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-13T19:25:49.517244] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HLT took 35.7s. Estimated remaining: 3h 8m 29s. Rate: 7.1 symbols/min [2025-10-13T19:25:49.692197] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:49.755054] [DEBUG] [LOCAL ] HMY: Loaded 53913 existing records from primary storage. [2025-10-13T19:25:49.755482] [INFO ] [MAIN ] HMY: Loaded 53913 existing records. [2025-10-13T19:25:49.941836] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:49.942151] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-13T19:25:49.942206] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-13T19:25:49.942865] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-13T19:25:49.942925] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-13T19:25:50.023180] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-13T19:25:50.318468] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:50.501325] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-13T19:25:50.817957] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-13T19:25:51.617978] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-13T19:25:51.656681] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T19:25:51.662199] [INFO ] [REMOTE ] HLN: Full fetch complete (76836 records). [2025-10-13T19:25:51.662320] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-13T19:25:52.076340] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-13T19:25:52.077086] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-13T19:25:52.076991] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T19:25:52.078389] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-13T19:25:52.083153] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-13T19:25:52.086553] [DEBUG] [LOCAL ] HLN: Trimmed 76836 records to 53113 (keeping 200 days of data) [2025-10-13T19:25:52.421268] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-13T19:25:52.432223] [DEBUG] [LOCAL ] HLN: Primary data saved (53113 records). [2025-10-13T19:25:52.432462] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-13T19:25:52.433873] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HLN took 41.5s. Estimated remaining: 3h 8m 13s. Rate: 7.1 symbols/min [2025-10-13T19:25:52.617837] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:52.618126] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-13T19:25:52.618172] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-13T19:25:52.618328] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-13T19:25:52.618404] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-13T19:25:52.618507] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-13T19:25:52.618560] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-13T19:25:52.983101] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:53.218006] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-13T19:25:53.245478] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T19:25:53.250413] [INFO ] [REMOTE ] HMC: Full fetch complete (69018 records). [2025-10-13T19:25:53.250535] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-13T19:25:53.647486] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-13T19:25:53.647594] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-13T19:25:53.652220] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-13T19:25:53.652429] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-13T19:25:53.654137] [DEBUG] [LOCAL ] HMC: Trimmed 69018 records to 46553 (keeping 200 days of data) [2025-10-13T19:25:53.759589] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T19:25:53.953465] [DEBUG] [LOCAL ] HMC: Primary data saved (46553 records). [2025-10-13T19:25:53.953601] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-13T19:25:53.953722] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMC took 31.9s. Estimated remaining: 3h 7m 56s. Rate: 7.1 symbols/min [2025-10-13T19:25:54.027916] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-13T19:25:54.127203] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:25:54.159195] [DEBUG] [LOCAL ] HNI: Loaded 29751 existing records from primary storage. [2025-10-13T19:25:54.159483] [INFO ] [MAIN ] HNI: Loaded 29751 existing records. [2025-10-13T19:25:54.276364] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:25:54.308671] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-13T19:25:54.334995] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:25:54.338602] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-13T19:25:54.338434] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:25:54.338772] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:25:54.338908] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-13T19:25:54.339026] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-13T19:25:54.339181] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-13T19:25:54.339326] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-13T19:25:54.339271] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-13T19:25:54.339550] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-13T19:25:54.339666] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HNGE took 1.9s. Estimated remaining: 3h 7m 37s. Rate: 7.1 symbols/min [2025-10-13T19:25:54.339855] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-13T19:25:54.339929] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-13T19:25:54.696789] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:25:54.800989] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-13T19:25:54.817883] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-13T19:25:55.618007] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-13T19:25:56.418025] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-13T19:25:56.619098] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-13T19:25:56.789639] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-13T19:25:57.217969] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-13T19:25:57.635882] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-13T19:25:58.017948] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-13T19:25:58.244069] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-13T19:25:58.817955] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-13T19:25:59.140518] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-13T19:25:59.531835] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T19:25:59.534232] [INFO ] [REMOTE ] HMN: Full fetch complete (31420 records). [2025-10-13T19:25:59.534313] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-13T19:25:59.623476] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-13T19:25:59.900546] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-13T19:25:59.900670] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-13T19:25:59.901294] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-13T19:25:59.901354] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-13T19:25:59.902143] [DEBUG] [LOCAL ] HMN: Trimmed 31420 records to 23424 (keeping 200 days of data) [2025-10-13T19:26:00.047129] [DEBUG] [LOCAL ] HMN: Primary data saved (23424 records). [2025-10-13T19:26:00.047261] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-13T19:26:00.047349] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HMN took 25.9s. Estimated remaining: 3h 7m 25s. Rate: 7.1 symbols/min [2025-10-13T19:26:00.417917] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-13T19:26:01.688216] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-13T19:26:01.699094] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-13T19:26:01.745523] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T19:26:02.018030] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-13T19:26:03.355311] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T19:26:03.362447] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-13T19:26:03.467974] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T19:26:03.617935] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-13T19:26:04.562216] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-13T19:26:04.568455] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-13T19:26:05.670402] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T19:26:05.676052] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-13T19:26:05.882327] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-13T19:26:06.018012] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-13T19:26:06.920529] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T19:26:06.926669] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-13T19:26:07.999795] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-13T19:26:08.005503] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-13T19:26:08.154014] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-13T19:26:08.417993] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-13T19:26:09.508721] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:26:09.518243] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-13T19:26:10.436816] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-13T19:26:10.452213] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-13T19:26:11.156500] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T19:26:11.165949] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-13T19:26:12.496847] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T19:26:12.509835] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-13T19:26:12.576108] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:26:12.580043] [INFO ] [REMOTE ] HNI: Full fetch complete (41775 records). [2025-10-13T19:26:12.580146] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-13T19:26:13.010114] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-13T19:26:13.010243] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-13T19:26:13.011627] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-13T19:26:13.011720] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-13T19:26:13.013221] [DEBUG] [LOCAL ] HNI: Trimmed 41775 records to 29427 (keeping 200 days of data) [2025-10-13T19:26:13.201524] [DEBUG] [LOCAL ] HNI: Primary data saved (29427 records). [2025-10-13T19:26:13.201702] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-13T19:26:13.201802] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HNI took 19.2s. Estimated remaining: 3h 7m 23s. Rate: 7.1 symbols/min [2025-10-13T19:26:14.456381] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-13T19:26:14.467751] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-13T19:26:16.686087] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-13T19:26:16.706504] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-13T19:26:18.677870] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-13T19:26:18.684133] [INFO ] [REMOTE ] HMY: Full fetch complete (76790 records). [2025-10-13T19:26:18.684285] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-13T19:26:19.090754] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-13T19:26:19.090863] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-13T19:26:19.091838] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-13T19:26:19.091900] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-13T19:26:19.093446] [DEBUG] [LOCAL ] HMY: Trimmed 76790 records to 53167 (keeping 200 days of data) [2025-10-13T19:26:19.437087] [DEBUG] [LOCAL ] HMY: Primary data saved (53167 records). [2025-10-13T19:26:19.437277] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-13T19:26:19.437424] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HMY took 29.9s. Estimated remaining: 3h 7m 12s. Rate: 7.1 symbols/min [2025-10-13T19:26:20.011031] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:20.154854] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:20.153390] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:20.241251] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:20.249146] [DEBUG] [LOCAL ] HOV: Loaded 14065 existing records from primary storage. [2025-10-13T19:26:20.249616] [INFO ] [MAIN ] HOV: Loaded 14065 existing records. [2025-10-13T19:26:20.479412] [DEBUG] [LOCAL ] HOUS: Loaded 45606 existing records from primary storage. [2025-10-13T19:26:20.468992] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:20.494342] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-13T19:26:20.494422] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-13T19:26:20.494768] [INFO ] [MAIN ] HOUS: Loaded 45606 existing records. [2025-10-13T19:26:20.500446] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-13T19:26:20.515847] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-13T19:26:20.648397] [DEBUG] [LOCAL ] HOMB: Loaded 44074 existing records from primary storage. [2025-10-13T19:26:20.714697] [INFO ] [MAIN ] HOMB: Loaded 44074 existing records. [2025-10-13T19:26:20.721270] [DEBUG] [LOCAL ] HOG: Loaded 51709 existing records from primary storage. [2025-10-13T19:26:20.730737] [INFO ] [MAIN ] HOG: Loaded 51709 existing records. [2025-10-13T19:26:20.997356] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:21.205372] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-13T19:26:21.280135] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-13T19:26:21.343000] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:21.365438] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-13T19:26:21.376291] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-13T19:26:21.393991] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-13T19:26:21.471270] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:21.460253] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-13T19:26:21.485142] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-13T19:26:21.500682] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-13T19:26:21.553313] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-13T19:26:21.560693] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-13T19:26:21.575332] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-13T19:26:21.564920] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:21.591575] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-13T19:26:21.601455] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-13T19:26:22.496520] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:22.518889] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-13T19:26:22.693083] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:22.711905] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:22.712358] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-13T19:26:22.712553] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-13T19:26:22.723932] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T19:26:22.727684] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-13T19:26:23.531975] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T19:26:23.534988] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-13T19:26:23.722761] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T19:26:23.731137] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-13T19:26:23.795060] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T19:26:23.803833] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-13T19:26:24.379869] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T19:26:24.384240] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-13T19:26:24.439910] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T19:26:24.451309] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-13T19:26:25.177818] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T19:26:25.187480] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-13T19:26:25.198797] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T19:26:25.202365] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-13T19:26:25.310459] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T19:26:25.320853] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-13T19:26:26.186602] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:26:26.196914] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-13T19:26:26.227770] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T19:26:26.232261] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-13T19:26:26.286484] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:26:26.294956] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-13T19:26:26.717630] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T19:26:26.819231] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-13T19:26:26.820728] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T19:26:27.617917] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-13T19:26:27.877280] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:26:27.924138] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T19:26:28.402334] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:26:28.417918] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-13T19:26:28.589342] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T19:26:29.217953] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-13T19:26:30.017979] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-13T19:26:30.153404] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:26:30.191720] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T19:26:30.817969] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-13T19:26:31.437481] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T19:26:31.617938] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-13T19:26:32.417982] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-13T19:26:32.620142] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T19:26:33.047429] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T19:26:33.132473] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T19:26:33.217914] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-13T19:26:34.017907] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-13T19:26:34.149496] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T19:26:34.817914] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-13T19:26:35.431680] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T19:26:35.617957] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-13T19:26:36.417970] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-13T19:26:36.482382] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T19:26:36.484106] [INFO ] [REMOTE ] HOV: Full fetch complete (19003 records). [2025-10-13T19:26:36.484172] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-13T19:26:36.821994] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T19:26:36.940882] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-13T19:26:36.940990] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-13T19:26:36.941679] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-13T19:26:36.941755] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-13T19:26:36.942691] [DEBUG] [LOCAL ] HOV: Trimmed 19003 records to 13969 (keeping 200 days of data) [2025-10-13T19:26:37.035757] [DEBUG] [LOCAL ] HOV: Primary data saved (13969 records). [2025-10-13T19:26:37.035916] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-13T19:26:37.036001] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 17.6s. Estimated remaining: 3h 7m 15s. Rate: 7.1 symbols/min [2025-10-13T19:26:37.209155] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:37.218080] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-13T19:26:37.261920] [DEBUG] [LOCAL ] HP: Loaded 52330 existing records from primary storage. [2025-10-13T19:26:37.262262] [INFO ] [MAIN ] HP: Loaded 52330 existing records. [2025-10-13T19:26:37.438844] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:37.439078] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-13T19:26:37.439165] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-13T19:26:37.439530] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-13T19:26:37.439588] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-13T19:26:37.805238] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:38.018019] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-13T19:26:38.083460] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:26:38.787777] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T19:26:38.817878] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-13T19:26:39.586959] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T19:26:39.617881] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-13T19:26:40.417985] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-13T19:26:40.616197] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:26:41.217969] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-13T19:26:41.332672] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T19:26:41.867053] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:26:42.017912] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-13T19:26:42.648922] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:26:42.817886] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-13T19:26:43.383956] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T19:26:43.618001] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-13T19:26:44.293886] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T19:26:44.417946] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-13T19:26:45.217912] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-13T19:26:45.322758] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-13T19:26:45.686437] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T19:26:46.017960] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-13T19:26:46.817949] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-13T19:26:46.913378] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T19:26:46.918136] [INFO ] [REMOTE ] HOMB: Full fetch complete (63878 records). [2025-10-13T19:26:46.918251] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-13T19:26:47.323291] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-13T19:26:47.323411] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-13T19:26:47.324716] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-13T19:26:47.324789] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-13T19:26:47.326778] [DEBUG] [LOCAL ] HOMB: Trimmed 63878 records to 43542 (keeping 200 days of data) [2025-10-13T19:26:47.635769] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-13T19:26:47.649332] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T19:26:47.665894] [DEBUG] [LOCAL ] HOMB: Primary data saved (43542 records). [2025-10-13T19:26:47.666094] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-13T19:26:47.666200] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOMB took 28.2s. Estimated remaining: 3h 7m 9s. Rate: 7.1 symbols/min [2025-10-13T19:26:47.861703] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:47.919197] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-10-13T19:26:47.919622] [INFO ] [MAIN ] HPE: Loaded 54477 existing records. [2025-10-13T19:26:48.105351] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:48.105848] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-13T19:26:48.105905] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-13T19:26:48.106531] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-13T19:26:48.106589] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-13T19:26:48.424374] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-13T19:26:48.516611] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:48.529612] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T19:26:49.217987] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-13T19:26:49.328334] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T19:26:49.851853] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T19:26:50.017978] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-13T19:26:50.635214] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:26:50.817901] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-13T19:26:51.618001] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-13T19:26:51.684772] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T19:26:52.418033] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-13T19:26:52.827859] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-13T19:26:53.001488] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-13T19:26:53.007228] [INFO ] [REMOTE ] HOG: Full fetch complete (74049 records). [2025-10-13T19:26:53.007417] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-13T19:26:53.223112] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-13T19:26:53.425440] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-13T19:26:53.425576] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-13T19:26:53.427217] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-13T19:26:53.427289] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-13T19:26:53.429333] [DEBUG] [LOCAL ] HOG: Trimmed 74049 records to 50870 (keeping 200 days of data) [2025-10-13T19:26:53.762192] [DEBUG] [LOCAL ] HOG: Primary data saved (50870 records). [2025-10-13T19:26:53.762372] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-13T19:26:53.763280] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HOG took 34.3s. Estimated remaining: 3h 6m 58s. Rate: 7.1 symbols/min [2025-10-13T19:26:53.940404] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:53.952123] [DEBUG] [LOCAL ] HPF: Loaded 7555 existing records from primary storage. [2025-10-13T19:26:53.952555] [INFO ] [MAIN ] HPF: Loaded 7555 existing records. [2025-10-13T19:26:54.024003] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-13T19:26:54.141876] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:54.142283] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-13T19:26:54.142394] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-13T19:26:54.142774] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-13T19:26:54.142912] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-13T19:26:54.480740] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T19:26:54.578533] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:54.817972] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-13T19:26:55.205220] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-13T19:26:55.337284] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T19:26:55.343082] [INFO ] [REMOTE ] HOUS: Full fetch complete (64052 records). [2025-10-13T19:26:55.343306] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-13T19:26:55.623244] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-13T19:26:55.733035] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-13T19:26:55.733138] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-13T19:26:55.734012] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-13T19:26:55.734080] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-13T19:26:55.735505] [DEBUG] [LOCAL ] HOUS: Trimmed 64052 records to 45081 (keeping 200 days of data) [2025-10-13T19:26:55.997803] [DEBUG] [LOCAL ] HOUS: Primary data saved (45081 records). [2025-10-13T19:26:55.998014] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-13T19:26:55.998123] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HOUS took 36.5s. Estimated remaining: 3h 6m 41s. Rate: 7.1 symbols/min [2025-10-13T19:26:56.169137] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:26:56.183703] [DEBUG] [LOCAL ] HPI: Loaded 10713 existing records from primary storage. [2025-10-13T19:26:56.183974] [INFO ] [MAIN ] HPI: Loaded 10713 existing records. [2025-10-13T19:26:56.375261] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:26:56.375555] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-13T19:26:56.375625] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-13T19:26:56.376015] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-13T19:26:56.376077] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-13T19:26:56.425981] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-13T19:26:56.480367] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-13T19:26:56.762575] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:26:56.793531] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T19:26:57.217956] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-13T19:26:57.862907] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-13T19:26:58.017897] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-13T19:26:58.330717] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T19:26:58.773435] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T19:26:58.817896] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-13T19:26:59.433917] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T19:26:59.617955] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-13T19:27:00.417415] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T19:27:00.419737] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-13T19:27:01.217960] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-13T19:27:02.018009] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-13T19:27:02.479819] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-13T19:27:02.527904] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-13T19:27:02.706486] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T19:27:02.817939] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-13T19:27:03.617995] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-13T19:27:04.255538] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-13T19:27:04.417969] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-13T19:27:04.636671] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-13T19:27:05.217999] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-13T19:27:05.946133] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-13T19:27:06.023085] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-13T19:27:06.040340] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:27:06.764895] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-13T19:27:06.817893] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-13T19:27:07.295926] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-13T19:27:07.617964] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-13T19:27:08.418009] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-13T19:27:09.217975] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-13T19:27:09.632513] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-13T19:27:09.763632] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-13T19:27:09.945793] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T19:27:10.017886] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-13T19:27:10.817961] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-13T19:27:10.847615] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T19:27:11.530041] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T19:27:11.617956] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-13T19:27:12.417966] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-13T19:27:13.217960] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-13T19:27:13.393696] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T19:27:13.437431] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T19:27:13.926353] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T19:27:14.017911] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-13T19:27:14.767072] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T19:27:14.817909] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-13T19:27:15.617910] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-13T19:27:15.797604] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T19:27:16.417912] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-13T19:27:17.217898] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-13T19:27:17.232917] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T19:27:17.238211] [INFO ] [REMOTE ] HP: Full fetch complete (73886 records). [2025-10-13T19:27:17.238374] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-13T19:27:17.346585] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T19:27:17.351872] [INFO ] [REMOTE ] HPI: Full fetch complete (13905 records). [2025-10-13T19:27:17.357468] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-13T19:27:17.976000] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-13T19:27:17.997741] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-13T19:27:18.007890] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-13T19:27:18.031837] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-13T19:27:18.032781] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-13T19:27:18.032874] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-13T19:27:18.032930] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-13T19:27:18.033166] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-13T19:27:18.033357] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-13T19:27:18.034538] [DEBUG] [LOCAL ] HPI: Trimmed 13905 records to 10635 (keeping 200 days of data) [2025-10-13T19:27:18.035497] [DEBUG] [LOCAL ] HP: Trimmed 73886 records to 51538 (keeping 200 days of data) [2025-10-13T19:27:18.305675] [DEBUG] [LOCAL ] HPI: Primary data saved (10635 records). [2025-10-13T19:27:18.307822] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-13T19:27:18.309007] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPI took 22.3s. Estimated remaining: 3h 6m 51s. Rate: 7.1 symbols/min [2025-10-13T19:27:18.573102] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:18.595328] [DEBUG] [LOCAL ] HP: Primary data saved (51538 records). [2025-10-13T19:27:18.595490] [INFO ] [MAIN ] HP: Full history saved. [2025-10-13T19:27:18.595576] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HP took 41.6s. Estimated remaining: 3h 6m 32s. Rate: 7.1 symbols/min [2025-10-13T19:27:18.790604] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:18.806473] [DEBUG] [LOCAL ] HPP: Loaded 51811 existing records from primary storage. [2025-10-13T19:27:18.806874] [INFO ] [MAIN ] HPP: Loaded 51811 existing records. [2025-10-13T19:27:18.992944] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:18.993967] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-13T19:27:19.002372] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-13T19:27:19.002837] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T19:27:19.006295] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-13T19:27:19.006710] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-13T19:27:19.006916] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-13T19:27:19.154617] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-10-13T19:27:19.175931] [INFO ] [MAIN ] HPQ: Loaded 54448 existing records. [2025-10-13T19:27:19.616544] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:19.648055] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-13T19:27:19.672294] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-13T19:27:19.690138] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:19.691297] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-13T19:27:19.691178] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-13T19:27:19.692583] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-13T19:27:19.695690] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-13T19:27:19.825864] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T19:27:20.090708] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:20.417960] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-13T19:27:21.127665] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-13T19:27:21.217948] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-13T19:27:21.425142] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T19:27:22.017953] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-13T19:27:22.817968] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-13T19:27:23.247136] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-13T19:27:23.595469] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-13T19:27:23.618069] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-13T19:27:24.417993] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-13T19:27:24.749471] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-13T19:27:25.132896] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T19:27:25.217977] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-13T19:27:25.936519] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T19:27:25.939133] [INFO ] [REMOTE ] HPF: Full fetch complete (10684 records). [2025-10-13T19:27:25.939300] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-13T19:27:26.022588] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-13T19:27:26.222041] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T19:27:26.556623] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-13T19:27:26.556776] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-13T19:27:26.557288] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-13T19:27:26.557358] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-13T19:27:26.558299] [DEBUG] [LOCAL ] HPF: Trimmed 10684 records to 7500 (keeping 200 days of data) [2025-10-13T19:27:26.615959] [DEBUG] [LOCAL ] HPF: Primary data saved (7500 records). [2025-10-13T19:27:26.616154] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-13T19:27:26.616263] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPF took 32.9s. Estimated remaining: 3h 6m 23s. Rate: 7.1 symbols/min [2025-10-13T19:27:26.811036] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:26.818005] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-13T19:27:26.824763] [DEBUG] [LOCAL ] HPS: Loaded 10421 existing records from primary storage. [2025-10-13T19:27:26.825041] [INFO ] [MAIN ] HPS: Loaded 10421 existing records. [2025-10-13T19:27:27.069130] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:27.069445] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-13T19:27:27.069497] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-13T19:27:27.069782] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-13T19:27:27.069842] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-13T19:27:27.454243] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:27.617983] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-13T19:27:27.778279] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:27:28.417971] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-13T19:27:28.720421] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T19:27:29.217956] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-13T19:27:29.585901] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T19:27:30.017949] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-13T19:27:30.094372] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:27:30.817969] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-13T19:27:31.054729] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-13T19:27:31.617980] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-13T19:27:31.891116] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T19:27:31.897029] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-10-13T19:27:31.897234] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-13T19:27:32.310902] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-13T19:27:32.311107] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-13T19:27:32.312471] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-13T19:27:32.312601] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-13T19:27:32.316572] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-10-13T19:27:32.427263] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-13T19:27:32.450052] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-13T19:27:32.722875] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-13T19:27:32.723071] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-13T19:27:32.723178] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPE took 45.1s. Estimated remaining: 3h 6m 11s. Rate: 7.1 symbols/min [2025-10-13T19:27:32.902916] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:32.931346] [DEBUG] [LOCAL ] HQH: Loaded 26049 existing records from primary storage. [2025-10-13T19:27:32.931745] [INFO ] [MAIN ] HQH: Loaded 26049 existing records. [2025-10-13T19:27:33.131053] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:33.131565] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-13T19:27:33.131830] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-13T19:27:33.132286] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-13T19:27:33.132365] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-13T19:27:33.223912] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-13T19:27:33.312469] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-13T19:27:33.445988] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-13T19:27:33.579102] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:34.017976] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-13T19:27:34.756328] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T19:27:34.817891] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-13T19:27:35.617944] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-13T19:27:36.145206] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-13T19:27:36.417914] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-13T19:27:36.463217] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T19:27:36.514050] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T19:27:37.217973] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-13T19:27:37.762929] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T19:27:38.017979] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-13T19:27:38.820115] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-13T19:27:38.827404] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:27:39.151029] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-13T19:27:39.618015] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-13T19:27:40.276986] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-13T19:27:40.417950] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-13T19:27:40.842722] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T19:27:41.221770] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-13T19:27:41.224130] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-13T19:27:42.017992] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-13T19:27:42.326578] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:27:42.817962] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-13T19:27:43.618008] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-13T19:27:43.712710] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-13T19:27:43.742101] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-13T19:27:44.417976] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-13T19:27:44.696608] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T19:27:45.217953] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-13T19:27:45.302916] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-13T19:27:46.017970] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-13T19:27:46.817911] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-13T19:27:46.835631] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T19:27:46.842177] [INFO ] [REMOTE ] HPP: Full fetch complete (73271 records). [2025-10-13T19:27:46.842343] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-13T19:27:47.262154] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-13T19:27:47.271589] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-13T19:27:47.273963] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-13T19:27:47.274068] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-13T19:27:47.272254] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T19:27:47.282469] [DEBUG] [LOCAL ] HPP: Trimmed 73271 records to 51145 (keeping 200 days of data) [2025-10-13T19:27:47.592173] [DEBUG] [LOCAL ] HPP: Primary data saved (51145 records). [2025-10-13T19:27:47.592363] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-13T19:27:47.592474] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPP took 29.3s. Estimated remaining: 3h 6m 11s. Rate: 7.1 symbols/min [2025-10-13T19:27:47.623270] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-13T19:27:47.699305] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T19:27:47.787117] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:47.806729] [DEBUG] [LOCAL ] HQL: Loaded 17027 existing records from primary storage. [2025-10-13T19:27:47.807068] [INFO ] [MAIN ] HQL: Loaded 17027 existing records. [2025-10-13T19:27:47.993047] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:47.993308] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-13T19:27:47.993359] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-13T19:27:47.993738] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-13T19:27:47.993799] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-13T19:27:48.364500] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:48.418038] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-13T19:27:48.954170] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T19:27:49.217967] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-13T19:27:49.385152] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T19:27:50.018001] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-13T19:27:50.195759] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T19:27:50.817958] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-13T19:27:51.618043] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-13T19:27:51.641490] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T19:27:51.898881] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-13T19:27:52.417962] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-13T19:27:52.751407] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T19:27:52.883882] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-13T19:27:53.217968] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-13T19:27:54.018034] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-13T19:27:54.829883] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-13T19:27:54.837163] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T19:27:54.992007] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T19:27:55.617977] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-13T19:27:55.631776] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T19:27:55.634079] [INFO ] [REMOTE ] HPS: Full fetch complete (15195 records). [2025-10-13T19:27:55.634179] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-13T19:27:55.997028] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-13T19:27:55.997128] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-13T19:27:55.997574] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-13T19:27:55.997616] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-13T19:27:55.998193] [DEBUG] [LOCAL ] HPS: Trimmed 15195 records to 10321 (keeping 200 days of data) [2025-10-13T19:27:56.066629] [DEBUG] [LOCAL ] HPS: Primary data saved (10321 records). [2025-10-13T19:27:56.066834] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-13T19:27:56.066930] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HPS took 29.5s. Estimated remaining: 3h 6m 3s. Rate: 7.1 symbols/min [2025-10-13T19:27:56.245944] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:27:56.306636] [DEBUG] [LOCAL ] HR: Loaded 52742 existing records from primary storage. [2025-10-13T19:27:56.307023] [INFO ] [MAIN ] HR: Loaded 52742 existing records. [2025-10-13T19:27:56.423091] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-13T19:27:56.498970] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:27:56.499249] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-13T19:27:56.499306] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-13T19:27:56.500150] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-13T19:27:56.500209] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-13T19:27:56.850925] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T19:27:56.913979] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:27:57.217961] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-13T19:27:58.017973] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-13T19:27:58.272172] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T19:27:58.329267] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T19:27:58.817965] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-13T19:27:59.445315] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-13T19:27:59.617943] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-13T19:27:59.783225] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-13T19:28:00.417996] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-13T19:28:01.217988] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-13T19:28:01.689744] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-13T19:28:01.719845] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-13T19:28:02.017991] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-13T19:28:02.818003] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-13T19:28:02.899555] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T19:28:02.955455] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-13T19:28:02.961474] [INFO ] [REMOTE ] HPQ: Full fetch complete (77669 records). [2025-10-13T19:28:02.961713] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-13T19:28:03.350457] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-13T19:28:03.350559] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-13T19:28:03.351518] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-13T19:28:03.351611] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-13T19:28:03.353758] [DEBUG] [LOCAL ] HPQ: Trimmed 77669 records to 53668 (keeping 200 days of data) [2025-10-13T19:28:03.638353] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-13T19:28:03.690365] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-10-13T19:28:03.690518] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-13T19:28:03.690604] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HPQ took 45.1s. Estimated remaining: 3h 5m 53s. Rate: 7.1 symbols/min [2025-10-13T19:28:03.862202] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:03.874790] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T19:28:03.921972] [DEBUG] [LOCAL ] HRB: Loaded 49060 existing records from primary storage. [2025-10-13T19:28:03.922313] [INFO ] [MAIN ] HRB: Loaded 49060 existing records. [2025-10-13T19:28:04.094085] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:04.094318] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-13T19:28:04.094367] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-13T19:28:04.094680] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-13T19:28:04.094737] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-13T19:28:04.424964] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-13T19:28:04.472720] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:04.515012] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-13T19:28:05.217946] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-13T19:28:05.393605] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-13T19:28:06.017974] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-13T19:28:06.341187] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-13T19:28:06.344528] [INFO ] [REMOTE ] HQH: Full fetch complete (37199 records). [2025-10-13T19:28:06.344606] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-13T19:28:06.710278] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-13T19:28:06.710372] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-13T19:28:06.711011] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-13T19:28:06.711070] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-13T19:28:06.711920] [DEBUG] [LOCAL ] HQH: Trimmed 37199 records to 25666 (keeping 200 days of data) [2025-10-13T19:28:06.819764] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-13T19:28:06.867236] [DEBUG] [LOCAL ] HQH: Primary data saved (25666 records). [2025-10-13T19:28:06.867377] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-13T19:28:06.867458] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HQH took 34.1s. Estimated remaining: 3h 5m 38s. Rate: 7.1 symbols/min [2025-10-13T19:28:07.032629] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:07.065178] [DEBUG] [LOCAL ] HRI: Loaded 32990 existing records from primary storage. [2025-10-13T19:28:07.065467] [INFO ] [MAIN ] HRI: Loaded 32990 existing records. [2025-10-13T19:28:07.243018] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:07.243215] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-13T19:28:07.243261] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-13T19:28:07.243710] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-13T19:28:07.243767] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-13T19:28:07.610762] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:07.622994] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-13T19:28:07.640889] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-13T19:28:08.171879] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T19:28:08.417942] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-13T19:28:08.908637] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T19:28:09.217956] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-13T19:28:10.027777] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-13T19:28:10.048166] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-13T19:28:10.479471] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-13T19:28:10.817965] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-13T19:28:10.965138] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T19:28:11.617945] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-13T19:28:12.386120] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T19:28:12.417883] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-13T19:28:13.217987] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-13T19:28:13.276794] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T19:28:14.017891] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-13T19:28:14.073151] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:28:14.419186] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-13T19:28:14.817963] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-13T19:28:15.617888] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-13T19:28:15.743924] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T19:28:16.417964] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-13T19:28:16.571051] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T19:28:16.634042] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T19:28:17.217957] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-13T19:28:17.967569] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:28:18.017901] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-13T19:28:18.818015] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-13T19:28:18.963827] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T19:28:19.617966] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-13T19:28:19.729683] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T19:28:20.390199] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T19:28:20.419215] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-13T19:28:20.421927] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T19:28:21.217959] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-13T19:28:21.968121] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:28:22.017886] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-13T19:28:22.214225] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-13T19:28:22.817955] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-13T19:28:23.617951] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-13T19:28:23.727348] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T19:28:24.165213] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T19:28:24.417899] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-13T19:28:24.548711] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-13T19:28:25.218041] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-13T19:28:25.934023] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T19:28:26.017984] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-13T19:28:26.551747] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T19:28:26.817985] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-13T19:28:27.617960] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-13T19:28:27.837412] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T19:28:28.096106] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-13T19:28:28.417903] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-13T19:28:28.666923] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T19:28:29.217902] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-13T19:28:30.023994] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-13T19:28:30.026219] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T19:28:30.031918] [INFO ] [REMOTE ] HRB: Full fetch complete (69880 records). [2025-10-13T19:28:30.032023] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-13T19:28:30.476833] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-13T19:28:30.476917] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-13T19:28:30.477827] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-13T19:28:30.477889] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-13T19:28:30.479270] [DEBUG] [LOCAL ] HRB: Trimmed 69880 records to 48339 (keeping 200 days of data) [2025-10-13T19:28:30.771631] [DEBUG] [LOCAL ] HRB: Primary data saved (48339 records). [2025-10-13T19:28:30.771796] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-13T19:28:30.771880] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HRB took 27.1s. Estimated remaining: 3h 5m 49s. Rate: 7.1 symbols/min [2025-10-13T19:28:30.826171] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-13T19:28:30.956179] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:30.985765] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:28:31.045289] [DEBUG] [LOCAL ] HRL: Loaded 53874 existing records from primary storage. [2025-10-13T19:28:31.045709] [INFO ] [MAIN ] HRL: Loaded 53874 existing records. [2025-10-13T19:28:31.271276] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:31.271553] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-13T19:28:31.271629] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-13T19:28:31.272182] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-13T19:28:31.272240] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-13T19:28:31.624671] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-13T19:28:31.650159] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T19:28:31.647661] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:31.976238] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-13T19:28:31.979117] [INFO ] [REMOTE ] HQL: Full fetch complete (25153 records). [2025-10-13T19:28:31.979189] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-13T19:28:32.355505] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-13T19:28:32.355595] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-13T19:28:32.356170] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-13T19:28:32.356232] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-13T19:28:32.356928] [DEBUG] [LOCAL ] HQL: Trimmed 25153 records to 16787 (keeping 200 days of data) [2025-10-13T19:28:32.431091] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-13T19:28:32.463703] [DEBUG] [LOCAL ] HQL: Primary data saved (16787 records). [2025-10-13T19:28:32.463854] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-13T19:28:32.463935] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HQL took 44.9s. Estimated remaining: 3h 5m 32s. Rate: 7.1 symbols/min [2025-10-13T19:28:32.641630] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:32.675246] [DEBUG] [LOCAL ] HRTG: Loaded 34334 existing records from primary storage. [2025-10-13T19:28:32.675523] [INFO ] [MAIN ] HRTG: Loaded 34334 existing records. [2025-10-13T19:28:32.852847] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:32.853066] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-13T19:28:32.853113] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-13T19:28:32.853397] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-13T19:28:32.853454] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-13T19:28:33.217393] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:33.217987] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-13T19:28:33.239388] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-13T19:28:33.244886] [INFO ] [REMOTE ] HR: Full fetch complete (74808 records). [2025-10-13T19:28:33.245007] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-13T19:28:33.634833] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-13T19:28:33.634979] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-13T19:28:33.635996] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-13T19:28:33.636082] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-13T19:28:33.638023] [DEBUG] [LOCAL ] HR: Trimmed 74808 records to 52098 (keeping 200 days of data) [2025-10-13T19:28:33.755271] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T19:28:33.980623] [DEBUG] [LOCAL ] HR: Primary data saved (52098 records). [2025-10-13T19:28:33.980783] [INFO ] [MAIN ] HR: Full history saved. [2025-10-13T19:28:33.981458] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HR took 37.9s. Estimated remaining: 3h 5m 15s. Rate: 7.1 symbols/min [2025-10-13T19:28:34.024272] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-13T19:28:34.156425] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:34.208766] [DEBUG] [LOCAL ] HSBC: Loaded 51725 existing records from primary storage. [2025-10-13T19:28:34.209143] [INFO ] [MAIN ] HSBC: Loaded 51725 existing records. [2025-10-13T19:28:34.386592] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:34.386920] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-13T19:28:34.386971] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-13T19:28:34.387976] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-13T19:28:34.388035] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-13T19:28:34.522379] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T19:28:34.770848] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:34.817886] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-13T19:28:35.617941] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-13T19:28:35.845775] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-13T19:28:36.131915] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:28:36.417951] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-13T19:28:36.966779] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T19:28:37.009634] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T19:28:37.217958] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-13T19:28:38.017965] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-13T19:28:38.418911] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T19:28:38.422599] [INFO ] [REMOTE ] HRI: Full fetch complete (46208 records). [2025-10-13T19:28:38.422725] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-13T19:28:38.825167] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-13T19:28:38.829113] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-13T19:28:38.829227] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-13T19:28:38.830406] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-13T19:28:38.830588] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-13T19:28:38.832228] [DEBUG] [LOCAL ] HRI: Trimmed 46208 records to 32515 (keeping 200 days of data) [2025-10-13T19:28:39.051587] [DEBUG] [LOCAL ] HRI: Primary data saved (32515 records). [2025-10-13T19:28:39.051812] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-13T19:28:39.051918] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRI took 32.2s. Estimated remaining: 3h 5m 2s. Rate: 7.1 symbols/min [2025-10-13T19:28:39.224988] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:39.240693] [DEBUG] [LOCAL ] HSHP: Loaded 15260 existing records from primary storage. [2025-10-13T19:28:39.240993] [INFO ] [MAIN ] HSHP: Loaded 15260 existing records. [2025-10-13T19:28:39.417630] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:39.418031] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-13T19:28:39.418120] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-13T19:28:39.418632] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-13T19:28:39.418734] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-13T19:28:39.636001] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-13T19:28:39.799369] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:39.914089] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-13T19:28:39.963860] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T19:28:40.417977] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-13T19:28:41.217975] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-13T19:28:41.687397] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T19:28:42.017929] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-13T19:28:42.211762] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T19:28:42.280249] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-13T19:28:42.817957] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-13T19:28:43.623111] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-13T19:28:43.638302] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:28:44.186305] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-13T19:28:44.417986] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-13T19:28:44.601258] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T19:28:45.217994] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-13T19:28:45.934263] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T19:28:46.017911] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-13T19:28:46.216327] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-13T19:28:46.817957] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-13T19:28:47.446100] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:28:47.617904] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-13T19:28:48.418011] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-13T19:28:48.811552] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T19:28:48.939217] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-13T19:28:49.217944] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-13T19:28:49.885186] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:28:50.018024] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-13T19:28:50.616164] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-13T19:28:50.817944] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-13T19:28:51.617976] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-13T19:28:51.918517] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:28:52.220052] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T19:28:52.417987] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-13T19:28:53.217961] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-13T19:28:53.673621] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T19:28:53.844772] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:28:53.848753] [INFO ] [REMOTE ] HRTG: Full fetch complete (43682 records). [2025-10-13T19:28:53.848856] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-13T19:28:54.023302] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-13T19:28:54.233472] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-13T19:28:54.233592] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-13T19:28:54.246850] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-13T19:28:54.247047] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-13T19:28:54.248688] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T19:28:54.255000] [DEBUG] [LOCAL ] HRTG: Trimmed 43682 records to 34109 (keeping 200 days of data) [2025-10-13T19:28:54.450264] [DEBUG] [LOCAL ] HRTG: Primary data saved (34109 records). [2025-10-13T19:28:54.450402] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-13T19:28:54.450480] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HRTG took 22.0s. Estimated remaining: 3h 5m 2s. Rate: 7.1 symbols/min [2025-10-13T19:28:54.615717] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:28:54.668187] [DEBUG] [LOCAL ] HSY: Loaded 51062 existing records from primary storage. [2025-10-13T19:28:54.668525] [INFO ] [MAIN ] HSY: Loaded 51062 existing records. [2025-10-13T19:28:54.822621] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-13T19:28:54.843991] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:28:54.845564] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-13T19:28:54.845614] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-13T19:28:54.846126] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-13T19:28:54.846182] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-13T19:28:55.197464] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:28:55.617987] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-13T19:28:55.942350] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T19:28:56.005602] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-13T19:28:56.417983] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-13T19:28:57.217964] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-13T19:28:57.454124] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-13T19:28:58.017966] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-13T19:28:58.245741] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-13T19:28:58.301836] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T19:28:58.817963] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-13T19:28:59.365278] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-13T19:28:59.541757] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-13T19:28:59.618003] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-13T19:29:00.418028] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-13T19:29:01.218072] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-13T19:29:01.765615] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-13T19:29:02.017966] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-13T19:29:02.616622] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-13T19:29:02.817935] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-13T19:29:02.894280] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-13T19:29:03.617894] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-13T19:29:03.786345] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T19:29:03.832820] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T19:29:04.417932] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-13T19:29:05.217998] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-13T19:29:05.385423] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T19:29:06.017947] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-13T19:29:06.145337] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T19:29:06.337954] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T19:29:06.817945] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-13T19:29:07.617989] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-13T19:29:07.766245] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-13T19:29:07.787572] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-13T19:29:08.417970] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-13T19:29:09.217983] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-13T19:29:09.266357] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-13T19:29:10.017898] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-13T19:29:10.292942] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T19:29:10.817945] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-13T19:29:11.009361] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T19:29:11.014940] [INFO ] [REMOTE ] HSBC: Full fetch complete (73852 records). [2025-10-13T19:29:11.015115] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-13T19:29:11.455980] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-13T19:29:11.456382] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-13T19:29:11.458087] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-13T19:29:11.458481] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-13T19:29:11.460601] [DEBUG] [LOCAL ] HSBC: Trimmed 73852 records to 50994 (keeping 200 days of data) [2025-10-13T19:29:11.618720] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-13T19:29:11.654002] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T19:29:11.963340] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-13T19:29:12.011037] [DEBUG] [LOCAL ] HSBC: Primary data saved (50994 records). [2025-10-13T19:29:12.011253] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-13T19:29:12.012511] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HSBC took 38.0s. Estimated remaining: 3h 5m 5s. Rate: 7.1 symbols/min [2025-10-13T19:29:12.235402] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:12.235591] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-13T19:29:12.235628] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-13T19:29:12.235767] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-13T19:29:12.235809] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-13T19:29:12.235849] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-13T19:29:12.235890] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-13T19:29:12.423689] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-13T19:29:12.611954] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:13.218173] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-13T19:29:13.432225] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T19:29:13.465124] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-13T19:29:13.468049] [INFO ] [REMOTE ] HSHP: Full fetch complete (23263 records). [2025-10-13T19:29:13.468118] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-13T19:29:13.836224] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-13T19:29:13.836298] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-13T19:29:13.836854] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-13T19:29:13.836914] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-13T19:29:13.837514] [DEBUG] [LOCAL ] HSHP: Trimmed 23263 records to 14975 (keeping 200 days of data) [2025-10-13T19:29:13.924614] [DEBUG] [LOCAL ] HSHP: Primary data saved (14975 records). [2025-10-13T19:29:13.924772] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-13T19:29:13.924904] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSHP took 34.9s. Estimated remaining: 3h 4m 49s. Rate: 7.1 symbols/min [2025-10-13T19:29:14.023020] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-13T19:29:14.095352] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:14.114909] [DEBUG] [LOCAL ] HTD: Loaded 14213 existing records from primary storage. [2025-10-13T19:29:14.115150] [INFO ] [MAIN ] HTD: Loaded 14213 existing records. [2025-10-13T19:29:14.305615] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:29:14.305905] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-13T19:29:14.305967] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-13T19:29:14.306385] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-13T19:29:14.306459] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-13T19:29:14.670269] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:14.817945] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-13T19:29:15.178226] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-13T19:29:15.369217] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-13T19:29:15.617990] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-13T19:29:15.767333] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T19:29:16.417963] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-13T19:29:16.458223] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-13T19:29:17.217982] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-13T19:29:18.017940] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-13T19:29:18.230628] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:29:18.231268] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-13T19:29:18.231376] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:29:18.231425] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-13T19:29:18.231496] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:29:18.231573] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-13T19:29:18.231674] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-13T19:29:18.231769] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-13T19:29:18.231833] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-13T19:29:18.231892] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HTB took 6.2s. Estimated remaining: 3h 4m 35s. Rate: 7.1 symbols/min [2025-10-13T19:29:18.391433] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T19:29:18.460248] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:18.460470] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-13T19:29:18.460507] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-13T19:29:18.460639] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-13T19:29:18.460718] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-13T19:29:18.460764] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-13T19:29:18.460800] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-13T19:29:18.862046] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-13T19:29:18.867726] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:19.310488] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-13T19:29:19.316106] [INFO ] [REMOTE ] HRL: Full fetch complete (76699 records). [2025-10-13T19:29:19.316261] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-13T19:29:19.619834] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-13T19:29:19.705383] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T19:29:19.748237] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-13T19:29:19.748334] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-13T19:29:19.749578] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-13T19:29:19.749680] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-13T19:29:19.751534] [DEBUG] [LOCAL ] HRL: Trimmed 76699 records to 53111 (keeping 200 days of data) [2025-10-13T19:29:19.984122] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-13T19:29:20.070146] [DEBUG] [LOCAL ] HRL: Primary data saved (53111 records). [2025-10-13T19:29:20.070293] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-13T19:29:20.070394] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HRL took 49.3s. Estimated remaining: 3h 4m 19s. Rate: 7.1 symbols/min [2025-10-13T19:29:20.235212] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:20.280540] [DEBUG] [LOCAL ] HTGC: Loaded 48240 existing records from primary storage. [2025-10-13T19:29:20.280889] [INFO ] [MAIN ] HTGC: Loaded 48240 existing records. [2025-10-13T19:29:20.423093] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-13T19:29:20.461702] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:29:20.462212] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-13T19:29:20.462262] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-13T19:29:20.463226] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-13T19:29:20.463284] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-13T19:29:20.804303] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:21.221756] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-13T19:29:21.540152] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-13T19:29:22.017979] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-13T19:29:22.248199] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T19:29:22.278078] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-13T19:29:22.817978] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-13T19:29:23.617998] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-13T19:29:23.748684] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T19:29:24.417969] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-13T19:29:24.731676] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-13T19:29:25.217934] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-13T19:29:25.343604] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T19:29:26.017951] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-13T19:29:26.143779] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-13T19:29:26.817952] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-13T19:29:27.617952] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-13T19:29:27.646405] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-13T19:29:27.738168] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-13T19:29:27.743172] [INFO ] [REMOTE ] HSY: Full fetch complete (73480 records). [2025-10-13T19:29:27.743286] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-13T19:29:28.137760] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-13T19:29:28.137847] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-13T19:29:28.138780] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-13T19:29:28.138844] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-13T19:29:28.140282] [DEBUG] [LOCAL ] HSY: Trimmed 73480 records to 50382 (keeping 200 days of data) [2025-10-13T19:29:28.426442] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-13T19:29:28.459841] [DEBUG] [LOCAL ] HSY: Primary data saved (50382 records). [2025-10-13T19:29:28.459932] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-13T19:29:28.460008] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HSY took 34.0s. Estimated remaining: 3h 4m 10s. Rate: 7.1 symbols/min [2025-10-13T19:29:28.630548] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:28.666466] [DEBUG] [LOCAL ] HTH: Loaded 32795 existing records from primary storage. [2025-10-13T19:29:28.666755] [INFO ] [MAIN ] HTH: Loaded 32795 existing records. [2025-10-13T19:29:28.845160] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:29:28.845495] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-13T19:29:28.845550] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-13T19:29:28.845891] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-13T19:29:28.845947] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-13T19:29:29.237741] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-13T19:29:29.259080] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T19:29:29.262610] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:29.289671] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-13T19:29:29.698758] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T19:29:30.017933] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-13T19:29:30.818008] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-13T19:29:31.153264] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-13T19:29:31.617904] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-13T19:29:31.672047] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:29:31.929322] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-13T19:29:32.417947] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-13T19:29:32.652411] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-13T19:29:33.217946] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-13T19:29:33.442969] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-13T19:29:34.021289] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-13T19:29:34.817901] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-13T19:29:35.125946] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-13T19:29:35.617939] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-13T19:29:35.798119] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T19:29:35.928729] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-13T19:29:36.418028] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-13T19:29:37.217898] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-13T19:29:37.556370] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T19:29:37.557339] [INFO ] [REMOTE ] HTFC: Full fetch complete (852 records). [2025-10-13T19:29:37.557523] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-13T19:29:37.725816] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-13T19:29:37.761749] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-13T19:29:37.761898] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:29:37.761967] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:29:37.762039] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-13T19:29:37.762103] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-13T19:29:37.762140] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-13T19:29:37.762180] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-13T19:29:37.762237] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTFC took 19.5s. Estimated remaining: 3h 4m 3s. Rate: 7.1 symbols/min [2025-10-13T19:29:37.932263] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:37.973860] [DEBUG] [LOCAL ] HUBB: Loaded 37087 existing records from primary storage. [2025-10-13T19:29:37.974161] [INFO ] [MAIN ] HUBB: Loaded 37087 existing records. [2025-10-13T19:29:38.023122] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-13T19:29:38.167423] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:29:38.167765] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-13T19:29:38.167822] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-13T19:29:38.168926] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-13T19:29:38.168990] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-13T19:29:38.557016] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:38.817941] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-13T19:29:38.921228] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T19:29:39.617987] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-13T19:29:40.249940] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T19:29:40.417993] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-13T19:29:40.958255] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-13T19:29:41.217987] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-13T19:29:41.868953] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T19:29:42.017887] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-13T19:29:42.440356] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T19:29:42.817992] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-13T19:29:42.990697] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-13T19:29:43.617995] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-13T19:29:44.417910] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-13T19:29:44.573775] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:29:44.589672] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T19:29:44.591740] [INFO ] [REMOTE ] HTD: Full fetch complete (19301 records). [2025-10-13T19:29:44.591811] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-13T19:29:44.966909] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-13T19:29:44.966987] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-13T19:29:44.967410] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-13T19:29:44.967450] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-13T19:29:44.968306] [DEBUG] [LOCAL ] HTD: Trimmed 19301 records to 14053 (keeping 200 days of data) [2025-10-13T19:29:45.054798] [DEBUG] [LOCAL ] HTD: Primary data saved (14053 records). [2025-10-13T19:29:45.054939] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-13T19:29:45.055023] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTD took 31.1s. Estimated remaining: 3h 3m 53s. Rate: 7.1 symbols/min [2025-10-13T19:29:45.226961] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:29:45.223901] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-13T19:29:45.269026] [DEBUG] [LOCAL ] HUBS: Loaded 40321 existing records from primary storage. [2025-10-13T19:29:45.269312] [INFO ] [MAIN ] HUBS: Loaded 40321 existing records. [2025-10-13T19:29:45.443576] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:29:45.443785] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-13T19:29:45.443833] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-13T19:29:45.444218] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-13T19:29:45.444273] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-13T19:29:45.830065] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:29:45.910915] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T19:29:46.017934] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-13T19:29:46.522807] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:29:46.817966] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-13T19:29:47.617936] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-13T19:29:47.811551] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-13T19:29:47.890451] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T19:29:48.417970] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-13T19:29:48.993415] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T19:29:49.217899] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-13T19:29:50.017910] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-13T19:29:50.093802] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-13T19:29:50.664382] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T19:29:50.817961] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-13T19:29:51.375936] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T19:29:51.618000] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-13T19:29:52.256088] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:29:52.417979] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-13T19:29:52.819402] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T19:29:53.218008] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-13T19:29:54.017942] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-13T19:29:54.086476] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:29:54.814795] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:29:54.823005] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-13T19:29:55.238485] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-13T19:29:55.617946] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-13T19:29:56.094066] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T19:29:56.418008] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-13T19:29:56.847190] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-13T19:29:57.217951] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-13T19:29:57.898120] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:29:58.017975] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-13T19:29:58.791985] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:29:58.817894] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-13T19:29:59.623161] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-13T19:29:59.637609] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T19:30:00.247244] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:30:00.417996] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-13T19:30:01.208169] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T19:30:01.217877] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-13T19:30:01.481764] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T19:30:02.018065] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-13T19:30:02.697861] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:30:02.818009] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-13T19:30:03.394805] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T19:30:03.618004] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-13T19:30:04.442466] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-13T19:30:04.475701] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T19:30:05.217960] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-13T19:30:05.480305] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T19:30:06.017933] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-13T19:30:06.183172] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-13T19:30:06.737469] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T19:30:06.818014] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-13T19:30:07.617945] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-13T19:30:07.787700] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:30:08.179840] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T19:30:08.417968] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-13T19:30:09.217905] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-13T19:30:09.345790] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:30:09.685840] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T19:30:09.694745] [INFO ] [REMOTE ] HTGC: Full fetch complete (68591 records). [2025-10-13T19:30:09.694927] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-13T19:30:10.024296] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-13T19:30:10.088555] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-13T19:30:10.088691] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-13T19:30:10.089758] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-13T19:30:10.089835] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-13T19:30:10.091690] [DEBUG] [LOCAL ] HTGC: Trimmed 68591 records to 47669 (keeping 200 days of data) [2025-10-13T19:30:10.450691] [DEBUG] [LOCAL ] HTGC: Primary data saved (47669 records). [2025-10-13T19:30:10.450857] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-13T19:30:10.450948] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HTGC took 50.4s. Estimated remaining: 3h 4m 5s. Rate: 7.1 symbols/min [2025-10-13T19:30:10.574349] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T19:30:10.640472] [INFO ] [REMOTE ] HTH: Full fetch complete (46677 records). [2025-10-13T19:30:10.646821] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-13T19:30:10.646626] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:10.829727] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-13T19:30:11.029906] [DEBUG] [LOCAL ] HUM: Loaded 49709 existing records from primary storage. [2025-10-13T19:30:11.041250] [INFO ] [MAIN ] HUM: Loaded 49709 existing records. [2025-10-13T19:30:11.263058] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-13T19:30:11.263200] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-13T19:30:11.264003] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-13T19:30:11.264461] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-13T19:30:11.346317] [DEBUG] [LOCAL ] HTH: Trimmed 46677 records to 32523 (keeping 200 days of data) [2025-10-13T19:30:11.352040] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:11.353276] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-13T19:30:11.353353] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-13T19:30:11.353937] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-13T19:30:11.353998] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-13T19:30:11.726995] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T19:30:11.775988] [INFO ] [REMOTE ] HUBB: Full fetch complete (53966 records). [2025-10-13T19:30:11.789938] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-13T19:30:11.992162] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:12.023727] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-13T19:30:12.204697] [DEBUG] [LOCAL ] HTH: Primary data saved (32523 records). [2025-10-13T19:30:12.236997] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-13T19:30:12.248032] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HTH took 43.8s. Estimated remaining: 3h 3m 49s. Rate: 7.1 symbols/min [2025-10-13T19:30:12.495309] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-13T19:30:12.511833] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-13T19:30:12.543594] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-13T19:30:12.572144] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:12.572309] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-13T19:30:12.610471] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T19:30:12.606472] [DEBUG] [LOCAL ] HUBB: Trimmed 53966 records to 36459 (keeping 200 days of data) [2025-10-13T19:30:12.620758] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-13T19:30:12.797977] [DEBUG] [LOCAL ] HUN: Loaded 53981 existing records from primary storage. [2025-10-13T19:30:12.853476] [INFO ] [MAIN ] HUN: Loaded 53981 existing records. [2025-10-13T19:30:13.112867] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:13.114747] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-13T19:30:13.117720] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-13T19:30:13.122520] [DEBUG] [LOCAL ] HUBB: Primary data saved (36459 records). [2025-10-13T19:30:13.122703] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-13T19:30:13.123581] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUBB took 35.4s. Estimated remaining: 3h 3m 31s. Rate: 7.1 symbols/min [2025-10-13T19:30:13.123687] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-13T19:30:13.123834] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-13T19:30:13.479321] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:13.695147] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:13.705866] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-13T19:30:13.724013] [DEBUG] [LOCAL ] HUYA: Loaded 44619 existing records from primary storage. [2025-10-13T19:30:13.724312] [INFO ] [MAIN ] HUYA: Loaded 44619 existing records. [2025-10-13T19:30:13.903254] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:13.903669] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-13T19:30:13.903748] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-13T19:30:13.927048] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-13T19:30:13.930157] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-13T19:30:13.992339] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-13T19:30:14.019081] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-13T19:30:14.266271] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T19:30:14.326822] [INFO ] [REMOTE ] HUBS: Full fetch complete (56230 records). [2025-10-13T19:30:14.330605] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:14.330989] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-13T19:30:14.732466] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-13T19:30:14.732554] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-13T19:30:14.733377] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-13T19:30:14.733441] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-13T19:30:14.734779] [DEBUG] [LOCAL ] HUBS: Trimmed 56230 records to 39971 (keeping 200 days of data) [2025-10-13T19:30:14.828819] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-13T19:30:15.018972] [DEBUG] [LOCAL ] HUBS: Primary data saved (39971 records). [2025-10-13T19:30:15.019154] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-13T19:30:15.019261] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUBS took 30.0s. Estimated remaining: 3h 3m 14s. Rate: 7.1 symbols/min [2025-10-13T19:30:15.197468] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:15.213382] [DEBUG] [LOCAL ] HVT: Loaded 15512 existing records from primary storage. [2025-10-13T19:30:15.213668] [INFO ] [MAIN ] HVT: Loaded 15512 existing records. [2025-10-13T19:30:15.421969] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:15.422303] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-13T19:30:15.422480] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-13T19:30:15.423038] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-13T19:30:15.423142] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-13T19:30:15.745532] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-13T19:30:15.825540] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:15.826016] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-13T19:30:15.891878] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-13T19:30:16.376062] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T19:30:16.417887] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-13T19:30:16.828404] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T19:30:17.217948] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-13T19:30:18.017954] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-13T19:30:18.068356] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:30:18.207637] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:30:18.817943] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-13T19:30:19.612926] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T19:30:19.622711] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-13T19:30:20.341753] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:30:20.417957] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-13T19:30:21.171077] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-13T19:30:21.217886] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-13T19:30:21.455118] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T19:30:22.017947] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-13T19:30:22.817952] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-13T19:30:22.848145] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T19:30:23.617895] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-13T19:30:23.719322] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-13T19:30:23.972992] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T19:30:24.417982] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-13T19:30:25.217975] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-13T19:30:25.455848] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T19:30:26.017932] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-13T19:30:26.075450] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:30:26.332502] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:30:26.817942] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-13T19:30:27.578204] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:30:27.617902] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-13T19:30:28.311668] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-13T19:30:28.417894] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-13T19:30:28.818536] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T19:30:29.102092] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T19:30:29.217959] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-13T19:30:30.017962] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-13T19:30:30.581087] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-13T19:30:30.817989] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-13T19:30:30.917987] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-13T19:30:31.617966] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-13T19:30:32.181670] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:30:32.423278] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-13T19:30:32.427773] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:30:33.217945] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-13T19:30:34.017941] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-13T19:30:34.356471] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T19:30:34.817983] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-13T19:30:34.981691] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T19:30:35.348383] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-13T19:30:35.617973] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-13T19:30:36.149593] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T19:30:36.417942] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-13T19:30:36.528209] [DEBUG] [REMOTE ] HUM: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-13T19:30:36.528497] [WARN ] [REMOTE ] HUM: No data returned for month 2025-07 [2025-10-13T19:30:36.528605] [FATAL] [REMOTE ] HUM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:30:36.528757] [FATAL] [MAIN ] HUM: Failed to fetch primary data. [2025-10-13T19:30:36.528825] [WARN ] [MAIN ] HUM: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:30:36.528897] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-13T19:30:36.528960] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-13T19:30:36.529005] [INFO ] [LOCAL ] HUM: Starting deletion of derivative data. [2025-10-13T19:30:36.529221] [DEBUG] [LOCAL ] HUM: Deleted derivative data file. [2025-10-13T19:30:36.529314] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HUM took 26.1s. Estimated remaining: 3h 3m 22s. Rate: 7.1 symbols/min [2025-10-13T19:30:36.716948] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:36.767079] [DEBUG] [LOCAL ] HWM: Loaded 53615 existing records from primary storage. [2025-10-13T19:30:36.767384] [INFO ] [MAIN ] HWM: Loaded 53615 existing records. [2025-10-13T19:30:36.945510] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:36.945717] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-13T19:30:36.945770] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-13T19:30:36.947382] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-13T19:30:36.947441] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-13T19:30:37.224947] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-13T19:30:37.307047] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:37.395297] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T19:30:38.017967] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-13T19:30:38.133983] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T19:30:38.817942] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-13T19:30:39.617940] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-13T19:30:39.781404] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T19:30:40.417971] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-13T19:30:40.509190] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:30:40.525264] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-13T19:30:40.527061] [INFO ] [REMOTE ] HVT: Full fetch complete (23195 records). [2025-10-13T19:30:40.527128] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-13T19:30:40.886639] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-13T19:30:40.886742] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-13T19:30:40.887218] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-13T19:30:40.887258] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-13T19:30:40.887883] [DEBUG] [LOCAL ] HVT: Trimmed 23195 records to 15205 (keeping 200 days of data) [2025-10-13T19:30:40.978468] [DEBUG] [LOCAL ] HVT: Primary data saved (15205 records). [2025-10-13T19:30:40.978604] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-13T19:30:40.978720] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HVT took 26.0s. Estimated remaining: 3h 3m 9s. Rate: 7.1 symbols/min [2025-10-13T19:30:41.144422] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:41.184485] [DEBUG] [LOCAL ] HXL: Loaded 46548 existing records from primary storage. [2025-10-13T19:30:41.184833] [INFO ] [MAIN ] HXL: Loaded 46548 existing records. [2025-10-13T19:30:41.226262] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-13T19:30:41.360063] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:41.360263] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-13T19:30:41.360313] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-13T19:30:41.361367] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-13T19:30:41.361424] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-13T19:30:41.719472] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:41.922171] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-13T19:30:42.017904] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-13T19:30:42.754031] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T19:30:42.817942] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-13T19:30:43.263447] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T19:30:43.617954] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-13T19:30:44.417902] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-13T19:30:44.463479] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T19:30:45.109945] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T19:30:45.114633] [INFO ] [REMOTE ] HUYA: Full fetch complete (63960 records). [2025-10-13T19:30:45.114767] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-13T19:30:45.221157] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-13T19:30:45.516719] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-13T19:30:45.516812] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-13T19:30:45.517673] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-13T19:30:45.517737] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-13T19:30:45.519196] [DEBUG] [LOCAL ] HUYA: Trimmed 63960 records to 43863 (keeping 200 days of data) [2025-10-13T19:30:45.776216] [DEBUG] [LOCAL ] HUYA: Primary data saved (43863 records). [2025-10-13T19:30:45.776367] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-13T19:30:45.776458] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HUYA took 32.7s. Estimated remaining: 3h 2m 56s. Rate: 7.1 symbols/min [2025-10-13T19:30:45.955145] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:45.979638] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T19:30:45.996776] [DEBUG] [LOCAL ] HY: Loaded 10112 existing records from primary storage. [2025-10-13T19:30:45.997015] [INFO ] [MAIN ] HY: Loaded 10112 existing records. [2025-10-13T19:30:46.027958] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-13T19:30:46.173718] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:30:46.173957] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-13T19:30:46.174024] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-13T19:30:46.174391] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-13T19:30:46.174450] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-13T19:30:46.518005] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:46.817895] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-13T19:30:47.038122] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T19:30:47.621583] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-13T19:30:47.625905] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T19:30:48.417902] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-13T19:30:48.463201] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-13T19:30:49.217993] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-13T19:30:49.369459] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T19:30:49.375847] [INFO ] [REMOTE ] HUN: Full fetch complete (76726 records). [2025-10-13T19:30:49.376051] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-13T19:30:49.794293] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-13T19:30:49.794409] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-13T19:30:49.795474] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-13T19:30:49.795540] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-13T19:30:49.797132] [DEBUG] [LOCAL ] HUN: Trimmed 76726 records to 53215 (keeping 200 days of data) [2025-10-13T19:30:50.018260] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-13T19:30:50.057804] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T19:30:50.175399] [DEBUG] [LOCAL ] HUN: Primary data saved (53215 records). [2025-10-13T19:30:50.175548] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-13T19:30:50.175631] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HUN took 37.9s. Estimated remaining: 3h 2m 42s. Rate: 7.1 symbols/min [2025-10-13T19:30:50.350309] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:30:50.350519] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-13T19:30:50.350583] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-13T19:30:50.350725] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-13T19:30:50.350774] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-13T19:30:50.350816] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-13T19:30:50.350849] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-13T19:30:50.727378] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:30:50.759519] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T19:30:50.817945] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-13T19:30:50.828260] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-13T19:30:51.153182] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-13T19:30:51.617953] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-13T19:30:51.914378] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-13T19:30:52.417981] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-13T19:30:52.754178] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-13T19:30:53.218011] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-13T19:30:54.017978] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-13T19:30:54.817954] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-13T19:30:54.875639] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-13T19:30:55.160037] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-13T19:30:55.617961] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-13T19:30:56.418020] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-13T19:30:56.459229] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T19:30:56.667080] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-13T19:30:57.220397] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-13T19:30:57.223381] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T19:30:58.017950] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-13T19:30:58.133258] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-13T19:30:58.331403] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-13T19:30:58.817955] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-13T19:30:59.617975] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-13T19:30:59.691824] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T19:30:59.880735] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-13T19:31:00.417945] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-13T19:31:01.217980] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-13T19:31:02.017934] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-13T19:31:02.132118] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T19:31:02.332453] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-13T19:31:02.817981] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-13T19:31:03.147936] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T19:31:03.617897] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-13T19:31:03.672860] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T19:31:04.053072] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-13T19:31:04.417976] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-13T19:31:05.217947] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-13T19:31:06.017955] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-13T19:31:06.238605] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-13T19:31:06.269209] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-13T19:31:06.817973] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-13T19:31:06.870162] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-13T19:31:07.617971] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-13T19:31:07.850739] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-13T19:31:08.417897] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-13T19:31:08.891963] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T19:31:09.217982] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-13T19:31:09.677753] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T19:31:10.017970] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-13T19:31:10.427622] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-13T19:31:10.428457] [INFO ] [REMOTE ] HYAC: Full fetch complete (913 records). [2025-10-13T19:31:10.428539] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-13T19:31:10.608953] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-13T19:31:10.609163] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:31:10.609233] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:31:10.609304] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-13T19:31:10.609365] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-13T19:31:10.609400] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-13T19:31:10.609439] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-13T19:31:10.609543] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HYAC took 20.4s. Estimated remaining: 3h 2m 48s. Rate: 7.1 symbols/min [2025-10-13T19:31:10.776086] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:10.776252] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-13T19:31:10.776306] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-13T19:31:10.776415] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-13T19:31:10.776455] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-13T19:31:10.776495] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-13T19:31:10.776538] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-13T19:31:10.828733] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-13T19:31:11.133360] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:11.197987] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T19:31:11.617929] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-13T19:31:11.968768] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-13T19:31:12.417904] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-13T19:31:12.586318] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-13T19:31:13.209451] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T19:31:13.217897] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-13T19:31:14.013458] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T19:31:14.017962] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-13T19:31:14.817982] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-13T19:31:15.143971] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-13T19:31:15.617905] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-13T19:31:15.991093] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-13T19:31:16.417953] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-13T19:31:16.713842] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-13T19:31:17.096714] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-13T19:31:17.217902] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-13T19:31:18.017957] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-13T19:31:18.724226] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-13T19:31:18.784509] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T19:31:18.817892] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-13T19:31:19.617941] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-13T19:31:19.851961] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-13T19:31:20.417941] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-13T19:31:20.554216] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-13T19:31:20.558861] [INFO ] [REMOTE ] HXL: Full fetch complete (66230 records). [2025-10-13T19:31:20.559005] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-13T19:31:20.934707] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-13T19:31:20.934802] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-13T19:31:20.935662] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-13T19:31:20.935726] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-13T19:31:20.937079] [DEBUG] [LOCAL ] HXL: Trimmed 66230 records to 45906 (keeping 200 days of data) [2025-10-13T19:31:21.218273] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-13T19:31:21.264092] [DEBUG] [LOCAL ] HXL: Primary data saved (45906 records). [2025-10-13T19:31:21.264291] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-13T19:31:21.264503] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HXL took 40.3s. Estimated remaining: 3h 2m 43s. Rate: 7.1 symbols/min [2025-10-13T19:31:21.462386] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:21.476756] [DEBUG] [LOCAL ] HYI: Loaded 10069 existing records from primary storage. [2025-10-13T19:31:21.477000] [INFO ] [MAIN ] HYI: Loaded 10069 existing records. [2025-10-13T19:31:21.662533] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:21.662758] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-13T19:31:21.662815] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-13T19:31:21.663118] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-13T19:31:21.663184] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-13T19:31:22.029196] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-13T19:31:22.063712] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:22.073057] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-13T19:31:22.192013] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T19:31:22.197695] [INFO ] [REMOTE ] HWM: Full fetch complete (76516 records). [2025-10-13T19:31:22.197824] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-13T19:31:22.579387] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-13T19:31:22.579467] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-13T19:31:22.580422] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-13T19:31:22.580484] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-13T19:31:22.581986] [DEBUG] [LOCAL ] HWM: Trimmed 76516 records to 52832 (keeping 200 days of data) [2025-10-13T19:31:22.805179] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-13T19:31:22.818883] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-13T19:31:22.922359] [DEBUG] [LOCAL ] HWM: Primary data saved (52832 records). [2025-10-13T19:31:22.922501] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-13T19:31:22.922585] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HWM took 46.4s. Estimated remaining: 3h 2m 26s. Rate: 7.1 symbols/min [2025-10-13T19:31:23.087511] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:23.119567] [DEBUG] [LOCAL ] HYT: Loaded 34001 existing records from primary storage. [2025-10-13T19:31:23.119862] [INFO ] [MAIN ] HYT: Loaded 34001 existing records. [2025-10-13T19:31:23.297298] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:23.297667] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-13T19:31:23.297858] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-13T19:31:23.298179] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-13T19:31:23.298230] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-13T19:31:23.406076] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T19:31:23.623102] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-13T19:31:23.660881] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:23.988104] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-13T19:31:24.417930] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-13T19:31:25.217981] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-13T19:31:25.714285] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-13T19:31:25.726477] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-13T19:31:26.017980] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-13T19:31:26.817947] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-13T19:31:26.853553] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-13T19:31:27.611307] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:31:27.617872] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-13T19:31:28.356766] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-13T19:31:28.417940] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-13T19:31:28.723153] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-13T19:31:29.217945] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-13T19:31:30.017936] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-13T19:31:30.205309] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-13T19:31:30.356740] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-13T19:31:30.817959] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-13T19:31:31.617901] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-13T19:31:31.639434] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:31:31.640976] [INFO ] [REMOTE ] HY: Full fetch complete (15020 records). [2025-10-13T19:31:31.641045] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-13T19:31:31.996073] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-13T19:31:31.996148] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-13T19:31:31.996475] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-13T19:31:31.996517] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-13T19:31:31.997051] [DEBUG] [LOCAL ] HY: Trimmed 15020 records to 10021 (keeping 200 days of data) [2025-10-13T19:31:32.057074] [DEBUG] [LOCAL ] HY: Primary data saved (10021 records). [2025-10-13T19:31:32.057196] [INFO ] [MAIN ] HY: Full history saved. [2025-10-13T19:31:32.057296] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HY took 46.3s. Estimated remaining: 3h 2m 18s. Rate: 7.1 symbols/min [2025-10-13T19:31:32.222487] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:32.228236] [DEBUG] [LOCAL ] HYTR: Loaded 3168 existing records from primary storage. [2025-10-13T19:31:32.228406] [INFO ] [MAIN ] HYTR: Loaded 3168 existing records. [2025-10-13T19:31:32.404676] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:32.404899] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-13T19:31:32.404965] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-13T19:31:32.405194] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-13T19:31:32.405286] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-13T19:31:32.425686] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-13T19:31:32.798664] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:32.980110] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-13T19:31:33.002097] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T19:31:33.217968] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-13T19:31:33.635628] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-13T19:31:34.017957] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-13T19:31:34.340843] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-13T19:31:34.817946] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-13T19:31:35.617953] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-13T19:31:36.056030] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T19:31:36.327103] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T19:31:36.417886] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-13T19:31:37.217951] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-13T19:31:37.559201] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-13T19:31:37.559887] [INFO ] [REMOTE ] HYBX: Full fetch complete (717 records). [2025-10-13T19:31:37.559952] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-13T19:31:37.560282] [FATAL] [VALIDATOR ] HYBX: Data is stale - most recent date (2025-10-10) is before last completed trading day (2025-10-13). Symbol may be delisted or halted. [2025-10-13T19:31:37.560363] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:31:37.560404] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:31:37.560442] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-13T19:31:37.560496] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-13T19:31:37.560530] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-13T19:31:37.560567] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-13T19:31:37.560618] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYBX took 27.0s. Estimated remaining: 3h 2m 6s. Rate: 7.1 symbols/min [2025-10-13T19:31:38.001365] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:31:38.017870] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-13T19:31:38.817960] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-13T19:31:39.500413] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-13T19:31:39.514551] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T19:31:39.617938] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-13T19:31:40.417947] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-13T19:31:40.868317] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-13T19:31:40.930552] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T19:31:41.217981] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-13T19:31:41.998481] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T19:31:42.017880] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-13T19:31:42.535995] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T19:31:42.817937] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-13T19:31:43.313121] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-13T19:31:43.617949] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-13T19:31:44.233575] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-13T19:31:44.417947] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-13T19:31:45.217953] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-13T19:31:45.381063] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T19:31:45.383104] [INFO ] [REMOTE ] HYI: Full fetch complete (13976 records). [2025-10-13T19:31:45.383202] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-13T19:31:45.745921] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-13T19:31:45.745995] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-13T19:31:45.746293] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-13T19:31:45.746330] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-13T19:31:45.746862] [DEBUG] [LOCAL ] HYI: Trimmed 13976 records to 9920 (keeping 200 days of data) [2025-10-13T19:31:45.806268] [DEBUG] [LOCAL ] HYI: Primary data saved (9920 records). [2025-10-13T19:31:45.806388] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-13T19:31:45.806471] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HYI took 24.5s. Estimated remaining: 3h 1m 58s. Rate: 7.1 symbols/min [2025-10-13T19:31:46.017923] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-13T19:31:46.459483] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-13T19:31:46.717820] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T19:31:46.817990] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-13T19:31:47.162138] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-13T19:31:47.617997] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-13T19:31:48.162307] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T19:31:48.418009] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-13T19:31:49.221486] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-13T19:31:49.749725] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-13T19:31:49.773894] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T19:31:50.017991] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-13T19:31:50.582269] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-13T19:31:50.817937] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-13T19:31:51.617960] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-13T19:31:52.081728] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-13T19:31:52.272508] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:31:52.417889] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-13T19:31:53.217976] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-13T19:31:53.696415] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-13T19:31:53.832292] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T19:31:54.017966] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-13T19:31:54.817989] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-13T19:31:55.383116] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-13T19:31:55.386851] [INFO ] [REMOTE ] HYT: Full fetch complete (47790 records). [2025-10-13T19:31:55.386953] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-13T19:31:55.490410] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:31:55.502322] [INFO ] [REMOTE ] HYTR: Full fetch complete (4627 records). [2025-10-13T19:31:55.512674] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-13T19:31:56.071595] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-13T19:31:56.081972] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-13T19:31:56.088082] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-13T19:31:56.088164] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-13T19:31:56.146614] [DEBUG] [LOCAL ] HYT: Trimmed 47790 records to 33656 (keeping 200 days of data) [2025-10-13T19:31:56.146962] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-13T19:31:56.147077] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-13T19:31:56.147202] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-13T19:31:56.147268] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-13T19:31:56.148314] [DEBUG] [LOCAL ] HYTR: Trimmed 4627 records to 3131 (keeping 200 days of data) [2025-10-13T19:31:56.259905] [DEBUG] [LOCAL ] HYTR: Primary data saved (3131 records). [2025-10-13T19:31:56.265286] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-13T19:31:56.266403] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYTR took 24.2s. Estimated remaining: 3h 1m 52s. Rate: 7.1 symbols/min [2025-10-13T19:31:56.367900] [DEBUG] [LOCAL ] HYT: Primary data saved (33656 records). [2025-10-13T19:31:56.368068] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-13T19:31:56.368162] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HYT took 33.4s. Estimated remaining: 3h 1m 33s. Rate: 7.1 symbols/min [2025-10-13T19:31:57.086176] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:57.076216] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:57.106269] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:57.104953] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:31:57.117505] [DEBUG] [LOCAL ] IAE: Loaded 6312 existing records from primary storage. [2025-10-13T19:31:57.117837] [INFO ] [MAIN ] IAE: Loaded 6312 existing records. [2025-10-13T19:31:57.331576] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:57.333054] [DEBUG] [LOCAL ] HZO: Loaded 29457 existing records from primary storage. [2025-10-13T19:31:57.333411] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-13T19:31:57.333981] [INFO ] [MAIN ] HZO: Loaded 29457 existing records. [2025-10-13T19:31:57.334086] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-13T19:31:57.350984] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-13T19:31:57.357792] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-13T19:31:57.532810] [DEBUG] [LOCAL ] IAG: Loaded 54253 existing records from primary storage. [2025-10-13T19:31:57.590735] [INFO ] [MAIN ] IAG: Loaded 54253 existing records. [2025-10-13T19:31:57.634245] [DEBUG] [LOCAL ] IBM: Loaded 54410 existing records from primary storage. [2025-10-13T19:31:57.733362] [INFO ] [MAIN ] IBM: Loaded 54410 existing records. [2025-10-13T19:31:57.842049] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:57.920052] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-13T19:31:57.972721] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-13T19:31:58.135412] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-13T19:31:58.141617] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:58.151423] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-13T19:31:58.161897] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-13T19:31:58.237168] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-13T19:31:58.362496] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-13T19:31:58.362691] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-13T19:31:58.464244] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:31:58.643990] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-13T19:31:58.709055] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-13T19:31:58.721288] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:58.737083] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-13T19:31:58.754731] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-13T19:31:58.745909] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-13T19:31:59.122261] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:59.202930] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-13T19:31:59.434769] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:59.445398] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-13T19:31:59.503968] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:31:59.504386] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-13T19:31:59.561528] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:31:59.563340] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-13T19:32:00.150725] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-13T19:32:00.152512] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-13T19:32:00.387509] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T19:32:00.417890] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-13T19:32:00.951330] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T19:32:01.217901] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-13T19:32:01.498926] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-13T19:32:01.725470] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-13T19:32:01.854913] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T19:32:02.009702] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-13T19:32:02.021528] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-13T19:32:02.817978] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-13T19:32:03.617972] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-13T19:32:03.770955] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T19:32:04.067365] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-13T19:32:04.068238] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-13T19:32:04.417929] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-13T19:32:05.217938] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-13T19:32:05.820200] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T19:32:06.018043] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-13T19:32:06.394010] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T19:32:06.817939] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-13T19:32:07.282695] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T19:32:07.617985] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-13T19:32:08.417949] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-13T19:32:09.065936] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-13T19:32:09.069208] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-13T19:32:09.217949] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-13T19:32:09.345915] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:32:10.017951] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-13T19:32:10.815545] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-13T19:32:10.817875] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-13T19:32:11.457553] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-13T19:32:11.494714] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-13T19:32:11.617900] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-13T19:32:12.418008] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-13T19:32:13.217900] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-13T19:32:13.786575] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-13T19:32:13.861532] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T19:32:14.017958] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-13T19:32:14.817987] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-13T19:32:14.822968] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T19:32:15.074203] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-13T19:32:15.617956] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-13T19:32:16.417940] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-13T19:32:17.002314] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-13T19:32:17.217934] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-13T19:32:17.415039] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-13T19:32:17.592922] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-13T19:32:18.014241] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T19:32:18.015947] [INFO ] [REMOTE ] IAE: Full fetch complete (8967 records). [2025-10-13T19:32:18.016022] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-13T19:32:18.023164] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-13T19:32:18.408070] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-13T19:32:18.408154] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-13T19:32:18.408438] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-13T19:32:18.408478] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-13T19:32:18.408948] [DEBUG] [LOCAL ] IAE: Trimmed 8967 records to 6226 (keeping 200 days of data) [2025-10-13T19:32:18.448024] [DEBUG] [LOCAL ] IAE: Primary data saved (6226 records). [2025-10-13T19:32:18.448157] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-13T19:32:18.448256] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IAE took 22.1s. Estimated remaining: 3h 1m 41s. Rate: 7.1 symbols/min [2025-10-13T19:32:18.628781] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:18.678387] [DEBUG] [LOCAL ] IBN: Loaded 53629 existing records from primary storage. [2025-10-13T19:32:18.678767] [INFO ] [MAIN ] IBN: Loaded 53629 existing records. [2025-10-13T19:32:18.824498] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-13T19:32:18.866898] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:18.867112] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-13T19:32:18.867159] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-13T19:32:18.868247] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-13T19:32:18.868309] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-13T19:32:19.219716] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:19.617989] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-13T19:32:20.083978] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-13T19:32:20.417937] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-13T19:32:21.217981] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-13T19:32:21.378672] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T19:32:21.408991] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-13T19:32:21.941487] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T19:32:22.017887] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-13T19:32:22.396450] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-13T19:32:22.817995] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-13T19:32:23.617944] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-13T19:32:24.423036] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-13T19:32:24.444276] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-13T19:32:24.625455] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T19:32:25.103344] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:32:25.217940] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-13T19:32:25.706135] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-13T19:32:26.018001] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-13T19:32:26.817931] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-13T19:32:26.937934] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T19:32:27.284931] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T19:32:27.618005] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-13T19:32:28.417949] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-13T19:32:29.218025] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-13T19:32:29.292070] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-13T19:32:29.336228] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T19:32:29.651578] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T19:32:30.017978] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-13T19:32:30.817964] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-13T19:32:30.859582] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T19:32:30.879569] [INFO ] [REMOTE ] IBM: Full fetch complete (77621 records). [2025-10-13T19:32:30.893572] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-13T19:32:30.899096] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-13T19:32:31.305020] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-13T19:32:31.305102] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-13T19:32:31.306058] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-13T19:32:31.306120] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-13T19:32:31.307759] [DEBUG] [LOCAL ] IBM: Trimmed 77621 records to 53633 (keeping 200 days of data) [2025-10-13T19:32:31.635058] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-13T19:32:31.662369] [DEBUG] [LOCAL ] IBM: Primary data saved (53633 records). [2025-10-13T19:32:31.662522] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-13T19:32:31.662618] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBM took 35.3s. Estimated remaining: 3h 1m 38s. Rate: 7.1 symbols/min [2025-10-13T19:32:31.835095] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:31.862910] [DEBUG] [LOCAL ] IBP: Loaded 29252 existing records from primary storage. [2025-10-13T19:32:31.863173] [INFO ] [MAIN ] IBP: Loaded 29252 existing records. [2025-10-13T19:32:32.044393] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:32.044669] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-13T19:32:32.044729] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-13T19:32:32.045485] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-13T19:32:32.045545] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-13T19:32:32.401954] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:32.417879] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-13T19:32:32.809115] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:32:32.812106] [INFO ] [REMOTE ] HZO: Full fetch complete (41072 records). [2025-10-13T19:32:32.812183] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-13T19:32:32.998555] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-13T19:32:33.219009] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-13T19:32:33.252872] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-13T19:32:33.253147] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-13T19:32:33.254083] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-13T19:32:33.254256] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-13T19:32:33.255515] [DEBUG] [LOCAL ] HZO: Trimmed 41072 records to 29044 (keeping 200 days of data) [2025-10-13T19:32:33.435620] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-13T19:32:33.457347] [DEBUG] [LOCAL ] HZO: Primary data saved (29044 records). [2025-10-13T19:32:33.457497] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-13T19:32:33.457590] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. HZO took 37.1s. Estimated remaining: 3h 1m 22s. Rate: 7.1 symbols/min [2025-10-13T19:32:33.622111] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:33.660413] [DEBUG] [LOCAL ] IBTA: Loaded 37604 existing records from primary storage. [2025-10-13T19:32:33.660741] [INFO ] [MAIN ] IBTA: Loaded 37604 existing records. [2025-10-13T19:32:33.834229] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:33.834419] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-13T19:32:33.834466] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-13T19:32:33.834906] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-13T19:32:33.834975] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-13T19:32:34.026008] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-13T19:32:34.181934] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:34.817950] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-13T19:32:35.101074] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T19:32:35.106542] [INFO ] [REMOTE ] IAG: Full fetch complete (77298 records). [2025-10-13T19:32:35.106684] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-13T19:32:35.488294] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-13T19:32:35.488378] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-13T19:32:35.489364] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-13T19:32:35.489428] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-13T19:32:35.490900] [DEBUG] [LOCAL ] IAG: Trimmed 77298 records to 53486 (keeping 200 days of data) [2025-10-13T19:32:35.651093] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-13T19:32:35.809190] [DEBUG] [LOCAL ] IAG: Primary data saved (53486 records). [2025-10-13T19:32:35.809463] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-13T19:32:35.809603] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IAG took 39.4s. Estimated remaining: 3h 1m 6s. Rate: 7.1 symbols/min [2025-10-13T19:32:35.988045] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:36.018975] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T19:32:36.083925] [DEBUG] [LOCAL ] ICE: Loaded 53792 existing records from primary storage. [2025-10-13T19:32:36.084412] [INFO ] [MAIN ] ICE: Loaded 53792 existing records. [2025-10-13T19:32:36.241776] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T19:32:36.290039] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:36.290227] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-13T19:32:36.290273] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-13T19:32:36.291122] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-13T19:32:36.291180] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-13T19:32:36.425994] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-13T19:32:36.647628] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:36.663223] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-13T19:32:37.217896] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-13T19:32:37.589167] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T19:32:38.017985] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-13T19:32:38.515599] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T19:32:38.817942] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-13T19:32:39.617928] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-13T19:32:39.805432] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T19:32:40.153432] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-13T19:32:40.417922] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-13T19:32:40.721480] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:32:41.218000] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-13T19:32:42.017926] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-13T19:32:42.210145] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T19:32:42.790870] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:32:42.817878] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-13T19:32:43.430892] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T19:32:43.617938] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-13T19:32:44.417931] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-13T19:32:44.557732] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T19:32:44.946428] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T19:32:45.217952] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-13T19:32:46.017900] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-13T19:32:46.216692] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T19:32:46.492571] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T19:32:46.817967] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-13T19:32:47.508547] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T19:32:47.617899] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-13T19:32:48.418002] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-13T19:32:48.516106] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T19:32:48.581954] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:32:49.217901] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-13T19:32:49.710697] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T19:32:50.017964] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-13T19:32:50.609612] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T19:32:50.817990] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-13T19:32:51.617970] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-13T19:32:51.725481] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T19:32:52.341971] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-13T19:32:52.418002] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-13T19:32:52.993867] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T19:32:53.217980] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-13T19:32:53.918628] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T19:32:54.017890] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-13T19:32:54.817991] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-13T19:32:55.018789] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T19:32:55.341854] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T19:32:55.345479] [INFO ] [REMOTE ] IBTA: Full fetch complete (50941 records). [2025-10-13T19:32:55.345581] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-13T19:32:55.623135] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-13T19:32:55.744104] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-13T19:32:55.744212] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-13T19:32:55.745294] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-13T19:32:55.745398] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-13T19:32:55.747006] [DEBUG] [LOCAL ] IBTA: Trimmed 50941 records to 36817 (keeping 200 days of data) [2025-10-13T19:32:55.988146] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-13T19:32:56.004952] [DEBUG] [LOCAL ] IBTA: Primary data saved (36817 records). [2025-10-13T19:32:56.005191] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-13T19:32:56.005307] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBTA took 22.5s. Estimated remaining: 3h 1m 12s. Rate: 7.1 symbols/min [2025-10-13T19:32:56.187205] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:56.227401] [DEBUG] [LOCAL ] ICL: Loaded 39002 existing records from primary storage. [2025-10-13T19:32:56.227811] [INFO ] [MAIN ] ICL: Loaded 39002 existing records. [2025-10-13T19:32:56.407113] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:56.407444] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-13T19:32:56.407500] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-13T19:32:56.407868] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-13T19:32:56.407960] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-13T19:32:56.423234] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-13T19:32:56.783958] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:57.218114] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-13T19:32:57.224687] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:32:58.018007] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-13T19:32:58.357149] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-13T19:32:58.380021] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T19:32:58.383620] [INFO ] [REMOTE ] IBP: Full fetch complete (40972 records). [2025-10-13T19:32:58.383773] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-13T19:32:58.756612] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-13T19:32:58.756728] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-13T19:32:58.757431] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-13T19:32:58.757528] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-13T19:32:58.758592] [DEBUG] [LOCAL ] IBP: Trimmed 40972 records to 28889 (keeping 200 days of data) [2025-10-13T19:32:58.827745] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-13T19:32:58.946883] [DEBUG] [LOCAL ] IBP: Primary data saved (28889 records). [2025-10-13T19:32:58.947028] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-13T19:32:58.947109] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. IBP took 27.3s. Estimated remaining: 3h 0m 57s. Rate: 7.1 symbols/min [2025-10-13T19:32:59.115840] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:32:59.151049] [DEBUG] [LOCAL ] IDA: Loaded 33044 existing records from primary storage. [2025-10-13T19:32:59.151352] [INFO ] [MAIN ] IDA: Loaded 33044 existing records. [2025-10-13T19:32:59.347750] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:32:59.348068] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-13T19:32:59.348144] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-13T19:32:59.348494] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-13T19:32:59.348562] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-13T19:32:59.620319] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-13T19:32:59.852010] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:32:59.906276] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-13T19:32:59.951733] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-13T19:33:00.418027] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-13T19:33:01.217938] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-13T19:33:01.755170] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-13T19:33:01.784614] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-13T19:33:02.018004] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-13T19:33:02.575567] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T19:33:02.817960] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-13T19:33:03.617893] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-13T19:33:03.950130] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T19:33:03.979102] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-13T19:33:04.417973] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-13T19:33:05.129862] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T19:33:05.217921] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-13T19:33:05.543974] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-13T19:33:06.017987] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-13T19:33:06.504386] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T19:33:06.817956] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-13T19:33:07.617980] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-13T19:33:07.710186] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-13T19:33:07.715524] [INFO ] [REMOTE ] IBN: Full fetch complete (76326 records). [2025-10-13T19:33:07.715634] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-13T19:33:08.115623] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-13T19:33:08.115832] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-13T19:33:08.116875] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-13T19:33:08.117012] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-13T19:33:08.140174] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T19:33:08.149020] [DEBUG] [LOCAL ] IBN: Trimmed 76326 records to 52832 (keeping 200 days of data) [2025-10-13T19:33:08.427838] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-13T19:33:08.475071] [DEBUG] [LOCAL ] IBN: Primary data saved (52832 records). [2025-10-13T19:33:08.475182] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-13T19:33:08.475261] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. IBN took 50.0s. Estimated remaining: 3h 0m 50s. Rate: 7.1 symbols/min [2025-10-13T19:33:08.640625] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:08.650161] [DEBUG] [LOCAL ] IDE: Loaded 9136 existing records from primary storage. [2025-10-13T19:33:08.650331] [INFO ] [MAIN ] IDE: Loaded 9136 existing records. [2025-10-13T19:33:08.822787] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:08.822999] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-13T19:33:08.823045] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-13T19:33:08.823206] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-13T19:33:08.823262] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-13T19:33:09.180677] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:09.217891] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-13T19:33:09.253994] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T19:33:10.017977] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-13T19:33:10.049945] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:33:10.186444] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T19:33:10.817962] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-13T19:33:11.555733] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-13T19:33:11.617893] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-13T19:33:12.055336] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-13T19:33:12.372625] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T19:33:12.417969] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-13T19:33:13.078244] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-13T19:33:13.217984] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-13T19:33:14.017970] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-13T19:33:14.735629] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-13T19:33:14.817931] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-13T19:33:15.069622] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T19:33:15.617976] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-13T19:33:16.165168] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T19:33:16.409683] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-13T19:33:16.417872] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-13T19:33:17.204094] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-13T19:33:17.217876] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-13T19:33:17.965637] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-13T19:33:18.017891] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-13T19:33:18.817990] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-13T19:33:18.831802] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:33:19.617981] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-13T19:33:20.203379] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-13T19:33:20.372448] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T19:33:20.417888] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-13T19:33:21.202576] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-13T19:33:21.204247] [INFO ] [REMOTE ] IDE: Full fetch complete (12676 records). [2025-10-13T19:33:21.204343] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-13T19:33:21.224918] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-13T19:33:21.588874] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-13T19:33:21.589012] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-13T19:33:21.589490] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-13T19:33:21.589557] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-13T19:33:21.590210] [DEBUG] [LOCAL ] IDE: Trimmed 12676 records to 9063 (keeping 200 days of data) [2025-10-13T19:33:21.651854] [DEBUG] [LOCAL ] IDE: Primary data saved (9063 records). [2025-10-13T19:33:21.652042] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-13T19:33:21.652189] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. IDE took 13.2s. Estimated remaining: 3h 0m 47s. Rate: 7.1 symbols/min [2025-10-13T19:33:21.826859] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:21.849493] [DEBUG] [LOCAL ] IDT: Loaded 18518 existing records from primary storage. [2025-10-13T19:33:21.849871] [INFO ] [MAIN ] IDT: Loaded 18518 existing records. [2025-10-13T19:33:22.023492] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-13T19:33:22.028484] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:22.029781] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-13T19:33:22.029846] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-13T19:33:22.030122] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-13T19:33:22.030192] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-13T19:33:22.401691] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:22.461547] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T19:33:22.817938] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-13T19:33:23.621189] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-13T19:33:23.944963] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-13T19:33:24.256748] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T19:33:24.417863] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-13T19:33:24.678685] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T19:33:25.217948] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-13T19:33:25.879792] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T19:33:25.897211] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-13T19:33:26.017955] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-13T19:33:26.818010] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-13T19:33:26.830010] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T19:33:27.617978] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-13T19:33:28.251529] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:33:28.372205] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-13T19:33:28.417930] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-13T19:33:29.217949] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-13T19:33:29.843553] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-13T19:33:30.017943] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-13T19:33:30.731874] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T19:33:30.737456] [INFO ] [REMOTE ] ICE: Full fetch complete (76766 records). [2025-10-13T19:33:30.737577] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-13T19:33:30.823267] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-13T19:33:31.106326] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-13T19:33:31.166967] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-13T19:33:31.167062] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-13T19:33:31.168160] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-13T19:33:31.168225] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-13T19:33:31.169830] [DEBUG] [LOCAL ] ICE: Trimmed 76766 records to 53011 (keeping 200 days of data) [2025-10-13T19:33:31.504913] [DEBUG] [LOCAL ] ICE: Primary data saved (53011 records). [2025-10-13T19:33:31.505059] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-13T19:33:31.505148] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. ICE took 55.7s. Estimated remaining: 3h 0m 40s. Rate: 7.1 symbols/min [2025-10-13T19:33:31.623133] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-13T19:33:31.673810] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:31.711949] [DEBUG] [LOCAL ] IEX: Loaded 38845 existing records from primary storage. [2025-10-13T19:33:31.712249] [INFO ] [MAIN ] IEX: Loaded 38845 existing records. [2025-10-13T19:33:31.887823] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:31.888103] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-13T19:33:31.888151] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-13T19:33:31.889058] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-13T19:33:31.889117] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-13T19:33:32.262806] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:32.418017] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-13T19:33:32.791969] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-13T19:33:33.064897] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:33:33.218005] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-13T19:33:33.913783] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T19:33:34.017974] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-13T19:33:34.555086] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:33:34.559438] [INFO ] [REMOTE ] ICL: Full fetch complete (55923 records). [2025-10-13T19:33:34.559547] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-13T19:33:34.826610] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-13T19:33:34.974425] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-13T19:33:34.974540] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-13T19:33:34.975538] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-13T19:33:34.975608] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-13T19:33:34.979271] [DEBUG] [LOCAL ] ICL: Trimmed 55923 records to 38494 (keeping 200 days of data) [2025-10-13T19:33:35.223205] [DEBUG] [LOCAL ] ICL: Primary data saved (38494 records). [2025-10-13T19:33:35.223614] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-13T19:33:35.223771] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. ICL took 39.2s. Estimated remaining: 3h 0m 26s. Rate: 7.1 symbols/min [2025-10-13T19:33:35.403244] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:35.423772] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T19:33:35.492304] [DEBUG] [LOCAL ] IFF: Loaded 51808 existing records from primary storage. [2025-10-13T19:33:35.492776] [INFO ] [MAIN ] IFF: Loaded 51808 existing records. [2025-10-13T19:33:35.623170] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-13T19:33:35.686023] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:35.687505] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-13T19:33:35.687739] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-13T19:33:35.688376] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-13T19:33:35.688443] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-13T19:33:35.892966] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T19:33:36.080217] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:36.417963] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-13T19:33:36.710122] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-13T19:33:37.217972] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-13T19:33:37.474704] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T19:33:38.017968] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-13T19:33:38.717132] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T19:33:38.817954] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-13T19:33:39.183473] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T19:33:39.617996] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-13T19:33:40.417965] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-13T19:33:40.540148] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T19:33:41.047567] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-13T19:33:41.122927] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:33:41.218013] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-13T19:33:42.018031] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-13T19:33:42.817992] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-13T19:33:42.910797] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:33:43.267449] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T19:33:43.617945] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-13T19:33:43.761120] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T19:33:44.417971] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-13T19:33:45.217960] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-13T19:33:45.410856] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T19:33:45.905041] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T19:33:46.018011] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-13T19:33:46.663341] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T19:33:46.667306] [INFO ] [REMOTE ] IDA: Full fetch complete (45066 records). [2025-10-13T19:33:46.667453] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-13T19:33:46.823125] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-13T19:33:47.072071] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-13T19:33:47.072193] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-13T19:33:47.073207] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-13T19:33:47.073288] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-13T19:33:47.075302] [DEBUG] [LOCAL ] IDA: Trimmed 45066 records to 32732 (keeping 200 days of data) [2025-10-13T19:33:47.296383] [DEBUG] [LOCAL ] IDA: Primary data saved (32732 records). [2025-10-13T19:33:47.296602] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-13T19:33:47.296788] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IDA took 48.3s. Estimated remaining: 3h 0m 22s. Rate: 7.1 symbols/min [2025-10-13T19:33:47.478266] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:47.503026] [DEBUG] [LOCAL ] IFN: Loaded 18563 existing records from primary storage. [2025-10-13T19:33:47.503364] [INFO ] [MAIN ] IFN: Loaded 18563 existing records. [2025-10-13T19:33:47.619717] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-13T19:33:47.695553] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:47.696057] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-13T19:33:47.696138] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-13T19:33:47.706473] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-13T19:33:47.707124] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-13T19:33:47.778971] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T19:33:48.157867] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:48.290711] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T19:33:48.417952] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-13T19:33:49.156367] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T19:33:49.217933] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-13T19:33:49.622861] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-13T19:33:49.625788] [INFO ] [REMOTE ] IDT: Full fetch complete (23620 records). [2025-10-13T19:33:49.625868] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-13T19:33:49.988125] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-13T19:33:49.988200] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-13T19:33:49.988717] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-13T19:33:49.988776] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-13T19:33:49.989368] [DEBUG] [LOCAL ] IDT: Trimmed 23620 records to 18345 (keeping 200 days of data) [2025-10-13T19:33:50.037205] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-13T19:33:50.104892] [DEBUG] [LOCAL ] IDT: Primary data saved (18345 records). [2025-10-13T19:33:50.105014] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-13T19:33:50.105117] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IDT took 28.5s. Estimated remaining: 3h 0m 7s. Rate: 7.1 symbols/min [2025-10-13T19:33:50.272348] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:50.299715] [DEBUG] [LOCAL ] IFS: Loaded 23218 existing records from primary storage. [2025-10-13T19:33:50.300110] [INFO ] [MAIN ] IFS: Loaded 23218 existing records. [2025-10-13T19:33:50.491239] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:50.491545] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-13T19:33:50.491596] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-13T19:33:50.492357] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-13T19:33:50.492419] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-13T19:33:50.819623] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-13T19:33:50.878211] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:33:50.905955] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T19:33:51.362833] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T19:33:51.618141] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-13T19:33:52.318109] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T19:33:52.418072] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-13T19:33:52.696061] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T19:33:53.217984] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-13T19:33:54.017939] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-13T19:33:54.307403] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T19:33:54.755684] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T19:33:54.817918] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-13T19:33:55.193351] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T19:33:55.618006] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-13T19:33:56.062706] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T19:33:56.417995] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-13T19:33:56.681354] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-13T19:33:57.217957] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-13T19:33:57.435018] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T19:33:58.018006] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-13T19:33:58.664331] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T19:33:58.668279] [INFO ] [REMOTE ] IEX: Full fetch complete (53398 records). [2025-10-13T19:33:58.668378] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-13T19:33:58.825250] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-13T19:33:59.080827] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-13T19:33:59.081056] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-13T19:33:59.082027] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-13T19:33:59.082115] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-13T19:33:59.084348] [DEBUG] [LOCAL ] IEX: Trimmed 53398 records to 38338 (keeping 200 days of data) [2025-10-13T19:33:59.334149] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T19:33:59.397143] [DEBUG] [LOCAL ] IEX: Primary data saved (38338 records). [2025-10-13T19:33:59.397317] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-13T19:33:59.397412] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IEX took 27.9s. Estimated remaining: 2h 59m 59s. Rate: 7.1 symbols/min [2025-10-13T19:33:59.563975] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:33:59.576960] [DEBUG] [LOCAL ] IGA: Loaded 10174 existing records from primary storage. [2025-10-13T19:33:59.577210] [INFO ] [MAIN ] IGA: Loaded 10174 existing records. [2025-10-13T19:33:59.630197] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-13T19:33:59.758492] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:33:59.758738] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-13T19:33:59.758790] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-13T19:33:59.759037] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-13T19:33:59.759105] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-13T19:34:00.062238] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T19:34:00.145161] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:00.417975] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-13T19:34:01.217950] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-13T19:34:01.651068] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-13T19:34:01.674704] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T19:34:02.017933] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-13T19:34:02.177801] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-13T19:34:02.817962] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-13T19:34:03.028308] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T19:34:03.617896] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-13T19:34:03.934909] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T19:34:04.417962] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-13T19:34:05.217925] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-13T19:34:05.253376] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T19:34:05.419732] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-13T19:34:06.017978] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-13T19:34:06.084635] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T19:34:06.817940] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-13T19:34:07.097115] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-13T19:34:07.617971] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-13T19:34:07.654561] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:34:08.417982] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-13T19:34:09.217921] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-13T19:34:09.389164] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-13T19:34:09.565080] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T19:34:09.738725] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T19:34:10.017973] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-13T19:34:10.817943] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-13T19:34:11.104801] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T19:34:11.621924] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-13T19:34:11.957083] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T19:34:12.417979] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-13T19:34:13.108748] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-13T19:34:13.217964] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-13T19:34:13.394522] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T19:34:14.017964] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-13T19:34:14.195612] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-13T19:34:14.817939] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-13T19:34:15.617929] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-13T19:34:15.815321] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-13T19:34:15.924258] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-13T19:34:16.417973] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-13T19:34:16.636070] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T19:34:17.217942] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-13T19:34:17.490491] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T19:34:18.017988] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-13T19:34:18.290484] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T19:34:18.728892] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T19:34:18.817946] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-13T19:34:19.617945] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-13T19:34:19.626275] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T19:34:20.417931] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-13T19:34:21.210992] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-13T19:34:21.217877] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-13T19:34:21.374074] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T19:34:21.381885] [INFO ] [REMOTE ] IFF: Full fetch complete (73231 records). [2025-10-13T19:34:21.382116] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-13T19:34:21.790364] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-13T19:34:21.790454] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-13T19:34:21.791359] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-13T19:34:21.791421] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-13T19:34:21.792835] [DEBUG] [LOCAL ] IFF: Trimmed 73231 records to 51078 (keeping 200 days of data) [2025-10-13T19:34:22.027868] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-13T19:34:22.036157] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T19:34:22.133058] [DEBUG] [LOCAL ] IFF: Primary data saved (51078 records). [2025-10-13T19:34:22.133222] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-13T19:34:22.133316] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFF took 46.9s. Estimated remaining: 3h 0m 7s. Rate: 7.1 symbols/min [2025-10-13T19:34:22.300100] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:34:22.318578] [DEBUG] [LOCAL ] IGD: Loaded 19633 existing records from primary storage. [2025-10-13T19:34:22.318835] [INFO ] [MAIN ] IGD: Loaded 19633 existing records. [2025-10-13T19:34:22.493771] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:34:22.493994] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-13T19:34:22.494041] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-13T19:34:22.494322] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-13T19:34:22.494384] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-13T19:34:22.824726] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-13T19:34:22.855143] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:23.100017] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:34:23.102999] [INFO ] [REMOTE ] IFN: Full fetch complete (28661 records). [2025-10-13T19:34:23.103093] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-13T19:34:23.482912] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-13T19:34:23.483009] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-13T19:34:23.483907] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-13T19:34:23.483972] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-13T19:34:23.484796] [DEBUG] [LOCAL ] IFN: Trimmed 28661 records to 18400 (keeping 200 days of data) [2025-10-13T19:34:23.607633] [DEBUG] [LOCAL ] IFN: Primary data saved (18400 records). [2025-10-13T19:34:23.607944] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-13T19:34:23.608073] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFN took 36.3s. Estimated remaining: 2h 59m 51s. Rate: 7.1 symbols/min [2025-10-13T19:34:23.623036] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-13T19:34:23.738057] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-13T19:34:23.823827] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:34:23.831363] [DEBUG] [LOCAL ] IGI: Loaded 3893 existing records from primary storage. [2025-10-13T19:34:23.831702] [INFO ] [MAIN ] IGI: Loaded 3893 existing records. [2025-10-13T19:34:24.017168] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:34:24.017461] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-13T19:34:24.017513] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-13T19:34:24.017809] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-13T19:34:24.017867] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-13T19:34:24.389442] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:24.417948] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-13T19:34:24.689189] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:34:24.692581] [INFO ] [REMOTE ] IFS: Full fetch complete (31856 records). [2025-10-13T19:34:24.692717] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-13T19:34:25.088335] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-13T19:34:25.088450] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-13T19:34:25.089327] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-13T19:34:25.089391] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-13T19:34:25.090783] [DEBUG] [LOCAL ] IFS: Trimmed 31856 records to 22767 (keeping 200 days of data) [2025-10-13T19:34:25.223713] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-13T19:34:25.234866] [DEBUG] [LOCAL ] IFS: Primary data saved (22767 records). [2025-10-13T19:34:25.235209] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-13T19:34:25.235315] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IFS took 35.1s. Estimated remaining: 2h 59m 34s. Rate: 7.1 symbols/min [2025-10-13T19:34:25.282528] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-13T19:34:25.321965] [INFO ] [REMOTE ] IGA: Full fetch complete (14026 records). [2025-10-13T19:34:25.333810] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-13T19:34:25.574710] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:34:25.849112] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-13T19:34:25.848867] [DEBUG] [LOCAL ] IGR: Loaded 30825 existing records from primary storage. [2025-10-13T19:34:25.849508] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-13T19:34:25.849767] [INFO ] [MAIN ] IGR: Loaded 30825 existing records. [2025-10-13T19:34:25.850408] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-13T19:34:25.850503] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-13T19:34:25.884331] [DEBUG] [LOCAL ] IGA: Trimmed 14026 records to 10122 (keeping 200 days of data) [2025-10-13T19:34:26.028211] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-13T19:34:26.108285] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:34:26.111013] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-13T19:34:26.111467] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-13T19:34:26.116932] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-13T19:34:26.117674] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-13T19:34:26.168284] [DEBUG] [LOCAL ] IGA: Primary data saved (10122 records). [2025-10-13T19:34:26.191341] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-13T19:34:26.191506] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IGA took 26.8s. Estimated remaining: 2h 59m 17s. Rate: 7.1 symbols/min [2025-10-13T19:34:26.509394] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:34:26.603236] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T19:34:26.618582] [DEBUG] [LOCAL ] IH: Loaded 2888 existing records from primary storage. [2025-10-13T19:34:26.636337] [INFO ] [MAIN ] IH: Loaded 2888 existing records. [2025-10-13T19:34:26.841187] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-13T19:34:26.847542] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:26.940772] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:34:26.941050] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-13T19:34:26.941139] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-13T19:34:26.944229] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-13T19:34:26.946863] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-13T19:34:26.983337] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-13T19:34:27.357313] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:27.618017] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-13T19:34:28.116034] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T19:34:28.183879] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-13T19:34:28.417988] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-13T19:34:29.217926] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-13T19:34:29.428514] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T19:34:29.688381] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-13T19:34:30.017964] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-13T19:34:30.541272] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T19:34:30.818013] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-13T19:34:31.617976] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-13T19:34:31.923518] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-13T19:34:32.417971] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-13T19:34:33.043191] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T19:34:33.217941] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-13T19:34:33.312728] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-13T19:34:33.702294] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-13T19:34:34.017965] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-13T19:34:34.495911] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T19:34:34.817941] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-13T19:34:35.338294] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-13T19:34:35.617966] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-13T19:34:36.417961] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-13T19:34:36.854610] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-13T19:34:36.988281] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-13T19:34:37.218003] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-13T19:34:37.873368] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-13T19:34:38.017950] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-13T19:34:38.325980] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-13T19:34:38.817971] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-13T19:34:39.617960] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-13T19:34:40.076453] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-13T19:34:40.174231] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T19:34:40.417957] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-13T19:34:40.905549] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-13T19:34:41.217966] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-13T19:34:42.017971] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-13T19:34:42.253956] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-13T19:34:42.605861] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T19:34:42.817979] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-13T19:34:43.617997] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-13T19:34:43.862872] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-13T19:34:44.214056] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-13T19:34:44.417938] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-13T19:34:45.045533] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T19:34:45.217989] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-13T19:34:45.766013] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-13T19:34:46.017973] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-13T19:34:46.817980] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-13T19:34:47.308908] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T19:34:47.617953] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-13T19:34:47.854385] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T19:34:48.256135] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-13T19:34:48.417993] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-13T19:34:49.028716] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T19:34:49.217971] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-13T19:34:50.017981] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-13T19:34:50.269845] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-13T19:34:50.704820] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T19:34:50.706102] [INFO ] [REMOTE ] IGI: Full fetch complete (5443 records). [2025-10-13T19:34:50.706169] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-13T19:34:50.823192] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-13T19:34:51.088612] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-13T19:34:51.088816] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-13T19:34:51.089095] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-13T19:34:51.089146] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-13T19:34:51.089858] [DEBUG] [LOCAL ] IGI: Trimmed 5443 records to 3896 (keeping 200 days of data) [2025-10-13T19:34:51.113160] [DEBUG] [LOCAL ] IGI: Primary data saved (3896 records). [2025-10-13T19:34:51.113223] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-13T19:34:51.113299] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGI took 27.5s. Estimated remaining: 2h 59m 28s. Rate: 7.1 symbols/min [2025-10-13T19:34:51.276618] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:34:51.284663] [DEBUG] [LOCAL ] IHD: Loaded 7240 existing records from primary storage. [2025-10-13T19:34:51.284860] [INFO ] [MAIN ] IHD: Loaded 7240 existing records. [2025-10-13T19:34:51.463145] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:34:51.463335] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T19:34:51.463606] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-13T19:34:51.465102] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-13T19:34:51.465706] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-13T19:34:51.465765] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-13T19:34:51.623423] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-13T19:34:51.818285] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:34:52.417987] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-13T19:34:53.123733] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T19:34:53.168087] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T19:34:53.217882] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-13T19:34:54.019977] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-13T19:34:54.023617] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T19:34:54.817995] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-13T19:34:55.175111] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-13T19:34:55.617961] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-13T19:34:56.133409] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T19:34:56.334120] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T19:34:56.417935] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-13T19:34:57.217901] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-13T19:34:57.419822] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-13T19:34:57.990340] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-13T19:34:58.017879] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-13T19:34:58.608237] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-13T19:34:58.818002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-13T19:34:59.540932] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-13T19:34:59.618008] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-13T19:35:00.417954] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-13T19:35:00.665568] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-13T19:35:00.668775] [INFO ] [REMOTE ] IGD: Full fetch complete (29979 records). [2025-10-13T19:35:00.668854] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-13T19:35:01.093093] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-13T19:35:01.093232] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-13T19:35:01.094588] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-13T19:35:01.094850] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-13T19:35:01.096867] [DEBUG] [LOCAL ] IGD: Trimmed 29979 records to 19338 (keeping 200 days of data) [2025-10-13T19:35:01.220131] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-13T19:35:01.221576] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T19:35:01.286626] [DEBUG] [LOCAL ] IGD: Primary data saved (19338 records). [2025-10-13T19:35:01.286864] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-13T19:35:01.286990] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGD took 39.2s. Estimated remaining: 2h 59m 21s. Rate: 7.1 symbols/min [2025-10-13T19:35:01.547125] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:01.581392] [DEBUG] [LOCAL ] IHG: Loaded 24505 existing records from primary storage. [2025-10-13T19:35:01.581807] [INFO ] [MAIN ] IHG: Loaded 24505 existing records. [2025-10-13T19:35:01.853988] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:01.854286] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-13T19:35:01.854357] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-13T19:35:01.855096] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-13T19:35:01.855159] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-13T19:35:02.023250] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-13T19:35:02.350508] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:02.513430] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-13T19:35:02.817989] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-13T19:35:02.857537] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T19:35:03.368776] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-13T19:35:03.369721] [INFO ] [REMOTE ] IH: Full fetch complete (5002 records). [2025-10-13T19:35:03.369794] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-13T19:35:03.623207] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-13T19:35:03.743068] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-13T19:35:03.743148] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-13T19:35:03.743299] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-13T19:35:03.743338] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-13T19:35:03.743755] [DEBUG] [LOCAL ] IH: Trimmed 5002 records to 2809 (keeping 200 days of data) [2025-10-13T19:35:03.759749] [DEBUG] [LOCAL ] IH: Primary data saved (2809 records). [2025-10-13T19:35:03.759851] [INFO ] [MAIN ] IH: Full history saved. [2025-10-13T19:35:03.759945] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IH took 37.6s. Estimated remaining: 2h 59m 6s. Rate: 7.1 symbols/min [2025-10-13T19:35:03.928957] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:03.963867] [DEBUG] [LOCAL ] IHS: Loaded 38726 existing records from primary storage. [2025-10-13T19:35:03.964179] [INFO ] [MAIN ] IHS: Loaded 38726 existing records. [2025-10-13T19:35:04.144738] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:04.144998] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-13T19:35:04.145057] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-13T19:35:04.145849] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-13T19:35:04.145905] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-13T19:35:04.421557] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-13T19:35:04.457094] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T19:35:04.546286] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:05.217971] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-13T19:35:05.689397] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-13T19:35:06.017974] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-13T19:35:06.714618] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-13T19:35:06.817936] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-13T19:35:07.467513] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-13T19:35:07.617954] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-13T19:35:07.916014] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T19:35:08.417932] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-13T19:35:08.739309] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-13T19:35:09.217959] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-13T19:35:09.445414] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-13T19:35:10.017986] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-13T19:35:10.545437] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:35:10.817964] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-13T19:35:10.971763] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-13T19:35:11.617963] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-13T19:35:11.986255] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:35:11.989291] [INFO ] [REMOTE ] IGR: Full fetch complete (44933 records). [2025-10-13T19:35:11.989372] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-13T19:35:12.360255] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-13T19:35:12.360336] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-13T19:35:12.361027] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-13T19:35:12.361127] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-13T19:35:12.362109] [DEBUG] [LOCAL ] IGR: Trimmed 44933 records to 30339 (keeping 200 days of data) [2025-10-13T19:35:12.419166] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-13T19:35:12.538575] [DEBUG] [LOCAL ] IGR: Primary data saved (30339 records). [2025-10-13T19:35:12.538739] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-13T19:35:12.538827] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IGR took 47.3s. Estimated remaining: 2h 58m 58s. Rate: 7.1 symbols/min [2025-10-13T19:35:12.713103] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:12.730021] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T19:35:12.739112] [DEBUG] [LOCAL ] IIF: Loaded 5698 existing records from primary storage. [2025-10-13T19:35:12.739331] [INFO ] [MAIN ] IIF: Loaded 5698 existing records. [2025-10-13T19:35:12.915156] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:12.915360] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-13T19:35:12.915406] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-13T19:35:12.915723] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-13T19:35:12.915782] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-13T19:35:13.223102] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-13T19:35:13.260172] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:13.922010] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:35:14.017878] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-13T19:35:14.492771] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-13T19:35:14.817942] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-13T19:35:15.368301] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T19:35:15.544440] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-13T19:35:15.617959] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-13T19:35:16.417950] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-13T19:35:16.952417] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-13T19:35:17.217976] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-13T19:35:17.272355] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-13T19:35:18.017960] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-13T19:35:18.823685] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-13T19:35:18.836812] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-13T19:35:19.280070] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T19:35:19.617994] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-13T19:35:19.695016] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T19:35:20.417979] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-13T19:35:20.994223] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T19:35:21.095045] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:35:21.217977] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-13T19:35:21.985555] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T19:35:22.017987] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-13T19:35:22.818006] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-13T19:35:23.442047] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-13T19:35:23.619114] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-13T19:35:23.622994] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-13T19:35:23.624821] [INFO ] [REMOTE ] IHD: Full fetch complete (11943 records). [2025-10-13T19:35:23.624894] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-13T19:35:23.975586] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-13T19:35:23.975687] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-13T19:35:23.975995] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-13T19:35:23.976035] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-13T19:35:23.976467] [DEBUG] [LOCAL ] IHD: Trimmed 11943 records to 7224 (keeping 200 days of data) [2025-10-13T19:35:24.017871] [DEBUG] [LOCAL ] IHD: Primary data saved (7224 records). [2025-10-13T19:35:24.018014] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-13T19:35:24.018101] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHD took 32.9s. Estimated remaining: 2h 58m 53s. Rate: 7.1 symbols/min [2025-10-13T19:35:24.188774] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:24.206926] [DEBUG] [LOCAL ] IIIN: Loaded 16292 existing records from primary storage. [2025-10-13T19:35:24.207142] [INFO ] [MAIN ] IIIN: Loaded 16292 existing records. [2025-10-13T19:35:24.378390] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:24.378613] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-13T19:35:24.378694] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-13T19:35:24.378974] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-13T19:35:24.379029] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-13T19:35:24.422995] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-13T19:35:24.723566] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:25.067309] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:35:25.217890] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-13T19:35:25.299006] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-13T19:35:26.018043] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-13T19:35:26.544839] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:35:26.817965] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-13T19:35:26.892798] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-13T19:35:27.617950] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-13T19:35:28.028173] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-13T19:35:28.417929] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-13T19:35:28.860073] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T19:35:28.863524] [INFO ] [REMOTE ] IHS: Full fetch complete (51455 records). [2025-10-13T19:35:28.863669] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-13T19:35:28.985722] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T19:35:29.218712] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-13T19:35:29.251837] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-13T19:35:29.251905] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-13T19:35:29.252720] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-13T19:35:29.252783] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-13T19:35:29.253967] [DEBUG] [LOCAL ] IHS: Trimmed 51455 records to 37878 (keeping 200 days of data) [2025-10-13T19:35:29.462365] [DEBUG] [LOCAL ] IHS: Primary data saved (37878 records). [2025-10-13T19:35:29.462495] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-13T19:35:29.462587] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IHS took 25.7s. Estimated remaining: 2h 58m 41s. Rate: 7.1 symbols/min [2025-10-13T19:35:29.642277] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:29.661233] [DEBUG] [LOCAL ] IIM: Loaded 16054 existing records from primary storage. [2025-10-13T19:35:29.661452] [INFO ] [MAIN ] IIM: Loaded 16054 existing records. [2025-10-13T19:35:29.840517] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:29.840854] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-13T19:35:29.840908] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-13T19:35:29.841454] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-13T19:35:29.841516] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-13T19:35:29.946092] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T19:35:30.028281] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-13T19:35:30.206907] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:30.817950] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-13T19:35:31.353279] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-13T19:35:31.617951] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-13T19:35:32.144927] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T19:35:32.234274] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T19:35:32.417941] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-13T19:35:33.218008] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-13T19:35:33.749429] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-13T19:35:33.820291] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T19:35:34.018013] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-13T19:35:34.817983] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-13T19:35:35.250464] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-13T19:35:35.464285] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T19:35:35.617949] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-13T19:35:36.417971] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-13T19:35:36.577284] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-13T19:35:36.907495] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-13T19:35:36.908444] [INFO ] [REMOTE ] IIF: Full fetch complete (9041 records). [2025-10-13T19:35:36.908513] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-13T19:35:37.223040] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-13T19:35:37.263975] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-13T19:35:37.264062] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-13T19:35:37.264321] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-13T19:35:37.264384] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-13T19:35:37.265000] [DEBUG] [LOCAL ] IIF: Trimmed 9041 records to 5598 (keeping 200 days of data) [2025-10-13T19:35:37.303505] [DEBUG] [LOCAL ] IIF: Primary data saved (5598 records). [2025-10-13T19:35:37.303792] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-13T19:35:37.304059] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IIF took 24.8s. Estimated remaining: 2h 58m 32s. Rate: 7.1 symbols/min [2025-10-13T19:35:37.475162] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:37.505776] [DEBUG] [LOCAL ] IIPR: Loaded 29852 existing records from primary storage. [2025-10-13T19:35:37.506042] [INFO ] [MAIN ] IIPR: Loaded 29852 existing records. [2025-10-13T19:35:37.685635] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:37.685889] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-13T19:35:37.685935] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-13T19:35:37.686695] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-13T19:35:37.686792] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-13T19:35:38.023083] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-13T19:35:38.055554] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:38.299432] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-13T19:35:38.820990] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-13T19:35:39.166087] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-13T19:35:39.618029] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-13T19:35:40.410077] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T19:35:40.417873] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-13T19:35:40.697789] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T19:35:41.217946] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-13T19:35:41.911153] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T19:35:42.017945] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-13T19:35:42.378798] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-13T19:35:42.381628] [INFO ] [REMOTE ] IHG: Full fetch complete (33776 records). [2025-10-13T19:35:42.381747] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-13T19:35:42.754510] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-13T19:35:42.754592] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-13T19:35:42.755261] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-13T19:35:42.755322] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-13T19:35:42.757479] [DEBUG] [LOCAL ] IHG: Trimmed 33776 records to 24225 (keeping 200 days of data) [2025-10-13T19:35:42.822795] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-13T19:35:42.915843] [DEBUG] [LOCAL ] IHG: Primary data saved (24225 records). [2025-10-13T19:35:42.915983] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-13T19:35:42.916083] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IHG took 41.6s. Estimated remaining: 2h 58m 20s. Rate: 7.1 symbols/min [2025-10-13T19:35:43.087074] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:35:43.104588] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T19:35:43.148485] [DEBUG] [LOCAL ] IMAX: Loaded 43577 existing records from primary storage. [2025-10-13T19:35:43.148816] [INFO ] [MAIN ] IMAX: Loaded 43577 existing records. [2025-10-13T19:35:43.321617] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:35:43.321874] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-13T19:35:43.321920] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-13T19:35:43.322286] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-13T19:35:43.322342] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-13T19:35:43.623107] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-13T19:35:43.678674] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:35:43.969709] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T19:35:44.418031] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-13T19:35:44.712069] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T19:35:45.217903] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-13T19:35:45.375043] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T19:35:46.017942] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-13T19:35:46.519761] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T19:35:46.817935] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-13T19:35:47.029233] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-13T19:35:47.617903] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-13T19:35:48.421840] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-13T19:35:48.424723] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-13T19:35:48.577130] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:35:49.217952] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-13T19:35:49.865764] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T19:35:50.017954] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-13T19:35:50.679457] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T19:35:50.817902] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-13T19:35:50.857709] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:35:51.617984] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-13T19:35:52.188377] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T19:35:52.417952] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-13T19:35:53.163812] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-13T19:35:53.217902] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-13T19:35:53.343711] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-13T19:35:54.017994] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-13T19:35:54.212269] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T19:35:54.789731] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T19:35:54.818024] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-13T19:35:55.617018] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T19:35:55.621051] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-13T19:35:56.244632] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-13T19:35:56.417953] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-13T19:35:57.217934] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-13T19:35:57.362239] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-13T19:35:58.017969] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-13T19:35:58.689369] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:35:58.817928] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-13T19:35:59.214581] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-13T19:35:59.617946] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-13T19:36:00.324050] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:36:00.417949] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-13T19:36:01.004685] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T19:36:01.167074] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-13T19:36:01.217887] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-13T19:36:02.017985] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-13T19:36:02.287630] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:36:02.290442] [INFO ] [REMOTE ] IIM: Full fetch complete (25252 records). [2025-10-13T19:36:02.290943] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-13T19:36:02.667683] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-13T19:36:02.667825] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-13T19:36:02.668855] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-13T19:36:02.668925] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-13T19:36:02.670029] [DEBUG] [LOCAL ] IIM: Trimmed 25252 records to 15729 (keeping 200 days of data) [2025-10-13T19:36:02.778813] [DEBUG] [LOCAL ] IIM: Primary data saved (15729 records). [2025-10-13T19:36:02.778976] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-13T19:36:02.779061] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIM took 33.3s. Estimated remaining: 2h 58m 25s. Rate: 7.1 symbols/min [2025-10-13T19:36:02.823153] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-13T19:36:02.973846] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:03.018141] [DEBUG] [LOCAL ] INFA: Loaded 49851 existing records from primary storage. [2025-10-13T19:36:03.018498] [INFO ] [MAIN ] INFA: Loaded 49851 existing records. [2025-10-13T19:36:03.194806] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:03.195234] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-13T19:36:03.195406] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-13T19:36:03.196003] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-13T19:36:03.196061] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-13T19:36:03.576204] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:03.598293] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-13T19:36:03.617985] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-13T19:36:04.415529] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T19:36:04.423707] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-13T19:36:05.217966] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-13T19:36:05.234369] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-13T19:36:05.465318] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T19:36:06.017979] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-13T19:36:06.605812] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-13T19:36:06.817985] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-13T19:36:07.617994] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-13T19:36:07.788666] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T19:36:08.088076] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-13T19:36:08.091833] [INFO ] [REMOTE ] IIPR: Full fetch complete (44393 records). [2025-10-13T19:36:08.091933] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-13T19:36:08.422587] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-13T19:36:08.433451] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:36:08.441801] [INFO ] [REMOTE ] IIIN: Full fetch complete (24463 records). [2025-10-13T19:36:08.502120] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-13T19:36:08.513906] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-13T19:36:08.514133] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-13T19:36:08.515136] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-13T19:36:08.528099] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-13T19:36:08.641121] [DEBUG] [LOCAL ] IIPR: Trimmed 44393 records to 29422 (keeping 200 days of data) [2025-10-13T19:36:09.175088] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-13T19:36:09.175840] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-13T19:36:09.178601] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-13T19:36:09.183211] [DEBUG] [LOCAL ] IIPR: Primary data saved (29422 records). [2025-10-13T19:36:09.183435] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-13T19:36:09.183537] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-13T19:36:09.183721] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IIPR took 31.9s. Estimated remaining: 2h 58m 14s. Rate: 7.1 symbols/min [2025-10-13T19:36:09.226724] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-13T19:36:09.252609] [DEBUG] [LOCAL ] IIIN: Trimmed 24463 records to 15957 (keeping 200 days of data) [2025-10-13T19:36:09.431861] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:09.464040] [DEBUG] [LOCAL ] IIIN: Primary data saved (15957 records). [2025-10-13T19:36:09.464328] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-13T19:36:09.464467] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. IIIN took 45.4s. Estimated remaining: 2h 57m 56s. Rate: 7.1 symbols/min [2025-10-13T19:36:09.669834] [DEBUG] [LOCAL ] INFY: Loaded 54374 existing records from primary storage. [2025-10-13T19:36:09.671367] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:09.672131] [INFO ] [MAIN ] INFY: Loaded 54374 existing records. [2025-10-13T19:36:09.859462] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:09.859784] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-13T19:36:09.859834] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-13T19:36:09.860353] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-13T19:36:09.860408] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-13T19:36:10.139793] [DEBUG] [LOCAL ] ING: Loaded 51465 existing records from primary storage. [2025-10-13T19:36:10.172508] [INFO ] [MAIN ] ING: Loaded 51465 existing records. [2025-10-13T19:36:10.311007] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:10.333295] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-13T19:36:10.476455] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:10.478537] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-13T19:36:10.487626] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-13T19:36:10.487814] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-13T19:36:10.489446] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-13T19:36:10.489584] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-13T19:36:10.796990] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-13T19:36:10.820571] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-13T19:36:10.885941] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:11.618007] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-13T19:36:12.422602] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-13T19:36:12.425820] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T19:36:12.600317] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T19:36:12.925496] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:36:13.217935] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-13T19:36:14.017956] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-13T19:36:14.109455] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-13T19:36:14.817937] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-13T19:36:14.954450] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:36:15.476361] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T19:36:15.617894] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-13T19:36:16.288771] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T19:36:16.417956] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-13T19:36:16.718361] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:36:17.217974] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-13T19:36:18.012827] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T19:36:18.023274] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-13T19:36:18.817943] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-13T19:36:18.903208] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-13T19:36:19.617895] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-13T19:36:19.652208] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-13T19:36:20.270144] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T19:36:20.274736] [INFO ] [REMOTE ] IMAX: Full fetch complete (60284 records). [2025-10-13T19:36:20.274838] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-13T19:36:20.423022] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-13T19:36:20.654815] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-13T19:36:20.654895] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-13T19:36:20.655692] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-13T19:36:20.655754] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-13T19:36:20.657002] [DEBUG] [LOCAL ] IMAX: Trimmed 60284 records to 43065 (keeping 200 days of data) [2025-10-13T19:36:20.915084] [DEBUG] [LOCAL ] IMAX: Primary data saved (43065 records). [2025-10-13T19:36:20.915210] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-13T19:36:20.915287] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. IMAX took 38.0s. Estimated remaining: 2h 57m 51s. Rate: 7.1 symbols/min [2025-10-13T19:36:21.088204] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:21.119211] [DEBUG] [LOCAL ] INGM: Loaded 29140 existing records from primary storage. [2025-10-13T19:36:21.119478] [INFO ] [MAIN ] INGM: Loaded 29140 existing records. [2025-10-13T19:36:21.223090] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-13T19:36:21.307841] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:21.308126] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-13T19:36:21.308183] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-13T19:36:21.308632] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-13T19:36:21.308723] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-13T19:36:21.665735] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:21.756456] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-13T19:36:22.017985] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-13T19:36:22.274353] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-13T19:36:22.594630] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T19:36:22.817938] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-13T19:36:22.945339] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T19:36:23.617968] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-13T19:36:24.417948] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-13T19:36:24.536143] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-13T19:36:24.887667] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T19:36:25.217974] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-13T19:36:25.304615] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-13T19:36:26.017930] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-13T19:36:26.817954] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-13T19:36:27.133949] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-13T19:36:27.586993] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-13T19:36:27.617896] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-13T19:36:28.417986] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-13T19:36:28.604601] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T19:36:29.223887] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-13T19:36:29.230093] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:36:29.257268] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-13T19:36:30.017950] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-13T19:36:30.817927] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-13T19:36:31.102166] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T19:36:31.324150] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-13T19:36:31.618011] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-13T19:36:32.371310] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T19:36:32.417904] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-13T19:36:33.116316] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-13T19:36:33.217947] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-13T19:36:33.853741] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T19:36:33.858165] [INFO ] [REMOTE ] INFA: Full fetch complete (70797 records). [2025-10-13T19:36:33.858295] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-13T19:36:34.029197] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-13T19:36:34.243941] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-13T19:36:34.244027] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-13T19:36:34.244952] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-13T19:36:34.245017] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-13T19:36:34.246489] [DEBUG] [LOCAL ] INFA: Trimmed 70797 records to 49157 (keeping 200 days of data) [2025-10-13T19:36:34.499253] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-13T19:36:34.582399] [DEBUG] [LOCAL ] INFA: Primary data saved (49157 records). [2025-10-13T19:36:34.582535] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-13T19:36:34.582614] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INFA took 31.8s. Estimated remaining: 2h 57m 49s. Rate: 7.1 symbols/min [2025-10-13T19:36:34.746790] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:34.780582] [DEBUG] [LOCAL ] INGR: Loaded 34205 existing records from primary storage. [2025-10-13T19:36:34.780874] [INFO ] [MAIN ] INGR: Loaded 34205 existing records. [2025-10-13T19:36:34.823289] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-13T19:36:34.954132] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:34.954324] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-13T19:36:34.954370] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-13T19:36:34.954688] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-13T19:36:34.954744] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-13T19:36:35.330612] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:35.617979] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-13T19:36:36.078985] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-13T19:36:36.417990] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-13T19:36:36.780425] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-13T19:36:36.974925] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T19:36:37.217943] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-13T19:36:37.778887] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T19:36:38.017928] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-13T19:36:38.443966] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T19:36:38.817992] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-13T19:36:39.536988] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T19:36:39.617901] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-13T19:36:40.133183] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T19:36:40.417956] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-13T19:36:40.949755] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-13T19:36:41.217964] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-13T19:36:42.017972] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-13T19:36:42.141776] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-13T19:36:42.331924] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-13T19:36:42.817950] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-13T19:36:43.244167] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-13T19:36:43.617986] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-13T19:36:44.106879] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T19:36:44.417956] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-13T19:36:44.878118] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T19:36:45.217940] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-13T19:36:45.590984] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T19:36:46.017962] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-13T19:36:46.817927] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-13T19:36:47.085416] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T19:36:47.618008] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-13T19:36:47.904940] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T19:36:47.964821] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-13T19:36:48.418006] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-13T19:36:49.217928] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-13T19:36:49.258206] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T19:36:49.263843] [INFO ] [REMOTE ] INFY: Full fetch complete (77553 records). [2025-10-13T19:36:49.264012] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-13T19:36:49.608437] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T19:36:49.654966] [INFO ] [REMOTE ] INGM: Full fetch complete (42096 records). [2025-10-13T19:36:49.671954] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-13T19:36:49.699150] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-13T19:36:49.733334] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-13T19:36:49.747202] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-13T19:36:49.761439] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-13T19:36:49.820904] [DEBUG] [LOCAL ] INFY: Trimmed 77553 records to 53596 (keeping 200 days of data) [2025-10-13T19:36:50.052906] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-13T19:36:50.269975] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-13T19:36:50.270091] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-13T19:36:50.271258] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-13T19:36:50.324213] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-13T19:36:50.369029] [DEBUG] [LOCAL ] INGM: Trimmed 42096 records to 28621 (keeping 200 days of data) [2025-10-13T19:36:50.662609] [DEBUG] [LOCAL ] INFY: Primary data saved (53596 records). [2025-10-13T19:36:50.664835] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-13T19:36:50.665272] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INFY took 41.5s. Estimated remaining: 2h 57m 49s. Rate: 7.1 symbols/min [2025-10-13T19:36:50.789807] [DEBUG] [LOCAL ] INGM: Primary data saved (28621 records). [2025-10-13T19:36:50.800755] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-13T19:36:50.806106] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INGM took 29.9s. Estimated remaining: 2h 57m 31s. Rate: 7.1 symbols/min [2025-10-13T19:36:50.981212] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:51.074363] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:51.081906] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-13T19:36:51.091565] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-13T19:36:51.094267] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-13T19:36:51.094154] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T19:36:51.094477] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-13T19:36:51.100086] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-13T19:36:51.100480] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-13T19:36:51.117757] [INFO ] [REMOTE ] ING: Full fetch complete (73607 records). [2025-10-13T19:36:51.131080] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-13T19:36:51.312742] [DEBUG] [LOCAL ] INN: Loaded 42347 existing records from primary storage. [2025-10-13T19:36:51.324229] [INFO ] [MAIN ] INN: Loaded 42347 existing records. [2025-10-13T19:36:52.052767] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:52.118224] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-13T19:36:52.124564] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-13T19:36:52.124449] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:52.138316] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-13T19:36:52.139312] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-13T19:36:52.139618] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-13T19:36:52.160429] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-13T19:36:52.231232] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-13T19:36:52.372870] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:36:52.387901] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-13T19:36:52.407352] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-13T19:36:52.417895] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-13T19:36:52.406624] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:36:52.434780] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-13T19:36:52.461387] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-13T19:36:52.449584] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-13T19:36:52.469188] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:36:52.498756] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-13T19:36:52.538957] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-13T19:36:52.551290] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-13T19:36:52.551169] [DEBUG] [LOCAL ] ING: Trimmed 73607 records to 50726 (keeping 200 days of data) [2025-10-13T19:36:52.592687] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-13T19:36:52.600796] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INR took 1.8s. Estimated remaining: 2h 57m 15s. Rate: 7.1 symbols/min [2025-10-13T19:36:52.898521] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:52.914596] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-13T19:36:52.990850] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:53.157748] [DEBUG] [LOCAL ] INSP: Loaded 38337 existing records from primary storage. [2025-10-13T19:36:53.165158] [INFO ] [MAIN ] INSP: Loaded 38337 existing records. [2025-10-13T19:36:53.419566] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:53.422129] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-13T19:36:53.423897] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-13T19:36:53.425201] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-13T19:36:53.425573] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-13T19:36:53.477846] [DEBUG] [LOCAL ] ING: Primary data saved (50726 records). [2025-10-13T19:36:53.490625] [INFO ] [MAIN ] ING: Full history saved. [2025-10-13T19:36:53.528149] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. ING took 44.1s. Estimated remaining: 2h 56m 58s. Rate: 7.1 symbols/min [2025-10-13T19:36:53.949292] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:36:54.021515] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T19:36:54.053315] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:54.059768] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-13T19:36:54.061387] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-13T19:36:54.100066] [DEBUG] [LOCAL ] INSW: Loaded 40341 existing records from primary storage. [2025-10-13T19:36:54.100448] [INFO ] [MAIN ] INSW: Loaded 40341 existing records. [2025-10-13T19:36:54.280178] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:36:54.280389] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-13T19:36:54.280439] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-13T19:36:54.280895] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-13T19:36:54.280953] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-13T19:36:54.622831] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T19:36:54.681961] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:36:54.817953] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-13T19:36:55.232279] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T19:36:55.449066] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-13T19:36:55.617948] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-13T19:36:56.417934] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-13T19:36:56.578540] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T19:36:56.658515] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-13T19:36:57.217956] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-13T19:36:57.816583] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T19:36:58.017950] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-13T19:36:58.160675] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T19:36:58.817947] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-13T19:36:59.489482] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T19:36:59.617972] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-13T19:37:00.304227] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T19:37:00.417898] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-13T19:37:01.028127] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T19:37:01.217994] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-13T19:37:02.000789] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-13T19:37:02.007565] [INFO ] [REMOTE ] INGR: Full fetch complete (50470 records). [2025-10-13T19:37:02.007827] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-13T19:37:02.023241] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-13T19:37:02.410988] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-13T19:37:02.411215] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-13T19:37:02.412530] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-13T19:37:02.412604] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-13T19:37:02.414365] [DEBUG] [LOCAL ] INGR: Trimmed 50470 records to 33810 (keeping 200 days of data) [2025-10-13T19:37:02.650100] [DEBUG] [LOCAL ] INGR: Primary data saved (33810 records). [2025-10-13T19:37:02.650318] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-13T19:37:02.650540] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INGR took 28.1s. Estimated remaining: 2h 56m 50s. Rate: 7.1 symbols/min [2025-10-13T19:37:02.853625] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-13T19:37:02.857776] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:02.872154] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-13T19:37:02.939194] [DEBUG] [LOCAL ] INVH: Loaded 53939 existing records from primary storage. [2025-10-13T19:37:02.939635] [INFO ] [MAIN ] INVH: Loaded 53939 existing records. [2025-10-13T19:37:03.123683] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:03.123986] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-13T19:37:03.124039] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-13T19:37:03.124635] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-13T19:37:03.124731] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-13T19:37:03.506954] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:03.520221] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T19:37:03.617953] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-13T19:37:04.005011] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T19:37:04.417948] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-13T19:37:05.165331] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T19:37:05.217904] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-13T19:37:05.928052] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:37:06.017946] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-13T19:37:06.817953] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-13T19:37:06.923341] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T19:37:07.617967] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-13T19:37:07.729581] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-13T19:37:08.201531] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-13T19:37:08.417940] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-13T19:37:08.774748] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T19:37:09.217958] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-13T19:37:09.986826] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:37:10.017963] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-13T19:37:10.817948] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-13T19:37:10.847940] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T19:37:11.429783] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T19:37:11.617957] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-13T19:37:12.223518] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-13T19:37:12.418004] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-13T19:37:13.217943] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-13T19:37:13.465882] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-13T19:37:13.980604] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T19:37:14.017903] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-13T19:37:14.330720] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:37:14.817964] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-13T19:37:15.617988] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-13T19:37:15.785221] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T19:37:16.392464] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:37:16.417892] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-13T19:37:16.633361] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-13T19:37:17.217978] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-13T19:37:17.796453] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-13T19:37:18.017967] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-13T19:37:18.682695] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T19:37:18.817964] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-13T19:37:19.223980] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-13T19:37:19.617992] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-13T19:37:20.215901] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-13T19:37:20.221571] [INFO ] [REMOTE ] INSW: Full fetch complete (60172 records). [2025-10-13T19:37:20.221696] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-13T19:37:20.424214] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-13T19:37:20.606633] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-13T19:37:20.606765] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-13T19:37:20.607742] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-13T19:37:20.607818] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-13T19:37:20.609239] [DEBUG] [LOCAL ] INSW: Trimmed 60172 records to 39735 (keeping 200 days of data) [2025-10-13T19:37:20.757635] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-13T19:37:20.883139] [DEBUG] [LOCAL ] INSW: Primary data saved (39735 records). [2025-10-13T19:37:20.883285] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-13T19:37:20.883380] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSW took 27.3s. Estimated remaining: 2h 56m 53s. Rate: 7.1 symbols/min [2025-10-13T19:37:21.053309] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:21.085876] [DEBUG] [LOCAL ] INVX: Loaded 29577 existing records from primary storage. [2025-10-13T19:37:21.086135] [INFO ] [MAIN ] INVX: Loaded 29577 existing records. [2025-10-13T19:37:21.224396] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-13T19:37:21.266593] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:21.266801] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-13T19:37:21.266848] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-13T19:37:21.267195] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-13T19:37:21.267251] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-13T19:37:21.617175] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:22.018007] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-13T19:37:22.159685] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T19:37:22.721346] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T19:37:22.817897] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-13T19:37:23.107082] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T19:37:23.618025] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-13T19:37:24.369541] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T19:37:24.417984] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-13T19:37:25.217938] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-13T19:37:25.466479] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-13T19:37:26.017969] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-13T19:37:26.205389] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T19:37:26.529962] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T19:37:26.817947] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-13T19:37:27.449488] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T19:37:27.617904] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-13T19:37:28.417921] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-13T19:37:28.655350] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T19:37:28.707201] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T19:37:29.217945] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-13T19:37:30.017948] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-13T19:37:30.072297] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T19:37:30.371403] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T19:37:30.817972] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-13T19:37:31.210925] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T19:37:31.618016] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-13T19:37:32.207995] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-13T19:37:32.418043] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-13T19:37:33.128297] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T19:37:33.132895] [INFO ] [REMOTE ] INSP: Full fetch complete (53346 records). [2025-10-13T19:37:33.133001] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-13T19:37:33.223195] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-13T19:37:33.520669] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-13T19:37:33.520892] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-13T19:37:33.521733] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-13T19:37:33.521795] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-13T19:37:33.523232] [DEBUG] [LOCAL ] INSP: Trimmed 53346 records to 38084 (keeping 200 days of data) [2025-10-13T19:37:33.751885] [DEBUG] [LOCAL ] INSP: Primary data saved (38084 records). [2025-10-13T19:37:33.752035] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-13T19:37:33.752116] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INSP took 41.2s. Estimated remaining: 2h 56m 49s. Rate: 7.1 symbols/min [2025-10-13T19:37:33.842491] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T19:37:33.846776] [INFO ] [REMOTE ] INN: Full fetch complete (57671 records). [2025-10-13T19:37:33.846867] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-13T19:37:34.020093] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-13T19:37:34.233600] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-13T19:37:34.233708] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-13T19:37:34.234579] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-13T19:37:34.234621] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-13T19:37:34.237608] [DEBUG] [LOCAL ] INN: Trimmed 57671 records to 41803 (keeping 200 days of data) [2025-10-13T19:37:34.503383] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T19:37:34.504591] [DEBUG] [LOCAL ] INN: Primary data saved (41803 records). [2025-10-13T19:37:34.511330] [INFO ] [MAIN ] INN: Full history saved. [2025-10-13T19:37:34.511820] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INN took 43.8s. Estimated remaining: 2h 56m 32s. Rate: 7.1 symbols/min [2025-10-13T19:37:34.817946] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-13T19:37:35.905450] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-13T19:37:35.917334] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-13T19:37:35.963963] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-13T19:37:36.417997] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-13T19:37:37.647123] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-13T19:37:37.652871] [INFO ] [REMOTE ] INVH: Full fetch complete (76743 records). [2025-10-13T19:37:37.653030] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-13T19:37:38.034619] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T19:37:38.082246] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-13T19:37:38.082125] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-13T19:37:38.082445] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-13T19:37:38.084718] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-13T19:37:38.084792] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-13T19:37:38.086361] [DEBUG] [LOCAL ] INVH: Trimmed 76743 records to 53181 (keeping 200 days of data) [2025-10-13T19:37:38.441377] [DEBUG] [LOCAL ] INVH: Primary data saved (53181 records). [2025-10-13T19:37:38.441599] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-13T19:37:38.441809] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. INVH took 35.8s. Estimated remaining: 2h 56m 19s. Rate: 7.1 symbols/min [2025-10-13T19:37:39.423921] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T19:37:39.430108] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-13T19:37:40.621591] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T19:37:40.634305] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-13T19:37:41.641610] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:37:41.645515] [INFO ] [REMOTE ] INVX: Full fetch complete (43415 records). [2025-10-13T19:37:41.645705] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-13T19:37:42.037401] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-13T19:37:42.037481] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-13T19:37:42.038160] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-13T19:37:42.038224] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-13T19:37:42.039164] [DEBUG] [LOCAL ] INVX: Trimmed 43415 records to 29284 (keeping 200 days of data) [2025-10-13T19:37:42.206404] [DEBUG] [LOCAL ] INVX: Primary data saved (29284 records). [2025-10-13T19:37:42.206532] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-13T19:37:42.206611] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. INVX took 21.3s. Estimated remaining: 2h 56m 5s. Rate: 7.1 symbols/min [2025-10-13T19:37:42.741017] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:42.844040] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:42.908830] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:42.958129] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:37:43.022622] [DEBUG] [LOCAL ] IOT: Loaded 54252 existing records from primary storage. [2025-10-13T19:37:43.023132] [INFO ] [MAIN ] IOT: Loaded 54252 existing records. [2025-10-13T19:37:43.214397] [DEBUG] [LOCAL ] IPG: Loaded 54108 existing records from primary storage. [2025-10-13T19:37:43.228298] [DEBUG] [LOCAL ] IP: Loaded 54090 existing records from primary storage. [2025-10-13T19:37:43.270872] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:43.286749] [INFO ] [MAIN ] IP: Loaded 54090 existing records. [2025-10-13T19:37:43.286194] [INFO ] [MAIN ] IPG: Loaded 54108 existing records. [2025-10-13T19:37:43.287181] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-13T19:37:43.334400] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-13T19:37:43.335409] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-10-13T19:37:43.387320] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-13T19:37:43.420103] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-13T19:37:43.425767] [INFO ] [MAIN ] IONQ: Loaded 54568 existing records. [2025-10-13T19:37:43.839040] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:43.855131] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-13T19:37:43.927547] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-13T19:37:43.991434] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-13T19:37:44.027091] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:44.076048] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-13T19:37:44.112659] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-13T19:37:44.112361] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:37:44.174431] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-13T19:37:44.194228] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-13T19:37:44.141355] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-13T19:37:44.272891] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-13T19:37:44.296238] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-13T19:37:44.296337] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-13T19:37:44.296602] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-13T19:37:44.633531] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:44.652833] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-13T19:37:45.225271] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:45.255523] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-13T19:37:45.383749] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:45.380282] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:37:45.384145] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-13T19:37:45.384608] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-13T19:37:46.739414] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T19:37:46.750324] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-13T19:37:47.008987] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-13T19:37:47.020094] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-13T19:37:47.187764] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-13T19:37:47.198279] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-13T19:37:48.060598] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-13T19:37:48.071686] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-13T19:37:48.526167] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T19:37:48.537150] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-13T19:37:48.592563] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T19:37:48.603365] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-13T19:37:48.816104] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T19:37:48.827839] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-13T19:37:49.938009] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T19:37:49.948754] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-13T19:37:50.265946] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-13T19:37:50.277250] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-13T19:37:50.404278] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-13T19:37:50.416137] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-13T19:37:50.456945] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T19:37:50.817972] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-13T19:37:51.934148] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-13T19:37:51.945568] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-13T19:37:52.151263] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T19:37:52.417965] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-13T19:37:52.583467] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T19:37:52.662709] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-13T19:37:53.217960] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-13T19:37:53.887001] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T19:37:54.017936] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-13T19:37:54.381993] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T19:37:54.817925] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-13T19:37:55.617948] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-13T19:37:55.948713] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-13T19:37:56.114434] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-10-13T19:37:56.369628] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T19:37:56.417952] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-13T19:37:57.065596] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T19:37:57.217943] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-13T19:37:58.017946] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-13T19:37:58.444626] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-13T19:37:58.818012] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-13T19:37:59.617948] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-13T19:37:59.688170] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:37:59.922686] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-13T19:38:00.417966] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-13T19:38:00.800131] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T19:38:01.217956] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-13T19:38:01.382037] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T19:38:02.017948] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-13T19:38:02.308395] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T19:38:02.817905] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-13T19:38:03.205405] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T19:38:03.618029] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-13T19:38:04.031583] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-13T19:38:04.162020] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T19:38:04.417969] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-13T19:38:05.217986] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-13T19:38:05.342709] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T19:38:06.017961] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-13T19:38:06.823971] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-13T19:38:06.830363] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:38:07.198268] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-13T19:38:07.617943] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-13T19:38:07.806758] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-13T19:38:07.812294] [INFO ] [REMOTE ] IOT: Full fetch complete (77392 records). [2025-10-13T19:38:07.812453] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-13T19:38:08.221457] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-13T19:38:08.221624] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-13T19:38:08.222760] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-13T19:38:08.222867] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-13T19:38:08.224766] [DEBUG] [LOCAL ] IOT: Trimmed 77392 records to 53475 (keeping 200 days of data) [2025-10-13T19:38:08.386575] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T19:38:08.433676] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-13T19:38:08.595141] [DEBUG] [LOCAL ] IOT: Primary data saved (53475 records). [2025-10-13T19:38:08.595279] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-13T19:38:08.595357] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IOT took 26.4s. Estimated remaining: 2h 56m 17s. Rate: 7.1 symbols/min [2025-10-13T19:38:08.760629] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:08.782625] [DEBUG] [LOCAL ] IPI: Loaded 21875 existing records from primary storage. [2025-10-13T19:38:08.782892] [INFO ] [MAIN ] IPI: Loaded 21875 existing records. [2025-10-13T19:38:08.984939] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:08.985244] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-13T19:38:08.985297] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-13T19:38:08.985578] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-13T19:38:08.985616] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-13T19:38:09.229678] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-13T19:38:09.357316] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:09.389552] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:38:10.017967] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-13T19:38:10.817932] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-13T19:38:10.992465] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-13T19:38:11.056001] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T19:38:11.591530] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T19:38:11.597349] [INFO ] [REMOTE ] IPG: Full fetch complete (77251 records). [2025-10-13T19:38:11.597458] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-13T19:38:11.628492] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-13T19:38:11.907806] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-13T19:38:12.004241] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-13T19:38:12.004320] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-13T19:38:12.005256] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-13T19:38:12.005321] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-13T19:38:12.006793] [DEBUG] [LOCAL ] IPG: Trimmed 77251 records to 53329 (keeping 200 days of data) [2025-10-13T19:38:12.338287] [DEBUG] [LOCAL ] IPG: Primary data saved (53329 records). [2025-10-13T19:38:12.338421] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-13T19:38:12.338563] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IPG took 30.1s. Estimated remaining: 2h 56m 3s. Rate: 7.1 symbols/min [2025-10-13T19:38:12.423277] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-13T19:38:12.511724] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:12.531370] [DEBUG] [LOCAL ] IQI: Loaded 18146 existing records from primary storage. [2025-10-13T19:38:12.531677] [INFO ] [MAIN ] IQI: Loaded 18146 existing records. [2025-10-13T19:38:12.712234] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:12.712491] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-13T19:38:12.712539] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-13T19:38:12.712818] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-13T19:38:12.712876] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-13T19:38:13.078861] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:13.097074] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-13T19:38:13.102790] [INFO ] [REMOTE ] IP: Full fetch complete (77171 records). [2025-10-13T19:38:13.102951] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-13T19:38:13.223175] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-13T19:38:13.493590] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-13T19:38:13.493702] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-13T19:38:13.494674] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-13T19:38:13.494737] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-13T19:38:13.496277] [DEBUG] [LOCAL ] IP: Trimmed 77171 records to 53310 (keeping 200 days of data) [2025-10-13T19:38:13.820463] [DEBUG] [LOCAL ] IP: Primary data saved (53310 records). [2025-10-13T19:38:13.820599] [INFO ] [MAIN ] IP: Full history saved. [2025-10-13T19:38:13.820701] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IP took 31.6s. Estimated remaining: 2h 55m 47s. Rate: 7.1 symbols/min [2025-10-13T19:38:13.983978] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:14.018012] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-13T19:38:14.037703] [DEBUG] [LOCAL ] IQV: Loaded 50832 existing records from primary storage. [2025-10-13T19:38:14.038039] [INFO ] [MAIN ] IQV: Loaded 50832 existing records. [2025-10-13T19:38:14.225843] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:14.226574] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-13T19:38:14.226629] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-13T19:38:14.227148] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-13T19:38:14.227206] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-13T19:38:14.578970] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-13T19:38:14.608014] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:14.817890] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-13T19:38:14.846836] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T19:38:15.218400] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-13T19:38:15.617960] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-13T19:38:15.883006] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T19:38:16.417899] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-13T19:38:16.612979] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T19:38:17.217960] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-13T19:38:18.017904] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-13T19:38:18.124988] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-13T19:38:18.817899] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-13T19:38:19.084889] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T19:38:19.623849] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-13T19:38:19.639987] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-13T19:38:19.966891] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T19:38:20.231057] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T19:38:20.417958] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-13T19:38:21.217938] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-13T19:38:22.017937] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-13T19:38:22.089297] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T19:38:22.297961] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T19:38:22.817968] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-13T19:38:23.618019] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-13T19:38:23.791858] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-13T19:38:24.417942] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-13T19:38:24.483995] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-13T19:38:25.214769] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-13T19:38:25.224270] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-13T19:38:25.642776] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T19:38:26.017965] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-13T19:38:26.818016] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-13T19:38:26.927501] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-13T19:38:27.617937] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-13T19:38:27.888986] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-13T19:38:27.894418] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-13T19:38:27.894538] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-13T19:38:28.304408] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-13T19:38:28.304556] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-13T19:38:28.305503] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-13T19:38:28.305567] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-13T19:38:28.307046] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-13T19:38:28.418087] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-13T19:38:28.591622] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-13T19:38:28.595978] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-13T19:38:28.703980] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-13T19:38:28.704126] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-13T19:38:28.704219] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IONQ took 46.5s. Estimated remaining: 2h 55m 45s. Rate: 7.1 symbols/min [2025-10-13T19:38:28.872706] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:28.924069] [DEBUG] [LOCAL ] IR: Loaded 53520 existing records from primary storage. [2025-10-13T19:38:28.924376] [INFO ] [MAIN ] IR: Loaded 53520 existing records. [2025-10-13T19:38:29.100403] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:29.100776] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-13T19:38:29.100845] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-13T19:38:29.106562] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-13T19:38:29.111818] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-13T19:38:29.117872] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T19:38:29.222597] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-13T19:38:29.505664] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:30.017892] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-13T19:38:30.145549] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-13T19:38:30.817962] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-13T19:38:30.986196] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-13T19:38:31.617980] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-13T19:38:32.423358] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-13T19:38:32.429743] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T19:38:33.217897] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-13T19:38:33.321801] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T19:38:33.561163] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-13T19:38:34.017905] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-13T19:38:34.275954] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T19:38:34.817984] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-13T19:38:35.617950] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-13T19:38:35.694753] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T19:38:35.736494] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-13T19:38:36.417951] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-13T19:38:36.671017] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T19:38:37.217978] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-13T19:38:38.017953] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-13T19:38:38.133714] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T19:38:38.705895] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T19:38:38.709068] [INFO ] [REMOTE ] IPI: Full fetch complete (29727 records). [2025-10-13T19:38:38.709167] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-13T19:38:38.821419] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-13T19:38:39.124043] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-13T19:38:39.135052] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-13T19:38:39.142175] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-13T19:38:39.142311] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-13T19:38:39.154726] [DEBUG] [LOCAL ] IPI: Trimmed 29727 records to 21272 (keeping 200 days of data) [2025-10-13T19:38:39.157120] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-13T19:38:39.310223] [DEBUG] [LOCAL ] IPI: Primary data saved (21272 records). [2025-10-13T19:38:39.310431] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-13T19:38:39.310542] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IPI took 30.7s. Estimated remaining: 2h 55m 39s. Rate: 7.1 symbols/min [2025-10-13T19:38:39.485232] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:39.543555] [DEBUG] [LOCAL ] IRM: Loaded 49959 existing records from primary storage. [2025-10-13T19:38:39.544016] [INFO ] [MAIN ] IRM: Loaded 49959 existing records. [2025-10-13T19:38:39.618327] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-13T19:38:39.743151] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:39.749409] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-13T19:38:39.750239] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-13T19:38:39.750552] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T19:38:39.752729] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-13T19:38:39.752939] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-13T19:38:39.758220] [INFO ] [REMOTE ] IQI: Full fetch complete (26595 records). [2025-10-13T19:38:39.785674] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-13T19:38:40.423817] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-13T19:38:40.529016] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:40.577375] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-13T19:38:40.577472] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-13T19:38:40.578179] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-13T19:38:40.578267] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-13T19:38:40.578970] [DEBUG] [LOCAL ] IQI: Trimmed 26595 records to 17869 (keeping 200 days of data) [2025-10-13T19:38:40.689236] [DEBUG] [LOCAL ] IQI: Primary data saved (17869 records). [2025-10-13T19:38:40.689386] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-13T19:38:40.689472] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IQI took 28.4s. Estimated remaining: 2h 55m 23s. Rate: 7.1 symbols/min [2025-10-13T19:38:40.862108] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:40.885303] [DEBUG] [LOCAL ] IRS: Loaded 22978 existing records from primary storage. [2025-10-13T19:38:40.885593] [INFO ] [MAIN ] IRS: Loaded 22978 existing records. [2025-10-13T19:38:41.069013] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:41.069257] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-13T19:38:41.069305] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-13T19:38:41.069676] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-13T19:38:41.069765] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-13T19:38:41.222462] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-13T19:38:41.453011] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:41.494766] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-13T19:38:42.017976] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-13T19:38:42.342818] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T19:38:42.819197] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-13T19:38:42.825964] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:38:43.359155] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-13T19:38:43.617975] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-13T19:38:44.158191] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-13T19:38:44.417983] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-13T19:38:45.217948] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-13T19:38:45.420047] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T19:38:46.017967] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-13T19:38:46.058955] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T19:38:46.127428] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-13T19:38:46.817980] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-13T19:38:47.617994] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-13T19:38:47.692519] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T19:38:48.417975] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-13T19:38:48.451568] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-13T19:38:49.223027] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-13T19:38:49.243310] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-13T19:38:49.518854] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T19:38:50.018222] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-13T19:38:50.818006] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-13T19:38:51.015985] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-13T19:38:51.125265] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T19:38:51.617968] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-13T19:38:52.357413] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-13T19:38:52.417990] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-13T19:38:52.848091] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T19:38:53.217979] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-13T19:38:53.462473] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T19:38:53.886452] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-13T19:38:53.892416] [INFO ] [REMOTE ] IQV: Full fetch complete (72160 records). [2025-10-13T19:38:53.892579] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-13T19:38:54.023047] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-13T19:38:54.322140] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-13T19:38:54.322253] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-13T19:38:54.323573] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-13T19:38:54.323690] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-13T19:38:54.326440] [DEBUG] [LOCAL ] IQV: Trimmed 72160 records to 50121 (keeping 200 days of data) [2025-10-13T19:38:54.663347] [DEBUG] [LOCAL ] IQV: Primary data saved (50121 records). [2025-10-13T19:38:54.663540] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-13T19:38:54.663666] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IQV took 40.8s. Estimated remaining: 2h 55m 21s. Rate: 7.1 symbols/min [2025-10-13T19:38:54.817945] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-13T19:38:54.837085] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:38:54.893885] [DEBUG] [LOCAL ] IRT: Loaded 51183 existing records from primary storage. [2025-10-13T19:38:54.894329] [INFO ] [MAIN ] IRT: Loaded 51183 existing records. [2025-10-13T19:38:55.081514] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:38:55.082112] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-13T19:38:55.082213] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-13T19:38:55.082696] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-13T19:38:55.082759] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-13T19:38:55.455953] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:38:55.617933] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-13T19:38:55.726277] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T19:38:56.417937] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-13T19:38:56.621780] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-13T19:38:56.701589] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-13T19:38:57.218021] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-13T19:38:58.017939] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-13T19:38:58.167507] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-13T19:38:58.779531] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-13T19:38:58.817962] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-13T19:38:59.536062] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:38:59.617965] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-13T19:39:00.366360] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-13T19:39:00.417949] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-13T19:39:00.480207] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-13T19:39:01.217974] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-13T19:39:02.018009] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-13T19:39:02.164542] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-13T19:39:02.171667] [INFO ] [REMOTE ] IR: Full fetch complete (76245 records). [2025-10-13T19:39:02.171902] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-13T19:39:02.623138] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-13T19:39:02.623244] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-13T19:39:02.624313] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-13T19:39:02.624378] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-13T19:39:02.626170] [DEBUG] [LOCAL ] IR: Trimmed 76245 records to 52765 (keeping 200 days of data) [2025-10-13T19:39:02.818006] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-13T19:39:02.884758] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-13T19:39:02.999525] [DEBUG] [LOCAL ] IR: Primary data saved (52765 records). [2025-10-13T19:39:02.999703] [INFO ] [MAIN ] IR: Full history saved. [2025-10-13T19:39:02.999800] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IR took 34.3s. Estimated remaining: 2h 55m 12s. Rate: 7.1 symbols/min [2025-10-13T19:39:03.166582] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:03.183735] [DEBUG] [LOCAL ] ISD: Loaded 16060 existing records from primary storage. [2025-10-13T19:39:03.184016] [INFO ] [MAIN ] ISD: Loaded 16060 existing records. [2025-10-13T19:39:03.361243] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:03.361820] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-13T19:39:03.361882] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-13T19:39:03.362160] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-13T19:39:03.362224] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-13T19:39:03.618561] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-13T19:39:03.753067] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:39:03.756810] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:03.884871] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-13T19:39:04.417900] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-13T19:39:05.217939] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-13T19:39:05.311288] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T19:39:05.872788] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-13T19:39:06.017990] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-13T19:39:06.352019] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T19:39:06.817947] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-13T19:39:07.617902] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-13T19:39:07.741392] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T19:39:07.781576] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T19:39:08.417891] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-13T19:39:08.730317] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T19:39:09.217924] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-13T19:39:09.425224] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T19:39:10.017977] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-13T19:39:10.266382] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T19:39:10.817961] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-13T19:39:11.617964] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-13T19:39:11.842254] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T19:39:11.847347] [INFO ] [REMOTE ] IRM: Full fetch complete (72210 records). [2025-10-13T19:39:11.847475] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-13T19:39:12.269670] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-13T19:39:12.270110] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-13T19:39:12.271872] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-13T19:39:12.273030] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-13T19:39:12.273279] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-13T19:39:12.292512] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T19:39:12.296702] [DEBUG] [LOCAL ] IRM: Trimmed 72210 records to 49203 (keeping 200 days of data) [2025-10-13T19:39:12.418146] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-13T19:39:12.616228] [DEBUG] [LOCAL ] IRM: Primary data saved (49203 records). [2025-10-13T19:39:12.616367] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-13T19:39:12.616448] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRM took 33.3s. Estimated remaining: 2h 55m 5s. Rate: 7.1 symbols/min [2025-10-13T19:39:12.783325] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:12.824200] [DEBUG] [LOCAL ] IT: Loaded 42823 existing records from primary storage. [2025-10-13T19:39:12.824486] [INFO ] [MAIN ] IT: Loaded 42823 existing records. [2025-10-13T19:39:12.998442] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:12.998668] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-13T19:39:12.998726] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-13T19:39:12.999126] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-13T19:39:12.999181] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-13T19:39:13.227841] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-13T19:39:13.380149] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:13.753247] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:39:13.757008] [INFO ] [REMOTE ] IRS: Full fetch complete (32538 records). [2025-10-13T19:39:13.757104] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-13T19:39:14.026954] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-13T19:39:14.168508] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-13T19:39:14.168621] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-13T19:39:14.169720] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-13T19:39:14.169800] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-13T19:39:14.171160] [DEBUG] [LOCAL ] IRS: Trimmed 32538 records to 22924 (keeping 200 days of data) [2025-10-13T19:39:14.315185] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T19:39:14.329341] [DEBUG] [LOCAL ] IRS: Primary data saved (22924 records). [2025-10-13T19:39:14.329498] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-13T19:39:14.329611] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IRS took 33.6s. Estimated remaining: 2h 54m 49s. Rate: 7.1 symbols/min [2025-10-13T19:39:14.500788] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:14.533637] [DEBUG] [LOCAL ] ITGR: Loaded 31647 existing records from primary storage. [2025-10-13T19:39:14.533978] [INFO ] [MAIN ] ITGR: Loaded 31647 existing records. [2025-10-13T19:39:14.717266] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:14.717601] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-13T19:39:14.717699] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-13T19:39:14.718196] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-13T19:39:14.718254] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-13T19:39:14.823088] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-13T19:39:15.091826] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:15.617952] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-13T19:39:15.786635] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:39:15.808279] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T19:39:16.417948] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-13T19:39:16.618675] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-13T19:39:17.217949] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-13T19:39:18.017963] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-13T19:39:18.112101] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T19:39:18.176975] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T19:39:18.817958] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-13T19:39:19.193085] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T19:39:19.618015] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-13T19:39:19.754110] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-13T19:39:20.417992] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-13T19:39:20.993115] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-13T19:39:21.217901] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-13T19:39:21.412110] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T19:39:22.017955] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-13T19:39:22.420925] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T19:39:22.818017] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-13T19:39:23.107334] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-13T19:39:23.618048] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-13T19:39:24.417940] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-13T19:39:24.455825] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:39:24.561499] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-13T19:39:25.218009] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-13T19:39:25.884594] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:39:26.017948] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-13T19:39:26.824231] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-13T19:39:26.829746] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T19:39:27.028167] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:39:27.030893] [INFO ] [REMOTE ] ISD: Full fetch complete (24010 records). [2025-10-13T19:39:27.030976] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-13T19:39:27.416555] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-13T19:39:27.417122] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-13T19:39:27.417983] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-13T19:39:27.418047] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-13T19:39:27.418889] [DEBUG] [LOCAL ] ISD: Trimmed 24010 records to 15901 (keeping 200 days of data) [2025-10-13T19:39:27.524238] [DEBUG] [LOCAL ] ISD: Primary data saved (15901 records). [2025-10-13T19:39:27.524443] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-13T19:39:27.524547] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. ISD took 24.5s. Estimated remaining: 2h 54m 46s. Rate: 7.1 symbols/min [2025-10-13T19:39:27.625882] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-13T19:39:27.707256] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:27.749234] [DEBUG] [LOCAL ] ITT: Loaded 33112 existing records from primary storage. [2025-10-13T19:39:27.749766] [INFO ] [MAIN ] ITT: Loaded 33112 existing records. [2025-10-13T19:39:27.931432] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:27.932032] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-13T19:39:27.932121] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-13T19:39:27.932669] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-13T19:39:27.932736] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-13T19:39:28.208805] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T19:39:28.334515] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:28.417999] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-13T19:39:29.217905] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-13T19:39:29.453834] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T19:39:29.750260] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-13T19:39:30.017979] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-13T19:39:30.801267] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T19:39:30.817885] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-13T19:39:31.626681] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-13T19:39:31.631792] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T19:39:32.351590] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T19:39:32.417899] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-13T19:39:33.137608] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-13T19:39:33.217890] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-13T19:39:33.958244] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T19:39:34.017882] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-13T19:39:34.568208] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-13T19:39:34.818026] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-13T19:39:35.373073] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T19:39:35.617906] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-13T19:39:36.017570] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T19:39:36.418005] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-13T19:39:37.217925] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-13T19:39:37.356844] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-13T19:39:37.680703] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-13T19:39:38.017961] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-13T19:39:38.817947] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-13T19:39:38.944272] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:39:39.228457] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T19:39:39.617994] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-13T19:39:40.245739] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-13T19:39:40.417894] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-13T19:39:40.796981] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T19:39:41.218020] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-13T19:39:41.767265] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-13T19:39:42.017945] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-13T19:39:42.822062] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-13T19:39:42.830669] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T19:39:43.318560] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-13T19:39:43.617989] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-13T19:39:43.874797] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-13T19:39:44.417990] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-13T19:39:45.217973] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-13T19:39:45.245494] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-13T19:39:45.250715] [INFO ] [REMOTE ] IT: Full fetch complete (56916 records). [2025-10-13T19:39:45.250852] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-13T19:39:45.637150] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-13T19:39:45.637227] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-13T19:39:45.638023] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-13T19:39:45.638098] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-13T19:39:45.641438] [DEBUG] [LOCAL ] IT: Trimmed 56916 records to 42159 (keeping 200 days of data) [2025-10-13T19:39:45.912992] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T19:39:45.937974] [DEBUG] [LOCAL ] IT: Primary data saved (42159 records). [2025-10-13T19:39:45.938113] [INFO ] [MAIN ] IT: Full history saved. [2025-10-13T19:39:45.938293] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. IT took 33.3s. Estimated remaining: 2h 54m 48s. Rate: 7.1 symbols/min [2025-10-13T19:39:46.027969] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-13T19:39:46.115566] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:46.166152] [DEBUG] [LOCAL ] ITUB: Loaded 54088 existing records from primary storage. [2025-10-13T19:39:46.166510] [INFO ] [MAIN ] ITUB: Loaded 54088 existing records. [2025-10-13T19:39:46.343485] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:46.343741] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-13T19:39:46.343793] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-13T19:39:46.344109] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-13T19:39:46.344164] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-13T19:39:46.707806] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:46.817893] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-13T19:39:46.868047] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T19:39:46.873604] [INFO ] [REMOTE ] IRT: Full fetch complete (72755 records). [2025-10-13T19:39:46.873739] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-13T19:39:47.308029] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-13T19:39:47.310398] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T19:39:47.310723] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-13T19:39:47.318750] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-13T19:39:47.319242] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-13T19:39:47.321408] [DEBUG] [LOCAL ] IRT: Trimmed 72755 records to 50560 (keeping 200 days of data) [2025-10-13T19:39:47.618116] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-13T19:39:47.640156] [DEBUG] [LOCAL ] IRT: Primary data saved (50560 records). [2025-10-13T19:39:47.640316] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-13T19:39:47.640425] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. IRT took 53.0s. Estimated remaining: 2h 54m 32s. Rate: 7.1 symbols/min [2025-10-13T19:39:47.804282] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:47.844914] [DEBUG] [LOCAL ] ITW: Loaded 46468 existing records from primary storage. [2025-10-13T19:39:47.845216] [INFO ] [MAIN ] ITW: Loaded 46468 existing records. [2025-10-13T19:39:48.019946] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:48.020177] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-13T19:39:48.020226] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-13T19:39:48.021376] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-13T19:39:48.021438] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-13T19:39:48.378062] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:48.417941] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-13T19:39:48.841345] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-13T19:39:48.917602] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:39:49.217970] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-13T19:39:49.609958] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-13T19:39:49.613584] [INFO ] [REMOTE ] ITGR: Full fetch complete (42472 records). [2025-10-13T19:39:49.613705] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-13T19:39:49.986898] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-13T19:39:49.986977] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-13T19:39:49.987607] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-13T19:39:49.987667] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-13T19:39:49.988588] [DEBUG] [LOCAL ] ITGR: Trimmed 42472 records to 31229 (keeping 200 days of data) [2025-10-13T19:39:50.038150] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-13T19:39:50.184917] [DEBUG] [LOCAL ] ITGR: Primary data saved (31229 records). [2025-10-13T19:39:50.185070] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-13T19:39:50.185207] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITGR took 35.9s. Estimated remaining: 2h 54m 17s. Rate: 7.1 symbols/min [2025-10-13T19:39:50.360209] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:39:50.404975] [DEBUG] [LOCAL ] IVR: Loaded 48793 existing records from primary storage. [2025-10-13T19:39:50.405404] [INFO ] [MAIN ] IVR: Loaded 48793 existing records. [2025-10-13T19:39:50.586903] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:39:50.587388] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-13T19:39:50.587468] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-13T19:39:50.606608] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-13T19:39:50.609870] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-13T19:39:50.643972] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T19:39:50.830275] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-13T19:39:50.977087] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:39:51.617958] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-13T19:39:51.821309] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T19:39:52.419404] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-13T19:39:52.425310] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:39:52.539842] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T19:39:53.217968] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-13T19:39:54.017974] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-13T19:39:54.194702] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T19:39:54.817977] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-13T19:39:54.989739] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-13T19:39:55.474742] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T19:39:55.617974] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-13T19:39:56.417939] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-13T19:39:56.516867] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-13T19:39:57.217937] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-13T19:39:57.320994] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T19:39:57.378616] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:39:58.017994] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-13T19:39:58.825780] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-13T19:39:58.842422] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:39:59.303323] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T19:39:59.617958] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-13T19:40:00.337718] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-13T19:40:00.417906] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-13T19:40:01.217934] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-13T19:40:01.529954] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T19:40:01.857886] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-13T19:40:01.863182] [INFO ] [REMOTE ] ITT: Full fetch complete (47043 records). [2025-10-13T19:40:01.863373] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-13T19:40:02.023079] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-13T19:40:02.290212] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-13T19:40:02.290290] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-13T19:40:02.290971] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-13T19:40:02.291039] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-13T19:40:02.291972] [DEBUG] [LOCAL ] ITT: Trimmed 47043 records to 32826 (keeping 200 days of data) [2025-10-13T19:40:02.498101] [DEBUG] [LOCAL ] ITT: Primary data saved (32826 records). [2025-10-13T19:40:02.498225] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-13T19:40:02.498317] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITT took 35.0s. Estimated remaining: 2h 54m 13s. Rate: 7.1 symbols/min [2025-10-13T19:40:02.665873] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:02.700130] [DEBUG] [LOCAL ] IVT: Loaded 31596 existing records from primary storage. [2025-10-13T19:40:02.700388] [INFO ] [MAIN ] IVT: Loaded 31596 existing records. [2025-10-13T19:40:02.823023] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-13T19:40:02.885341] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:02.885579] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-13T19:40:02.885635] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-13T19:40:02.886020] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-13T19:40:02.886075] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-13T19:40:03.224806] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:03.617935] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-13T19:40:04.232723] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-10-13T19:40:04.418028] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-13T19:40:04.726500] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T19:40:04.830469] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-13T19:40:05.217998] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-13T19:40:05.519195] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-13T19:40:05.907638] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:40:06.017991] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-13T19:40:06.690871] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-13T19:40:06.817959] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-13T19:40:07.617960] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-13T19:40:07.897079] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T19:40:08.417903] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-13T19:40:08.575839] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-13T19:40:09.217906] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-13T19:40:09.427419] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-13T19:40:09.779059] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T19:40:10.017958] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-13T19:40:10.746730] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T19:40:10.817896] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-13T19:40:11.618081] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-13T19:40:11.804132] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-13T19:40:11.877452] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-13T19:40:12.418032] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-13T19:40:13.217973] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-13T19:40:13.279048] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-13T19:40:14.017935] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-13T19:40:14.264619] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-13T19:40:14.659871] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:40:14.817957] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-13T19:40:15.185708] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T19:40:15.617961] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-13T19:40:16.417887] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-13T19:40:16.603249] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T19:40:17.217901] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-13T19:40:17.296989] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-13T19:40:17.302446] [INFO ] [REMOTE ] ITUB: Full fetch complete (77151 records). [2025-10-13T19:40:17.302591] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-13T19:40:17.715671] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-13T19:40:17.715776] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-13T19:40:17.716843] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-13T19:40:17.716907] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-13T19:40:17.718529] [DEBUG] [LOCAL ] ITUB: Trimmed 77151 records to 53318 (keeping 200 days of data) [2025-10-13T19:40:18.026701] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-13T19:40:18.055225] [DEBUG] [LOCAL ] ITUB: Primary data saved (53318 records). [2025-10-13T19:40:18.055377] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-13T19:40:18.055464] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. ITUB took 32.1s. Estimated remaining: 2h 54m 12s. Rate: 7.1 symbols/min [2025-10-13T19:40:18.234310] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:18.263169] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T19:40:18.329880] [DEBUG] [LOCAL ] IVZ: Loaded 53881 existing records from primary storage. [2025-10-13T19:40:18.330226] [INFO ] [MAIN ] IVZ: Loaded 53881 existing records. [2025-10-13T19:40:18.520935] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:18.521188] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-13T19:40:18.521257] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-13T19:40:18.521690] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-13T19:40:18.521747] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-13T19:40:18.829847] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-13T19:40:18.898407] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:18.963447] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T19:40:19.346536] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-13T19:40:19.617952] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-13T19:40:20.417898] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-13T19:40:20.455761] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T19:40:20.967611] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T19:40:21.217952] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-13T19:40:22.017971] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-13T19:40:22.080122] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-13T19:40:22.085321] [INFO ] [REMOTE ] IVR: Full fetch complete (69129 records). [2025-10-13T19:40:22.085445] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-13T19:40:22.477552] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-13T19:40:22.477662] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-13T19:40:22.478572] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-13T19:40:22.478636] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-13T19:40:22.480053] [DEBUG] [LOCAL ] IVR: Trimmed 69129 records to 48122 (keeping 200 days of data) [2025-10-13T19:40:22.787629] [DEBUG] [LOCAL ] IVR: Primary data saved (48122 records). [2025-10-13T19:40:22.788890] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-13T19:40:22.788341] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-13T19:40:22.789042] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IVR took 32.6s. Estimated remaining: 2h 53m 60s. Rate: 7.1 symbols/min [2025-10-13T19:40:22.830111] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-13T19:40:22.830244] [INFO ] [REMOTE ] ITW: Full fetch complete (66461 records). [2025-10-13T19:40:22.872560] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-13T19:40:23.097483] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:23.337166] [DEBUG] [LOCAL ] IX: Loaded 22586 existing records from primary storage. [2025-10-13T19:40:23.362580] [INFO ] [MAIN ] IX: Loaded 22586 existing records. [2025-10-13T19:40:23.515617] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-13T19:40:23.526127] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-13T19:40:23.536309] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-13T19:40:23.545828] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-13T19:40:23.643543] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:23.639327] [DEBUG] [LOCAL ] ITW: Trimmed 66461 records to 45832 (keeping 200 days of data) [2025-10-13T19:40:23.644254] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-13T19:40:23.644718] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-13T19:40:23.645225] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-13T19:40:23.645337] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-13T19:40:24.113372] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-13T19:40:24.164955] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-13T19:40:24.287760] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:24.318142] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-13T19:40:24.426416] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-13T19:40:24.503009] [DEBUG] [LOCAL ] ITW: Primary data saved (45832 records). [2025-10-13T19:40:24.503163] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-13T19:40:24.503250] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. ITW took 36.9s. Estimated remaining: 2h 53m 44s. Rate: 7.1 symbols/min [2025-10-13T19:40:24.675744] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:24.717562] [DEBUG] [LOCAL ] J: Loaded 40817 existing records from primary storage. [2025-10-13T19:40:24.717944] [INFO ] [MAIN ] J: Loaded 40817 existing records. [2025-10-13T19:40:24.898972] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:24.899190] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-13T19:40:24.899237] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-13T19:40:24.899495] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-13T19:40:24.899536] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-13T19:40:25.224480] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-13T19:40:25.267500] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:25.756187] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T19:40:25.808549] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-13T19:40:25.948874] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-13T19:40:26.017942] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-13T19:40:26.818018] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-13T19:40:27.432391] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-13T19:40:27.504130] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T19:40:27.617944] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-13T19:40:28.417928] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-13T19:40:28.826855] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-13T19:40:29.174810] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T19:40:29.217984] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-13T19:40:30.017901] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-13T19:40:30.489783] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T19:40:30.817986] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-13T19:40:31.617987] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-13T19:40:31.732746] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T19:40:31.889268] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T19:40:32.417970] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-13T19:40:32.831516] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-13T19:40:33.217936] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-13T19:40:33.669947] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T19:40:34.017970] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-13T19:40:34.732811] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T19:40:34.817987] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-13T19:40:35.252565] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-13T19:40:35.618088] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-13T19:40:36.327493] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T19:40:36.417959] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-13T19:40:36.871060] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T19:40:37.217978] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-13T19:40:37.932612] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:40:38.021489] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-13T19:40:38.234489] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-13T19:40:38.818008] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-13T19:40:39.344089] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T19:40:39.348202] [INFO ] [REMOTE ] IVT: Full fetch complete (45675 records). [2025-10-13T19:40:39.348336] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-13T19:40:39.623154] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-13T19:40:39.777156] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-13T19:40:39.777259] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-13T19:40:39.778577] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-13T19:40:39.778662] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-13T19:40:39.779965] [DEBUG] [LOCAL ] IVT: Trimmed 45675 records to 31261 (keeping 200 days of data) [2025-10-13T19:40:39.992448] [DEBUG] [LOCAL ] IVT: Primary data saved (31261 records). [2025-10-13T19:40:39.992708] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-13T19:40:39.992830] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IVT took 37.5s. Estimated remaining: 2h 53m 43s. Rate: 7.1 symbols/min [2025-10-13T19:40:40.186879] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:40.233825] [DEBUG] [LOCAL ] JBGS: Loaded 42765 existing records from primary storage. [2025-10-13T19:40:40.234264] [INFO ] [MAIN ] JBGS: Loaded 42765 existing records. [2025-10-13T19:40:40.424714] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-13T19:40:40.432008] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:40.433500] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-13T19:40:40.433557] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-13T19:40:40.434837] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-13T19:40:40.434907] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-13T19:40:40.818606] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:40.864721] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-13T19:40:41.217936] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-13T19:40:41.299524] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:40:41.606841] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T19:40:42.017984] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-13T19:40:42.817996] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-13T19:40:42.957260] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:40:42.994433] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T19:40:43.618006] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-13T19:40:44.055521] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T19:40:44.417996] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-13T19:40:45.218001] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-13T19:40:45.308952] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:40:45.378435] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-13T19:40:46.018009] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-13T19:40:46.725727] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-13T19:40:46.817892] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-13T19:40:47.618098] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-13T19:40:47.995837] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-13T19:40:48.248686] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:40:48.417974] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-13T19:40:48.868694] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-13T19:40:49.217976] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-13T19:40:49.736551] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T19:40:50.017963] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-13T19:40:50.601792] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-13T19:40:50.818008] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-13T19:40:51.462922] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-13T19:40:51.617948] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-13T19:40:52.417893] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-13T19:40:52.581633] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T19:40:52.783988] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-13T19:40:53.217960] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-13T19:40:53.946252] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-13T19:40:54.017897] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-13T19:40:54.463258] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T19:40:54.817949] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-13T19:40:55.567691] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T19:40:55.617879] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-13T19:40:55.884175] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:40:55.886812] [INFO ] [REMOTE ] IX: Full fetch complete (27958 records). [2025-10-13T19:40:55.886908] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-13T19:40:56.266759] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-13T19:40:56.266858] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-13T19:40:56.267514] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-13T19:40:56.267593] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-13T19:40:56.268851] [DEBUG] [LOCAL ] IX: Trimmed 27958 records to 22373 (keeping 200 days of data) [2025-10-13T19:40:56.405992] [DEBUG] [LOCAL ] IX: Primary data saved (22373 records). [2025-10-13T19:40:56.406121] [INFO ] [MAIN ] IX: Full history saved. [2025-10-13T19:40:56.406201] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. IX took 33.6s. Estimated remaining: 2h 53m 43s. Rate: 7.1 symbols/min [2025-10-13T19:40:56.428494] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-13T19:40:56.582214] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:56.622593] [DEBUG] [LOCAL ] JBI: Loaded 43912 existing records from primary storage. [2025-10-13T19:40:56.622910] [INFO ] [MAIN ] JBI: Loaded 43912 existing records. [2025-10-13T19:40:56.797275] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:40:56.797489] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-13T19:40:56.797544] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-13T19:40:56.798017] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-13T19:40:56.798080] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-13T19:40:57.144890] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:40:57.175845] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T19:40:57.217890] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-13T19:40:57.954017] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-13T19:40:58.017889] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-13T19:40:58.817899] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-13T19:40:58.865273] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T19:40:58.870730] [INFO ] [REMOTE ] IVZ: Full fetch complete (76813 records). [2025-10-13T19:40:58.870849] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-13T19:40:59.274311] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-13T19:40:59.274495] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-13T19:40:59.275872] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-13T19:40:59.276756] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-13T19:40:59.278703] [DEBUG] [LOCAL ] IVZ: Trimmed 76813 records to 53118 (keeping 200 days of data) [2025-10-13T19:40:59.535633] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T19:40:59.628742] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-13T19:40:59.652839] [DEBUG] [LOCAL ] IVZ: Primary data saved (53118 records). [2025-10-13T19:40:59.652928] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-13T19:40:59.653016] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. IVZ took 41.6s. Estimated remaining: 2h 53m 29s. Rate: 7.1 symbols/min [2025-10-13T19:40:59.819489] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:40:59.866173] [DEBUG] [LOCAL ] JBL: Loaded 49115 existing records from primary storage. [2025-10-13T19:40:59.866561] [INFO ] [MAIN ] JBL: Loaded 49115 existing records. [2025-10-13T19:41:00.043805] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:00.043981] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-13T19:41:00.044027] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-13T19:41:00.044444] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-13T19:41:00.044499] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-13T19:41:00.396010] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:00.418769] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-13T19:41:00.421343] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-13T19:41:01.115632] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T19:41:01.120437] [INFO ] [REMOTE ] J: Full fetch complete (59282 records). [2025-10-13T19:41:01.120575] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-13T19:41:01.223598] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-13T19:41:01.502575] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-13T19:41:01.502671] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-13T19:41:01.503502] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-13T19:41:01.503544] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-13T19:41:01.504760] [DEBUG] [LOCAL ] J: Trimmed 59282 records to 40285 (keeping 200 days of data) [2025-10-13T19:41:01.753589] [DEBUG] [LOCAL ] J: Primary data saved (40285 records). [2025-10-13T19:41:01.753737] [INFO ] [MAIN ] J: Full history saved. [2025-10-13T19:41:01.753822] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. J took 37.3s. Estimated remaining: 2h 53m 14s. Rate: 7.1 symbols/min [2025-10-13T19:41:01.921499] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:01.946031] [DEBUG] [LOCAL ] JBND: Loaded 26996 existing records from primary storage. [2025-10-13T19:41:01.946325] [INFO ] [MAIN ] JBND: Loaded 26996 existing records. [2025-10-13T19:41:02.020829] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-13T19:41:02.148175] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:02.150127] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:41:02.148954] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-13T19:41:02.158431] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-13T19:41:02.159285] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-13T19:41:02.159346] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-13T19:41:02.515870] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:02.672500] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T19:41:02.817984] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-13T19:41:03.617984] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-13T19:41:03.815747] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-13T19:41:03.871186] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-13T19:41:04.417944] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-13T19:41:04.970869] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-13T19:41:05.218004] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-13T19:41:06.017910] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-13T19:41:06.484509] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-13T19:41:06.713550] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-13T19:41:06.817898] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-13T19:41:06.957762] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-13T19:41:07.617953] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-13T19:41:08.241889] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T19:41:08.417903] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-13T19:41:08.473297] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-13T19:41:09.217950] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-13T19:41:09.928739] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T19:41:10.017885] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-13T19:41:10.734607] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T19:41:10.817892] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-13T19:41:11.617909] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-13T19:41:11.742316] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T19:41:12.249844] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:41:12.417934] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-13T19:41:12.770229] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T19:41:13.217956] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-13T19:41:13.830286] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T19:41:14.017947] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-13T19:41:14.744631] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-13T19:41:14.817891] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-13T19:41:15.617899] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-13T19:41:15.917470] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:41:16.295928] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-13T19:41:16.312721] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T19:41:16.317331] [INFO ] [REMOTE ] JBGS: Full fetch complete (59275 records). [2025-10-13T19:41:16.317470] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-13T19:41:16.423097] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-13T19:41:16.752438] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-13T19:41:16.752517] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-13T19:41:16.753328] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-13T19:41:16.753408] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-13T19:41:16.754559] [DEBUG] [LOCAL ] JBGS: Trimmed 59275 records to 42181 (keeping 200 days of data) [2025-10-13T19:41:17.013252] [DEBUG] [LOCAL ] JBGS: Primary data saved (42181 records). [2025-10-13T19:41:17.013397] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-13T19:41:17.013492] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBGS took 37.0s. Estimated remaining: 2h 53m 13s. Rate: 7.1 symbols/min [2025-10-13T19:41:17.180439] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:17.180626] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-13T19:41:17.180696] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-13T19:41:17.180810] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-13T19:41:17.180851] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-13T19:41:17.180893] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-13T19:41:17.180924] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-13T19:41:17.223201] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-13T19:41:17.530422] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:17.909786] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-13T19:41:18.017893] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-13T19:41:18.817905] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-13T19:41:18.922885] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-13T19:41:19.000084] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-13T19:41:19.617971] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-13T19:41:19.826605] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:41:19.826985] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-13T19:41:19.827076] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:41:19.827123] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-13T19:41:19.827157] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:41:19.827212] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-13T19:41:19.827268] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-13T19:41:19.827302] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-13T19:41:19.827340] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-13T19:41:19.827386] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBS took 2.8s. Estimated remaining: 2h 52m 58s. Rate: 7.1 symbols/min [2025-10-13T19:41:20.014798] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T19:41:20.079904] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:20.080198] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-13T19:41:20.080239] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-13T19:41:20.080373] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-13T19:41:20.080418] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-13T19:41:20.080461] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-13T19:41:20.080498] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-13T19:41:20.428111] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-13T19:41:20.472064] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:21.217941] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-13T19:41:21.422888] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:41:21.423215] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-13T19:41:21.423310] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:41:21.423386] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-13T19:41:21.423453] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:41:21.423525] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-13T19:41:21.423590] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-13T19:41:21.423626] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-13T19:41:21.423712] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-13T19:41:21.423770] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBTM took 1.6s. Estimated remaining: 2h 52m 43s. Rate: 7.1 symbols/min [2025-10-13T19:41:21.612559] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:21.621594] [DEBUG] [LOCAL ] JCE: Loaded 7358 existing records from primary storage. [2025-10-13T19:41:21.621827] [INFO ] [MAIN ] JCE: Loaded 7358 existing records. [2025-10-13T19:41:21.800487] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:21.800712] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-13T19:41:21.800768] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-13T19:41:21.800908] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-13T19:41:21.800947] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-13T19:41:22.023048] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-13T19:41:22.170880] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:22.263832] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T19:41:22.817974] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-13T19:41:23.099254] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-13T19:41:23.617949] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-13T19:41:24.417946] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-13T19:41:24.681978] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-13T19:41:24.733970] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T19:41:25.033543] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-13T19:41:25.217954] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-13T19:41:26.017947] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-13T19:41:26.624914] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:41:26.629210] [INFO ] [REMOTE ] JBI: Full fetch complete (63977 records). [2025-10-13T19:41:26.629318] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-13T19:41:26.708068] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-13T19:41:26.827028] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-13T19:41:27.042045] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-13T19:41:27.042132] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-13T19:41:27.042998] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-13T19:41:27.043061] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-13T19:41:27.044395] [DEBUG] [LOCAL ] JBI: Trimmed 63977 records to 43124 (keeping 200 days of data) [2025-10-13T19:41:27.292449] [DEBUG] [LOCAL ] JBI: Primary data saved (43124 records). [2025-10-13T19:41:27.292579] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-13T19:41:27.292678] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JBI took 30.9s. Estimated remaining: 2h 52m 31s. Rate: 7.1 symbols/min [2025-10-13T19:41:27.458250] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:27.514588] [DEBUG] [LOCAL ] JCI: Loaded 54312 existing records from primary storage. [2025-10-13T19:41:27.514984] [INFO ] [MAIN ] JCI: Loaded 54312 existing records. [2025-10-13T19:41:27.624768] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-13T19:41:27.743773] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:27.744142] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-13T19:41:27.744194] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-13T19:41:27.745366] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-13T19:41:27.745432] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-13T19:41:28.211030] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:28.233153] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-13T19:41:28.333824] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-13T19:41:28.418027] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-13T19:41:29.217949] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-13T19:41:29.805751] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-13T19:41:30.017943] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-13T19:41:30.090329] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T19:41:30.817946] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-13T19:41:31.525878] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-13T19:41:31.617943] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-13T19:41:31.751072] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-13T19:41:32.216608] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T19:41:32.417980] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-13T19:41:33.222034] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-13T19:41:34.017967] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-13T19:41:34.146254] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:41:34.817986] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-13T19:41:34.976685] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-13T19:41:35.346143] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-13T19:41:35.520703] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-13T19:41:35.617939] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-13T19:41:36.417949] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-13T19:41:36.898765] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-13T19:41:36.904884] [INFO ] [REMOTE ] JBND: Full fetch complete (35074 records). [2025-10-13T19:41:36.905078] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-13T19:41:37.105436] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T19:41:37.223024] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-13T19:41:37.312799] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-13T19:41:37.312876] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-13T19:41:37.313507] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-13T19:41:37.313567] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-13T19:41:37.314441] [DEBUG] [LOCAL ] JBND: Trimmed 35074 records to 26674 (keeping 200 days of data) [2025-10-13T19:41:37.480918] [DEBUG] [LOCAL ] JBND: Primary data saved (26674 records). [2025-10-13T19:41:37.481049] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-13T19:41:37.481168] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBND took 35.7s. Estimated remaining: 2h 52m 25s. Rate: 7.1 symbols/min [2025-10-13T19:41:37.648426] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:37.699901] [DEBUG] [LOCAL ] JEF: Loaded 50909 existing records from primary storage. [2025-10-13T19:41:37.700211] [INFO ] [MAIN ] JEF: Loaded 50909 existing records. [2025-10-13T19:41:37.887333] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:37.887725] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-13T19:41:37.887787] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-13T19:41:37.888798] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-13T19:41:37.888869] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-13T19:41:37.995143] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-13T19:41:38.024351] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-13T19:41:38.249996] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:38.817900] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-13T19:41:39.048473] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T19:41:39.617954] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-13T19:41:40.417907] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-13T19:41:40.554919] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-13T19:41:41.043451] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T19:41:41.045370] [INFO ] [REMOTE ] JCE: Full fetch complete (9765 records). [2025-10-13T19:41:41.045437] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-13T19:41:41.225959] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-13T19:41:41.430531] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-13T19:41:41.430626] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-13T19:41:41.431053] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-13T19:41:41.431112] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-13T19:41:41.431623] [DEBUG] [LOCAL ] JCE: Trimmed 9765 records to 7371 (keeping 200 days of data) [2025-10-13T19:41:41.491774] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-13T19:41:41.492863] [DEBUG] [LOCAL ] JCE: Primary data saved (7371 records). [2025-10-13T19:41:41.497872] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-13T19:41:41.498217] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JCE took 20.1s. Estimated remaining: 2h 52m 12s. Rate: 7.1 symbols/min [2025-10-13T19:41:41.519168] [INFO ] [REMOTE ] JBL: Full fetch complete (70357 records). [2025-10-13T19:41:41.541538] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-13T19:41:41.822204] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:42.023209] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-13T19:41:42.084739] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-13T19:41:42.084838] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-13T19:41:42.086825] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-13T19:41:42.086961] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-13T19:41:42.103704] [DEBUG] [LOCAL ] JELD: Loaded 46759 existing records from primary storage. [2025-10-13T19:41:42.104313] [INFO ] [MAIN ] JELD: Loaded 46759 existing records. [2025-10-13T19:41:42.104191] [DEBUG] [LOCAL ] JBL: Trimmed 70357 records to 48384 (keeping 200 days of data) [2025-10-13T19:41:42.388599] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:42.389408] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-13T19:41:42.389728] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-13T19:41:42.391432] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-13T19:41:42.391759] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-13T19:41:42.772312] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:42.841751] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-13T19:41:42.903299] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T19:41:43.000847] [DEBUG] [LOCAL ] JBL: Primary data saved (48384 records). [2025-10-13T19:41:43.000988] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-13T19:41:43.001074] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JBL took 43.3s. Estimated remaining: 2h 51m 56s. Rate: 7.1 symbols/min [2025-10-13T19:41:43.171783] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:41:43.201695] [DEBUG] [LOCAL ] JFR: Loaded 31454 existing records from primary storage. [2025-10-13T19:41:43.201988] [INFO ] [MAIN ] JFR: Loaded 31454 existing records. [2025-10-13T19:41:43.376758] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:41:43.377294] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-13T19:41:43.377385] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-13T19:41:43.378149] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-13T19:41:43.378207] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-13T19:41:43.620424] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-13T19:41:43.733137] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:41:43.863143] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T19:41:44.317399] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T19:41:44.418005] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-13T19:41:45.217987] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-13T19:41:45.451011] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T19:41:45.763526] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-13T19:41:46.018005] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-13T19:41:46.243609] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T19:41:46.817950] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-13T19:41:47.467928] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-13T19:41:47.617906] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-13T19:41:48.401110] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-13T19:41:48.417882] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-13T19:41:49.147568] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:41:49.217888] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-13T19:41:50.017954] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-13T19:41:50.631748] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-13T19:41:50.696982] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-13T19:41:50.817950] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-13T19:41:51.473097] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T19:41:51.617953] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-13T19:41:52.113752] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:41:52.417968] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-13T19:41:53.055365] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:41:53.217986] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-13T19:41:53.548901] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-13T19:41:54.018005] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-13T19:41:54.818063] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-13T19:41:55.084801] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-13T19:41:55.617996] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-13T19:41:55.716155] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-13T19:41:56.165904] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T19:41:56.417978] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-13T19:41:57.201401] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:41:57.217888] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-13T19:41:58.017970] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-13T19:41:58.097417] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:41:58.715712] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T19:41:58.817959] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-13T19:41:59.213252] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-13T19:41:59.617979] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-13T19:42:00.425450] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-13T19:42:00.432361] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:42:00.935511] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T19:42:01.217963] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-13T19:42:02.017948] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-13T19:42:02.217044] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-13T19:42:02.817900] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-13T19:42:03.000200] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T19:42:03.498631] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T19:42:03.617901] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-13T19:42:04.417978] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-13T19:42:04.457166] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T19:42:04.623758] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:42:04.627462] [INFO ] [REMOTE ] JFR: Full fetch complete (48241 records). [2025-10-13T19:42:04.627537] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-13T19:42:04.994080] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-13T19:42:04.994176] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-13T19:42:04.994947] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-13T19:42:04.995011] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-13T19:42:04.996173] [DEBUG] [LOCAL ] JFR: Trimmed 48241 records to 30972 (keeping 200 days of data) [2025-10-13T19:42:05.192770] [DEBUG] [LOCAL ] JFR: Primary data saved (30972 records). [2025-10-13T19:42:05.192935] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-13T19:42:05.193025] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JFR took 22.2s. Estimated remaining: 2h 52m 2s. Rate: 7.1 symbols/min [2025-10-13T19:42:05.223173] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-13T19:42:05.366406] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:05.378818] [DEBUG] [LOCAL ] JGH: Loaded 12013 existing records from primary storage. [2025-10-13T19:42:05.379027] [INFO ] [MAIN ] JGH: Loaded 12013 existing records. [2025-10-13T19:42:05.551723] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:05.551970] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-13T19:42:05.552016] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-13T19:42:05.552435] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-13T19:42:05.552494] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-13T19:42:05.905816] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:05.963083] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-13T19:42:06.017894] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-13T19:42:06.817954] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-13T19:42:06.977195] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-13T19:42:07.617929] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-13T19:42:07.648583] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-13T19:42:08.326020] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T19:42:08.372677] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-13T19:42:08.417937] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-13T19:42:09.218008] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-13T19:42:09.942770] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-13T19:42:10.017909] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-13T19:42:10.105852] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-13T19:42:10.644204] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T19:42:10.817946] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-13T19:42:11.595424] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-13T19:42:11.617885] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-13T19:42:12.417985] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-13T19:42:12.469453] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T19:42:13.218026] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-13T19:42:14.017939] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-13T19:42:14.326737] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-13T19:42:14.825423] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-13T19:42:14.830612] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:42:15.455323] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:42:15.531165] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T19:42:15.536743] [INFO ] [REMOTE ] JCI: Full fetch complete (77402 records). [2025-10-13T19:42:15.536859] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-13T19:42:15.623025] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-13T19:42:15.940588] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-13T19:42:15.940709] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-13T19:42:15.941709] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-13T19:42:15.941773] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-13T19:42:15.945143] [DEBUG] [LOCAL ] JCI: Trimmed 77402 records to 53533 (keeping 200 days of data) [2025-10-13T19:42:16.287991] [DEBUG] [LOCAL ] JCI: Primary data saved (53533 records). [2025-10-13T19:42:16.288533] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-13T19:42:16.288635] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JCI took 49.0s. Estimated remaining: 2h 51m 56s. Rate: 7.1 symbols/min [2025-10-13T19:42:16.424916] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-13T19:42:16.481179] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:16.522844] [DEBUG] [LOCAL ] JHG: Loaded 48298 existing records from primary storage. [2025-10-13T19:42:16.523196] [INFO ] [MAIN ] JHG: Loaded 48298 existing records. [2025-10-13T19:42:16.698965] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:16.699175] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-13T19:42:16.699221] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-13T19:42:16.700237] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-13T19:42:16.700295] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-13T19:42:17.043044] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:17.218058] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-13T19:42:17.246427] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T19:42:17.260669] [INFO ] [REMOTE ] JEF: Full fetch complete (73051 records). [2025-10-13T19:42:17.261607] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-13T19:42:17.261972] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:42:17.652740] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-13T19:42:17.652824] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-13T19:42:17.653783] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-13T19:42:17.653848] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-13T19:42:17.655440] [DEBUG] [LOCAL ] JEF: Trimmed 73051 records to 50183 (keeping 200 days of data) [2025-10-13T19:42:17.961686] [DEBUG] [LOCAL ] JEF: Primary data saved (50183 records). [2025-10-13T19:42:17.961827] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-13T19:42:17.961919] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JEF took 40.5s. Estimated remaining: 2h 51m 41s. Rate: 7.1 symbols/min [2025-10-13T19:42:18.023532] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-13T19:42:18.129254] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:18.134395] [DEBUG] [LOCAL ] JHI: Loaded 3929 existing records from primary storage. [2025-10-13T19:42:18.134547] [INFO ] [MAIN ] JHI: Loaded 3929 existing records. [2025-10-13T19:42:18.306803] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:18.307005] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-13T19:42:18.307051] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-13T19:42:18.307257] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-13T19:42:18.307313] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-13T19:42:18.658836] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:18.817945] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-13T19:42:18.871516] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-13T19:42:19.051331] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-13T19:42:19.617987] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-13T19:42:20.309426] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-13T19:42:20.417965] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-13T19:42:20.477484] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-13T19:42:20.836469] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-13T19:42:21.217949] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-13T19:42:22.018173] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-13T19:42:22.018038] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-13T19:42:22.581964] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T19:42:22.817976] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-13T19:42:23.618980] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-13T19:42:23.622919] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T19:42:24.107321] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-13T19:42:24.417959] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-13T19:42:25.217987] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-13T19:42:25.434872] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-13T19:42:25.437422] [INFO ] [REMOTE ] JGH: Full fetch complete (15567 records). [2025-10-13T19:42:25.437504] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-13T19:42:25.828871] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-13T19:42:25.828959] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-13T19:42:25.829315] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-13T19:42:25.829358] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-13T19:42:25.829925] [DEBUG] [LOCAL ] JGH: Trimmed 15567 records to 12022 (keeping 200 days of data) [2025-10-13T19:42:25.902217] [DEBUG] [LOCAL ] JGH: Primary data saved (12022 records). [2025-10-13T19:42:25.902353] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-13T19:42:25.902433] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JGH took 20.7s. Estimated remaining: 2h 51m 32s. Rate: 7.1 symbols/min [2025-10-13T19:42:26.023072] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-13T19:42:26.081732] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:26.087295] [DEBUG] [LOCAL ] JHS: Loaded 2954 existing records from primary storage. [2025-10-13T19:42:26.087880] [INFO ] [MAIN ] JHS: Loaded 2954 existing records. [2025-10-13T19:42:26.261823] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:26.262074] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-13T19:42:26.262123] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-13T19:42:26.262297] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-13T19:42:26.262354] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-13T19:42:26.616838] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:26.622892] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-13T19:42:26.681446] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T19:42:26.686544] [INFO ] [REMOTE ] JELD: Full fetch complete (64212 records). [2025-10-13T19:42:26.686794] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-13T19:42:26.823081] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-13T19:42:27.120358] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-13T19:42:27.120450] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-13T19:42:27.121548] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-13T19:42:27.121687] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-13T19:42:27.123191] [DEBUG] [LOCAL ] JELD: Trimmed 64212 records to 46105 (keeping 200 days of data) [2025-10-13T19:42:27.348326] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-13T19:42:27.420452] [DEBUG] [LOCAL ] JELD: Primary data saved (46105 records). [2025-10-13T19:42:27.420595] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-13T19:42:27.420777] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JELD took 45.9s. Estimated remaining: 2h 51m 16s. Rate: 7.1 symbols/min [2025-10-13T19:42:27.605059] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:27.617956] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-13T19:42:27.658140] [DEBUG] [LOCAL ] JHX: Loaded 53931 existing records from primary storage. [2025-10-13T19:42:27.658474] [INFO ] [MAIN ] JHX: Loaded 53931 existing records. [2025-10-13T19:42:27.828943] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:27.829152] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-13T19:42:27.829198] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-13T19:42:27.829698] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-13T19:42:27.829755] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-13T19:42:28.172870] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:28.417927] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-13T19:42:29.156511] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-13T19:42:29.217900] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-13T19:42:29.405256] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T19:42:30.017989] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-13T19:42:30.469224] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-13T19:42:30.576222] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-13T19:42:30.817976] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-13T19:42:31.618036] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-13T19:42:32.196884] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-13T19:42:32.418022] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-13T19:42:32.481364] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:42:33.063808] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-13T19:42:33.217982] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-13T19:42:33.783831] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T19:42:34.018021] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-13T19:42:34.817999] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-13T19:42:35.617943] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-13T19:42:35.783559] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T19:42:35.833119] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T19:42:36.078511] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-13T19:42:36.417986] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-13T19:42:37.206738] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-13T19:42:37.217900] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-13T19:42:38.018020] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-13T19:42:38.381448] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T19:42:38.547793] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-13T19:42:38.818000] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-13T19:42:39.618043] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-13T19:42:40.114865] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-13T19:42:40.418047] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-13T19:42:40.493748] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T19:42:40.961290] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-13T19:42:41.217950] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-13T19:42:42.017951] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-13T19:42:42.436430] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-13T19:42:42.614264] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T19:42:42.818025] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-13T19:42:43.618003] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-13T19:42:44.417971] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-13T19:42:44.499316] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-13T19:42:44.507737] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:42:44.970453] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T19:42:45.217987] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-13T19:42:45.683244] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T19:42:46.018053] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-13T19:42:46.630674] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-13T19:42:46.818038] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-13T19:42:47.409068] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-13T19:42:47.410356] [INFO ] [REMOTE ] JHS: Full fetch complete (4507 records). [2025-10-13T19:42:47.410431] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-13T19:42:47.619595] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-13T19:42:47.808604] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-13T19:42:47.808765] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-13T19:42:47.808962] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-13T19:42:47.809004] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-13T19:42:47.809453] [DEBUG] [LOCAL ] JHS: Trimmed 4507 records to 2944 (keeping 200 days of data) [2025-10-13T19:42:47.830306] [DEBUG] [LOCAL ] JHS: Primary data saved (2944 records). [2025-10-13T19:42:47.830501] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-13T19:42:47.830622] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHS took 21.9s. Estimated remaining: 2h 51m 20s. Rate: 7.1 symbols/min [2025-10-13T19:42:48.005320] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:48.026362] [DEBUG] [LOCAL ] JILL: Loaded 16471 existing records from primary storage. [2025-10-13T19:42:48.026728] [INFO ] [MAIN ] JILL: Loaded 16471 existing records. [2025-10-13T19:42:48.212975] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:48.213252] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-13T19:42:48.213332] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-13T19:42:48.213615] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-13T19:42:48.213703] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-13T19:42:48.423829] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-13T19:42:48.582761] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:42:49.218010] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-13T19:42:49.333699] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-13T19:42:49.810366] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T19:42:50.018020] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-13T19:42:50.352343] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-13T19:42:50.617069] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-13T19:42:50.817961] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-13T19:42:51.617958] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-13T19:42:52.192533] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-13T19:42:52.256177] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-13T19:42:52.417903] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-13T19:42:53.218016] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-13T19:42:53.946118] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T19:42:54.017940] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-13T19:42:54.083529] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-13T19:42:54.817946] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-13T19:42:55.593334] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-13T19:42:55.617883] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-13T19:42:55.654725] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T19:42:56.337382] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-13T19:42:56.417936] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-13T19:42:57.217899] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-13T19:42:57.477523] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-13T19:42:58.017954] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-13T19:42:58.387180] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:42:58.392238] [INFO ] [REMOTE ] JHG: Full fetch complete (68258 records). [2025-10-13T19:42:58.392367] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-13T19:42:58.781200] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-13T19:42:58.781331] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-13T19:42:58.782218] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-13T19:42:58.782281] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-13T19:42:58.783598] [DEBUG] [LOCAL ] JHG: Trimmed 68258 records to 47620 (keeping 200 days of data) [2025-10-13T19:42:58.837097] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-13T19:42:59.007217] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-13T19:42:59.092435] [DEBUG] [LOCAL ] JHG: Primary data saved (47620 records). [2025-10-13T19:42:59.092584] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-13T19:42:59.092694] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHG took 42.8s. Estimated remaining: 2h 51m 15s. Rate: 7.1 symbols/min [2025-10-13T19:42:59.259145] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:42:59.296307] [DEBUG] [LOCAL ] JKS: Loaded 40520 existing records from primary storage. [2025-10-13T19:42:59.296599] [INFO ] [MAIN ] JKS: Loaded 40520 existing records. [2025-10-13T19:42:59.475717] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:42:59.475980] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-13T19:42:59.476025] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-13T19:42:59.476679] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-13T19:42:59.476745] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-13T19:42:59.624025] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-13T19:42:59.829243] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:00.417962] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-13T19:43:00.665552] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-13T19:43:00.741844] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-13T19:43:01.218016] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-13T19:43:01.961382] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-13T19:43:01.962871] [INFO ] [REMOTE ] JHI: Full fetch complete (5557 records). [2025-10-13T19:43:01.962942] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-13T19:43:02.023181] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-13T19:43:02.320172] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-13T19:43:02.320346] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-13T19:43:02.320538] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-13T19:43:02.320860] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-13T19:43:02.321356] [DEBUG] [LOCAL ] JHI: Trimmed 5557 records to 3933 (keeping 200 days of data) [2025-10-13T19:43:02.365858] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-13T19:43:02.381542] [DEBUG] [LOCAL ] JHI: Primary data saved (3933 records). [2025-10-13T19:43:02.381623] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-13T19:43:02.381732] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JHI took 44.4s. Estimated remaining: 2h 51m 1s. Rate: 7.1 symbols/min [2025-10-13T19:43:02.805793] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-13T19:43:02.817973] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-13T19:43:03.617952] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-13T19:43:04.415733] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T19:43:04.424847] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-13T19:43:04.458889] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-13T19:43:05.217952] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-13T19:43:05.996163] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-13T19:43:06.017899] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-13T19:43:06.182314] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T19:43:06.713988] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T19:43:06.716082] [INFO ] [REMOTE ] JILL: Full fetch complete (22588 records). [2025-10-13T19:43:06.716180] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-13T19:43:06.823007] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-13T19:43:07.075862] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-13T19:43:07.075947] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-13T19:43:07.076503] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-13T19:43:07.076543] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-13T19:43:07.077153] [DEBUG] [LOCAL ] JILL: Trimmed 22588 records to 16095 (keeping 200 days of data) [2025-10-13T19:43:07.178335] [DEBUG] [LOCAL ] JILL: Primary data saved (16095 records). [2025-10-13T19:43:07.178475] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-13T19:43:07.178555] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JILL took 19.3s. Estimated remaining: 2h 50m 48s. Rate: 7.1 symbols/min [2025-10-13T19:43:07.617942] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-13T19:43:08.666524] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-13T19:43:08.679080] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-13T19:43:09.079340] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-13T19:43:09.217934] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-13T19:43:10.514354] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T19:43:10.520029] [INFO ] [REMOTE ] JHX: Full fetch complete (60615 records). [2025-10-13T19:43:10.520134] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-13T19:43:10.996350] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-13T19:43:10.996484] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-13T19:43:10.997532] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-13T19:43:10.997616] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-13T19:43:11.002266] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T19:43:11.012207] [DEBUG] [LOCAL ] JHX: Trimmed 60615 records to 53153 (keeping 200 days of data) [2025-10-13T19:43:11.012932] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-13T19:43:11.352797] [DEBUG] [LOCAL ] JHX: Primary data saved (53153 records). [2025-10-13T19:43:11.352934] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-13T19:43:11.353015] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JHX took 43.9s. Estimated remaining: 2h 50m 35s. Rate: 7.1 symbols/min [2025-10-13T19:43:12.892352] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T19:43:12.902511] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-13T19:43:14.338095] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T19:43:14.346121] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-13T19:43:15.785943] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-13T19:43:15.794105] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-13T19:43:17.252737] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T19:43:17.261496] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-13T19:43:18.649495] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T19:43:18.657097] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-13T19:43:20.081368] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:43:20.091830] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-13T19:43:21.414050] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-13T19:43:21.418930] [INFO ] [REMOTE ] JKS: Full fetch complete (58751 records). [2025-10-13T19:43:21.419106] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-13T19:43:21.801976] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-13T19:43:21.802074] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-13T19:43:21.802965] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-13T19:43:21.803029] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-13T19:43:21.804281] [DEBUG] [LOCAL ] JKS: Trimmed 58751 records to 39731 (keeping 200 days of data) [2025-10-13T19:43:22.042181] [DEBUG] [LOCAL ] JKS: Primary data saved (39731 records). [2025-10-13T19:43:22.042318] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-13T19:43:22.042406] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JKS took 22.9s. Estimated remaining: 2h 50m 29s. Rate: 7.1 symbols/min [2025-10-13T19:43:22.760440] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:22.739957] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:22.762010] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:22.769802] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-13T19:43:22.786549] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-13T19:43:22.787666] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-13T19:43:22.789239] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:22.790438] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-13T19:43:22.791150] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-13T19:43:22.791277] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-13T19:43:22.834850] [DEBUG] [LOCAL ] JLS: Loaded 4203 existing records from primary storage. [2025-10-13T19:43:22.858380] [INFO ] [MAIN ] JLS: Loaded 4203 existing records. [2025-10-13T19:43:23.147835] [DEBUG] [LOCAL ] JLL: Loaded 31853 existing records from primary storage. [2025-10-13T19:43:23.240841] [INFO ] [MAIN ] JLL: Loaded 31853 existing records. [2025-10-13T19:43:23.318951] [DEBUG] [LOCAL ] JMIA: Loaded 51623 existing records from primary storage. [2025-10-13T19:43:23.349721] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:23.360165] [INFO ] [MAIN ] JMIA: Loaded 51623 existing records. [2025-10-13T19:43:23.369708] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-13T19:43:23.388367] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-13T19:43:23.490713] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-13T19:43:23.552056] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:23.524995] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-13T19:43:23.557561] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-13T19:43:23.919075] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:23.952849] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-13T19:43:23.963929] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:23.964278] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-13T19:43:23.964546] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-13T19:43:23.972053] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-13T19:43:23.972162] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-13T19:43:24.004079] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-13T19:43:24.050559] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-13T19:43:24.050726] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-13T19:43:24.102057] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-13T19:43:24.103666] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-13T19:43:24.384304] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:24.409140] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-13T19:43:24.588317] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-13T19:43:24.649138] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-13T19:43:24.843301] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:24.854117] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-13T19:43:24.917897] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:24.918312] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-13T19:43:24.992845] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-13T19:43:24.994307] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-13T19:43:25.220811] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-13T19:43:25.221919] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-13T19:43:25.515830] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T19:43:25.517944] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-13T19:43:25.571559] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-13T19:43:25.572498] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-13T19:43:25.934994] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T19:43:25.940698] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-13T19:43:26.023282] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-13T19:43:26.024779] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-13T19:43:26.065557] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T19:43:26.067224] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-13T19:43:26.416118] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-13T19:43:26.417612] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-13T19:43:26.678259] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T19:43:26.800366] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T19:43:26.817893] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-13T19:43:26.929700] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-13T19:43:27.257565] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-13T19:43:27.617943] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-13T19:43:28.417908] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-13T19:43:28.648526] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T19:43:28.718851] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-13T19:43:28.962498] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T19:43:29.217906] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-13T19:43:29.644567] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-13T19:43:30.017979] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-13T19:43:30.469375] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T19:43:30.817909] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-13T19:43:31.435685] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-13T19:43:31.617969] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-13T19:43:32.417989] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-13T19:43:32.993371] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T19:43:33.013882] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-13T19:43:33.217978] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-13T19:43:34.017980] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-13T19:43:34.628909] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-13T19:43:34.650262] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-13T19:43:34.817942] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-13T19:43:35.387307] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-13T19:43:35.617904] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-13T19:43:36.417968] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-13T19:43:36.887228] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-13T19:43:36.888019] [INFO ] [REMOTE ] JMM: Full fetch complete (2303 records). [2025-10-13T19:43:36.888088] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-13T19:43:37.078121] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-13T19:43:37.078496] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:43:37.078712] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:43:37.078796] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-13T19:43:37.085879] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-13T19:43:37.096810] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-13T19:43:37.096971] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-13T19:43:37.097101] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JMM took 15.0s. Estimated remaining: 2h 50m 28s. Rate: 7.1 symbols/min [2025-10-13T19:43:37.133872] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T19:43:37.222991] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-13T19:43:37.284157] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:37.338044] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-10-13T19:43:37.338436] [INFO ] [MAIN ] JNJ: Loaded 54533 existing records. [2025-10-13T19:43:37.523043] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:37.523259] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-13T19:43:37.523305] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-13T19:43:37.524436] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-13T19:43:37.524494] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-13T19:43:37.880735] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:38.017965] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-13T19:43:38.637397] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T19:43:38.697386] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-13T19:43:38.817941] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-13T19:43:39.392939] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T19:43:39.617904] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-13T19:43:40.417987] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-13T19:43:41.069156] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-13T19:43:41.070320] [INFO ] [REMOTE ] JLS: Full fetch complete (5841 records). [2025-10-13T19:43:41.070392] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-13T19:43:41.223213] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-13T19:43:41.471549] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-13T19:43:41.471820] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-13T19:43:41.472014] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-13T19:43:41.472092] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-13T19:43:41.472775] [DEBUG] [LOCAL ] JLS: Trimmed 5841 records to 4178 (keeping 200 days of data) [2025-10-13T19:43:41.520430] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-13T19:43:41.525451] [DEBUG] [LOCAL ] JLS: Primary data saved (4178 records). [2025-10-13T19:43:41.534942] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-13T19:43:41.535076] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JLS took 19.5s. Estimated remaining: 2h 50m 15s. Rate: 7.1 symbols/min [2025-10-13T19:43:41.711829] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:41.769359] [DEBUG] [LOCAL ] JOBY: Loaded 54581 existing records from primary storage. [2025-10-13T19:43:41.769838] [INFO ] [MAIN ] JOBY: Loaded 54581 existing records. [2025-10-13T19:43:41.960567] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:41.960924] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-13T19:43:41.960986] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-13T19:43:41.961921] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-13T19:43:41.961989] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-13T19:43:42.026758] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-13T19:43:42.330992] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:42.402375] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T19:43:42.817948] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-13T19:43:43.617992] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-13T19:43:43.717809] [DEBUG] [REMOTE ] JMIA: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-13T19:43:43.718156] [WARN ] [REMOTE ] JMIA: No data returned for month 2025-03 [2025-10-13T19:43:43.718249] [FATAL] [REMOTE ] JMIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:43:43.718329] [FATAL] [MAIN ] JMIA: Failed to fetch primary data. [2025-10-13T19:43:43.718367] [WARN ] [MAIN ] JMIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:43:43.718441] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-13T19:43:43.718516] [DEBUG] [LOCAL ] JMIA: No primary data file found to delete. [2025-10-13T19:43:43.718556] [INFO ] [LOCAL ] JMIA: Starting deletion of derivative data. [2025-10-13T19:43:43.718833] [DEBUG] [LOCAL ] JMIA: Deleted derivative data file. [2025-10-13T19:43:43.718968] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JMIA took 21.7s. Estimated remaining: 2h 50m 0s. Rate: 7.1 symbols/min [2025-10-13T19:43:43.925284] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:43.950468] [DEBUG] [LOCAL ] JOE: Loaded 24247 existing records from primary storage. [2025-10-13T19:43:43.950838] [INFO ] [MAIN ] JOE: Loaded 24247 existing records. [2025-10-13T19:43:44.141247] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:44.141726] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-13T19:43:44.141791] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-13T19:43:44.142810] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-13T19:43:44.142893] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-13T19:43:44.421225] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-13T19:43:44.539768] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:44.573269] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-13T19:43:45.217904] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-13T19:43:45.337139] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-13T19:43:45.983497] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T19:43:46.017881] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-13T19:43:46.817972] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-13T19:43:47.279249] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-13T19:43:47.452300] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-13T19:43:47.617940] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-13T19:43:48.417944] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-13T19:43:48.959345] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:43:48.962522] [INFO ] [REMOTE ] JLL: Full fetch complete (44751 records). [2025-10-13T19:43:48.962663] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-13T19:43:49.227484] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-13T19:43:49.377911] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-13T19:43:49.378066] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-13T19:43:49.379492] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-13T19:43:49.379580] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-13T19:43:49.381923] [DEBUG] [LOCAL ] JLL: Trimmed 44751 records to 31667 (keeping 200 days of data) [2025-10-13T19:43:49.503965] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-13T19:43:49.628096] [DEBUG] [LOCAL ] JLL: Primary data saved (31667 records). [2025-10-13T19:43:49.628283] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-13T19:43:49.628456] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JLL took 27.5s. Estimated remaining: 2h 49m 49s. Rate: 7.1 symbols/min [2025-10-13T19:43:49.792599] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:43:49.800384] [DEBUG] [LOCAL ] JOF: Loaded 6991 existing records from primary storage. [2025-10-13T19:43:49.800555] [INFO ] [MAIN ] JOF: Loaded 6991 existing records. [2025-10-13T19:43:49.972511] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:43:49.972708] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-13T19:43:49.972763] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-13T19:43:49.973094] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-13T19:43:49.973151] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-13T19:43:50.027722] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-13T19:43:50.348841] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:43:50.479262] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-13T19:43:50.515064] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T19:43:50.818008] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-13T19:43:51.617931] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-13T19:43:52.002801] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-13T19:43:52.212291] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-13T19:43:52.417981] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-13T19:43:52.465546] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-13T19:43:53.217982] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-13T19:43:53.559905] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-13T19:43:54.017985] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-13T19:43:54.817961] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-13T19:43:55.275991] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-13T19:43:55.391689] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T19:43:55.617910] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-13T19:43:55.691952] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-13T19:43:56.417972] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-13T19:43:57.217903] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-13T19:43:57.767037] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-13T19:43:58.017944] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-13T19:43:58.548283] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-13T19:43:58.817900] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-13T19:43:58.920613] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-13T19:43:59.617891] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-13T19:43:59.955805] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T19:44:00.372127] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-13T19:44:00.417894] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-13T19:44:01.217945] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-13T19:44:02.017987] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-13T19:44:02.034048] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-13T19:44:02.439549] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-10-13T19:44:02.650261] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-13T19:44:02.819337] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-13T19:44:02.819486] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-13T19:44:03.617963] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-13T19:44:04.322959] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-13T19:44:04.417972] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-13T19:44:05.217983] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-13T19:44:05.302173] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-13T19:44:05.550361] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T19:44:05.663434] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-13T19:44:06.017996] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-13T19:44:06.625601] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T19:44:06.817900] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-13T19:44:07.397200] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-13T19:44:07.617879] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-13T19:44:08.292905] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-13T19:44:08.417942] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-13T19:44:09.217906] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-13T19:44:09.483874] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-13T19:44:10.017992] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-13T19:44:10.817914] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-13T19:44:10.982073] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-13T19:44:11.246729] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-13T19:44:11.329410] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-13T19:44:11.617994] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-13T19:44:12.388396] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-13T19:44:12.417952] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-13T19:44:13.075988] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-13T19:44:13.077318] [INFO ] [REMOTE ] JOF: Full fetch complete (9546 records). [2025-10-13T19:44:13.077387] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-13T19:44:13.223115] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-13T19:44:13.496986] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-13T19:44:13.497064] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-13T19:44:13.497297] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-13T19:44:13.497385] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-13T19:44:13.497853] [DEBUG] [LOCAL ] JOF: Trimmed 9546 records to 6875 (keeping 200 days of data) [2025-10-13T19:44:13.539595] [DEBUG] [LOCAL ] JOF: Primary data saved (6875 records). [2025-10-13T19:44:13.539749] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-13T19:44:13.539855] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOF took 23.9s. Estimated remaining: 2h 49m 57s. Rate: 7.1 symbols/min [2025-10-13T19:44:13.704392] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:13.737780] [DEBUG] [LOCAL ] JPC: Loaded 37827 existing records from primary storage. [2025-10-13T19:44:13.738133] [INFO ] [MAIN ] JPC: Loaded 37827 existing records. [2025-10-13T19:44:13.913923] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:13.914134] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-13T19:44:13.914179] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-13T19:44:13.914904] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-13T19:44:13.914961] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-13T19:44:14.023064] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-13T19:44:14.265431] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:14.362098] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-13T19:44:14.364848] [INFO ] [REMOTE ] JOE: Full fetch complete (35648 records). [2025-10-13T19:44:14.364927] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-13T19:44:14.724975] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-13T19:44:14.725057] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-13T19:44:14.725695] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-13T19:44:14.725758] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-13T19:44:14.726593] [DEBUG] [LOCAL ] JOE: Trimmed 35648 records to 23909 (keeping 200 days of data) [2025-10-13T19:44:14.818013] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-13T19:44:14.876394] [DEBUG] [LOCAL ] JOE: Primary data saved (23909 records). [2025-10-13T19:44:14.876526] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-13T19:44:14.876616] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOE took 31.2s. Estimated remaining: 2h 49m 41s. Rate: 7.1 symbols/min [2025-10-13T19:44:15.064754] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:15.121046] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-10-13T19:44:15.121456] [INFO ] [MAIN ] JPM: Loaded 54574 existing records. [2025-10-13T19:44:15.310676] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:15.310910] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-13T19:44:15.310958] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-13T19:44:15.312006] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-13T19:44:15.312064] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-13T19:44:15.630946] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-13T19:44:15.672335] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:16.287145] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-13T19:44:16.417909] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-13T19:44:16.833246] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-10-13T19:44:17.218001] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-13T19:44:17.913498] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-13T19:44:18.018812] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-13T19:44:18.021447] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-13T19:44:18.817906] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-13T19:44:19.617906] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-13T19:44:19.734260] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-13T19:44:20.322250] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-13T19:44:20.417947] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-13T19:44:20.763097] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-13T19:44:21.217974] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-13T19:44:21.876732] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T19:44:22.003630] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-13T19:44:22.017888] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-13T19:44:22.817950] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-13T19:44:23.377266] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-13T19:44:23.617946] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-13T19:44:24.339236] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-13T19:44:24.418002] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-13T19:44:25.140056] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T19:44:25.218006] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-13T19:44:25.392381] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-13T19:44:26.018001] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-13T19:44:26.674128] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-13T19:44:26.680338] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-13T19:44:26.680497] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-13T19:44:26.823085] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-13T19:44:27.120770] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-13T19:44:27.121345] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-13T19:44:27.122335] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-13T19:44:27.123301] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-13T19:44:27.131042] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-13T19:44:27.134332] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-10-13T19:44:27.392945] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-13T19:44:27.517017] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-13T19:44:27.517169] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-13T19:44:27.517254] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JNJ took 50.4s. Estimated remaining: 2h 49m 37s. Rate: 7.1 symbols/min [2025-10-13T19:44:27.622991] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-13T19:44:27.686971] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:27.719182] [DEBUG] [LOCAL ] JQC: Loaded 34731 existing records from primary storage. [2025-10-13T19:44:27.719487] [INFO ] [MAIN ] JQC: Loaded 34731 existing records. [2025-10-13T19:44:27.906519] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:27.906729] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-13T19:44:27.906784] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-13T19:44:27.907537] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-13T19:44:27.907596] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-13T19:44:28.267058] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:28.417963] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-13T19:44:29.134481] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T19:44:29.209863] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-13T19:44:29.217878] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-13T19:44:29.565377] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-13T19:44:29.570739] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-13T19:44:29.570844] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-13T19:44:29.955196] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-13T19:44:29.955284] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-13T19:44:29.956224] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-13T19:44:29.956287] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-13T19:44:29.958717] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53803 (keeping 200 days of data) [2025-10-13T19:44:30.042237] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-13T19:44:30.285779] [DEBUG] [LOCAL ] JOBY: Primary data saved (53803 records). [2025-10-13T19:44:30.285910] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-13T19:44:30.286025] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JOBY took 48.8s. Estimated remaining: 2h 49m 22s. Rate: 7.1 symbols/min [2025-10-13T19:44:30.458041] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:30.473598] [DEBUG] [LOCAL ] JRI: Loaded 15506 existing records from primary storage. [2025-10-13T19:44:30.473875] [INFO ] [MAIN ] JRI: Loaded 15506 existing records. [2025-10-13T19:44:30.654791] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:30.661829] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-13T19:44:30.673928] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-13T19:44:30.675220] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-13T19:44:30.675263] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-13T19:44:30.675411] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-13T19:44:30.825614] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-13T19:44:31.051225] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:31.351873] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T19:44:31.617960] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-13T19:44:32.253056] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-13T19:44:32.418060] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-13T19:44:32.809892] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-13T19:44:33.217980] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-13T19:44:33.784142] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-13T19:44:34.017943] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-13T19:44:34.292902] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-13T19:44:34.818022] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-13T19:44:35.534774] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T19:44:35.617942] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-13T19:44:36.208772] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-13T19:44:36.417957] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-13T19:44:36.654142] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T19:44:37.218010] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-13T19:44:37.666191] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-13T19:44:38.018002] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-13T19:44:38.623271] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T19:44:38.817975] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-13T19:44:39.178692] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-13T19:44:39.617983] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-13T19:44:39.807266] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-13T19:44:40.417987] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-13T19:44:40.796772] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-13T19:44:41.218016] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-13T19:44:41.549818] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T19:44:41.553911] [INFO ] [REMOTE ] JPC: Full fetch complete (55296 records). [2025-10-13T19:44:41.554006] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-13T19:44:41.947873] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-13T19:44:41.947967] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-13T19:44:41.948753] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-13T19:44:41.948813] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-13T19:44:41.950023] [DEBUG] [LOCAL ] JPC: Trimmed 55296 records to 37227 (keeping 200 days of data) [2025-10-13T19:44:42.034438] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-13T19:44:42.172071] [DEBUG] [LOCAL ] JPC: Primary data saved (37227 records). [2025-10-13T19:44:42.172335] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-13T19:44:42.172439] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JPC took 28.6s. Estimated remaining: 2h 49m 18s. Rate: 7.1 symbols/min [2025-10-13T19:44:42.342488] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:42.353962] [DEBUG] [LOCAL ] JRS: Loaded 11760 existing records from primary storage. [2025-10-13T19:44:42.354214] [INFO ] [MAIN ] JRS: Loaded 11760 existing records. [2025-10-13T19:44:42.536021] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:42.536319] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-13T19:44:42.536396] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-13T19:44:42.536791] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-13T19:44:42.536855] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-13T19:44:42.744208] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-13T19:44:42.823250] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-13T19:44:42.943122] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:43.068503] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T19:44:43.617978] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-13T19:44:44.260893] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:44:44.417984] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-13T19:44:44.542954] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-13T19:44:45.218010] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-13T19:44:45.490053] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-13T19:44:45.494207] [INFO ] [REMOTE ] JQC: Full fetch complete (49552 records). [2025-10-13T19:44:45.494295] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-13T19:44:45.914168] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-13T19:44:45.914303] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-13T19:44:45.915543] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-13T19:44:45.915629] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-13T19:44:45.917403] [DEBUG] [LOCAL ] JQC: Trimmed 49552 records to 33961 (keeping 200 days of data) [2025-10-13T19:44:46.024363] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-13T19:44:46.147783] [DEBUG] [LOCAL ] JQC: Primary data saved (33961 records). [2025-10-13T19:44:46.148006] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-13T19:44:46.148118] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JQC took 18.6s. Estimated remaining: 2h 49m 5s. Rate: 7.1 symbols/min [2025-10-13T19:44:46.264262] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T19:44:46.343057] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:46.386759] [DEBUG] [LOCAL ] JXN: Loaded 45676 existing records from primary storage. [2025-10-13T19:44:46.387175] [INFO ] [MAIN ] JXN: Loaded 45676 existing records. [2025-10-13T19:44:46.569291] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:46.569685] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-13T19:44:46.569860] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-13T19:44:46.571008] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-13T19:44:46.571072] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-13T19:44:46.696825] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T19:44:46.823059] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-13T19:44:46.963736] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:44:47.617942] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-13T19:44:47.853320] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T19:44:48.418037] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-13T19:44:49.174430] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T19:44:49.217990] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-13T19:44:50.017950] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-13T19:44:50.093749] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-13T19:44:50.391809] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-13T19:44:50.817955] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-13T19:44:50.840222] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-13T19:44:51.579412] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-13T19:44:51.617885] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-13T19:44:52.403008] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-13T19:44:52.417879] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-13T19:44:53.187797] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-13T19:44:53.217893] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-13T19:44:54.017944] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-13T19:44:54.083398] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-13T19:44:54.817982] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-13T19:44:55.596861] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-13T19:44:55.617912] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-13T19:44:56.417957] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-13T19:44:56.599118] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-13T19:44:56.604349] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-13T19:44:57.221323] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-13T19:44:57.217893] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-13T19:44:57.985915] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-13T19:44:58.018025] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-13T19:44:58.817944] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-13T19:44:58.947385] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T19:44:58.950355] [INFO ] [REMOTE ] JRI: Full fetch complete (23296 records). [2025-10-13T19:44:58.950437] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-13T19:44:59.344828] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-13T19:44:59.344914] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-13T19:44:59.345567] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-13T19:44:59.345610] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-13T19:44:59.346570] [DEBUG] [LOCAL ] JRI: Trimmed 23296 records to 15394 (keeping 200 days of data) [2025-10-13T19:44:59.454141] [DEBUG] [LOCAL ] JRI: Primary data saved (15394 records). [2025-10-13T19:44:59.454541] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-13T19:44:59.454734] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JRI took 29.2s. Estimated remaining: 2h 49m 1s. Rate: 7.1 symbols/min [2025-10-13T19:44:59.621629] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-13T19:44:59.644739] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:44:59.699365] [DEBUG] [LOCAL ] K: Loaded 50837 existing records from primary storage. [2025-10-13T19:44:59.699939] [INFO ] [MAIN ] K: Loaded 50837 existing records. [2025-10-13T19:44:59.911470] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:44:59.913216] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-13T19:44:59.913019] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T19:44:59.913452] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-13T19:44:59.918253] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-13T19:44:59.918344] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-13T19:45:00.303137] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:00.417979] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-13T19:45:01.218032] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-13T19:45:02.018006] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-13T19:45:02.091615] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-13T19:45:02.152902] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-13T19:45:02.155381] [INFO ] [REMOTE ] JRS: Full fetch complete (16367 records). [2025-10-13T19:45:02.155477] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-13T19:45:02.556562] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-13T19:45:02.595687] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-13T19:45:02.596188] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-13T19:45:02.597209] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-13T19:45:02.597277] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-13T19:45:02.598337] [DEBUG] [LOCAL ] JRS: Trimmed 16367 records to 11663 (keeping 200 days of data) [2025-10-13T19:45:02.675613] [DEBUG] [LOCAL ] JRS: Primary data saved (11663 records). [2025-10-13T19:45:02.675842] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-13T19:45:02.675956] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRS took 20.5s. Estimated remaining: 2h 48m 47s. Rate: 7.1 symbols/min [2025-10-13T19:45:02.824968] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-13T19:45:02.862805] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:02.879403] [DEBUG] [LOCAL ] KAI: Loaded 13601 existing records from primary storage. [2025-10-13T19:45:02.879761] [INFO ] [MAIN ] KAI: Loaded 13601 existing records. [2025-10-13T19:45:03.074155] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:03.074612] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-13T19:45:03.074709] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-13T19:45:03.075255] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-13T19:45:03.075317] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-13T19:45:03.468935] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:03.617957] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-13T19:45:03.881022] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T19:45:04.363293] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T19:45:04.417948] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-13T19:45:05.217983] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-13T19:45:06.018060] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-13T19:45:06.086251] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-13T19:45:06.254867] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-13T19:45:06.817963] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-13T19:45:06.838699] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-13T19:45:06.876678] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T19:45:07.617949] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-13T19:45:08.418004] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-13T19:45:08.998424] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-13T19:45:09.217914] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-13T19:45:09.285179] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-13T19:45:09.709904] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-13T19:45:10.017914] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-13T19:45:10.238807] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T19:45:10.817946] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-13T19:45:11.490673] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-13T19:45:11.617953] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-13T19:45:11.972973] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-13T19:45:12.418437] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-13T19:45:12.419998] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T19:45:13.217952] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-13T19:45:14.017909] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-13T19:45:14.176782] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-13T19:45:14.802329] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:45:14.817885] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-13T19:45:15.617953] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-13T19:45:16.423813] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-13T19:45:16.429892] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-13T19:45:16.543732] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-13T19:45:17.217986] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-13T19:45:17.361283] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:45:17.431454] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T19:45:18.018071] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-13T19:45:18.818039] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-13T19:45:19.567858] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-13T19:45:19.574107] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-13T19:45:19.574325] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-13T19:45:19.622994] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-13T19:45:19.927983] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T19:45:19.945077] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-13T19:45:20.048760] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-13T19:45:20.048890] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-13T19:45:20.050151] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-13T19:45:20.050221] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-13T19:45:20.052081] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-10-13T19:45:20.418709] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-13T19:45:20.438218] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-13T19:45:20.438574] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-13T19:45:20.438740] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JPM took 1m 6s. Estimated remaining: 2h 48m 48s. Rate: 7.1 symbols/min [2025-10-13T19:45:20.617215] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:20.664185] [DEBUG] [LOCAL ] KAR: Loaded 40626 existing records from primary storage. [2025-10-13T19:45:20.664696] [INFO ] [MAIN ] KAR: Loaded 40626 existing records. [2025-10-13T19:45:20.857482] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:20.857860] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-13T19:45:20.857913] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-13T19:45:20.858718] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-13T19:45:20.858778] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-13T19:45:21.226150] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-13T19:45:21.251608] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:21.449742] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T19:45:21.496959] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-13T19:45:22.017961] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-13T19:45:22.651323] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-13T19:45:22.817957] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-13T19:45:23.617913] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-13T19:45:23.647474] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-13T19:45:23.711303] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:45:24.417946] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-13T19:45:25.035784] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-13T19:45:25.217981] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-13T19:45:26.017944] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-13T19:45:26.203541] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-13T19:45:26.227375] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-13T19:45:26.817953] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-13T19:45:27.589679] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-13T19:45:27.617886] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-13T19:45:28.330814] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T19:45:28.417969] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-13T19:45:29.156516] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T19:45:29.217985] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-13T19:45:29.422847] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-13T19:45:29.424785] [INFO ] [REMOTE ] KAI: Full fetch complete (18967 records). [2025-10-13T19:45:29.424858] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-13T19:45:29.851687] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-13T19:45:29.851781] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-13T19:45:29.852287] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-13T19:45:29.852351] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-13T19:45:29.853115] [DEBUG] [LOCAL ] KAI: Trimmed 18967 records to 13493 (keeping 200 days of data) [2025-10-13T19:45:29.944929] [DEBUG] [LOCAL ] KAI: Primary data saved (13493 records). [2025-10-13T19:45:29.945083] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-13T19:45:29.945167] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 27.3s. Estimated remaining: 2h 48m 41s. Rate: 7.1 symbols/min [2025-10-13T19:45:30.023028] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-13T19:45:30.117090] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:30.140419] [DEBUG] [LOCAL ] KB: Loaded 23980 existing records from primary storage. [2025-10-13T19:45:30.140707] [INFO ] [MAIN ] KB: Loaded 23980 existing records. [2025-10-13T19:45:30.315790] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:30.316008] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-13T19:45:30.316056] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-13T19:45:30.316369] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-13T19:45:30.316426] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-13T19:45:30.678225] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:30.747482] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-13T19:45:30.751943] [INFO ] [REMOTE ] JXN: Full fetch complete (65231 records). [2025-10-13T19:45:30.752069] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-13T19:45:30.825419] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-13T19:45:31.133251] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-13T19:45:31.133328] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-13T19:45:31.134174] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-13T19:45:31.134338] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-13T19:45:31.135567] [DEBUG] [LOCAL ] JXN: Trimmed 65231 records to 44862 (keeping 200 days of data) [2025-10-13T19:45:31.383545] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T19:45:31.442923] [DEBUG] [LOCAL ] JXN: Primary data saved (44862 records). [2025-10-13T19:45:31.443084] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-13T19:45:31.443168] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. JXN took 45.3s. Estimated remaining: 2h 48m 25s. Rate: 7.1 symbols/min [2025-10-13T19:45:31.608087] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:31.622320] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-13T19:45:31.633256] [DEBUG] [LOCAL ] KBDC: Loaded 22135 existing records from primary storage. [2025-10-13T19:45:31.633497] [INFO ] [MAIN ] KBDC: Loaded 22135 existing records. [2025-10-13T19:45:31.813112] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:31.813502] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-13T19:45:31.813579] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-13T19:45:31.813899] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-13T19:45:31.814025] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-13T19:45:32.039976] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-13T19:45:32.193789] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:32.417957] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-13T19:45:33.217895] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-13T19:45:33.385036] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-13T19:45:33.458982] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-13T19:45:34.017946] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-13T19:45:34.581781] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-13T19:45:34.737024] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-13T19:45:34.817969] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-13T19:45:35.617980] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-13T19:45:35.967285] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T19:45:36.418029] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-13T19:45:36.858071] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-13T19:45:37.218005] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-13T19:45:37.363814] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-13T19:45:38.017980] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-13T19:45:38.667542] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-13T19:45:38.672883] [INFO ] [REMOTE ] K: Full fetch complete (72121 records). [2025-10-13T19:45:38.672985] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-13T19:45:38.832202] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-13T19:45:39.067319] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-13T19:45:39.067399] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-13T19:45:39.068305] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-13T19:45:39.068368] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-13T19:45:39.069714] [DEBUG] [LOCAL ] K: Trimmed 72121 records to 50349 (keeping 200 days of data) [2025-10-13T19:45:39.312833] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-13T19:45:39.414105] [DEBUG] [LOCAL ] K: Primary data saved (50349 records). [2025-10-13T19:45:39.414238] [INFO ] [MAIN ] K: Full history saved. [2025-10-13T19:45:39.414325] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. K took 40.0s. Estimated remaining: 2h 48m 16s. Rate: 7.1 symbols/min [2025-10-13T19:45:39.609811] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:39.617966] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-13T19:45:39.657061] [DEBUG] [LOCAL ] KBH: Loaded 49611 existing records from primary storage. [2025-10-13T19:45:39.657375] [INFO ] [MAIN ] KBH: Loaded 49611 existing records. [2025-10-13T19:45:39.836717] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:39.836980] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-13T19:45:39.837057] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-13T19:45:39.838016] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-13T19:45:39.838075] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-13T19:45:40.200067] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:40.415828] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:45:40.424128] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-13T19:45:40.894536] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T19:45:41.217915] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-13T19:45:41.372533] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T19:45:42.017902] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-13T19:45:42.177030] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:45:42.817990] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-13T19:45:43.116339] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-13T19:45:43.617904] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-13T19:45:44.084103] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T19:45:44.418014] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-13T19:45:45.217904] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-13T19:45:45.254546] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T19:45:45.566207] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-13T19:45:46.017909] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-13T19:45:46.076353] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-13T19:45:46.817970] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-13T19:45:47.225796] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T19:45:47.617983] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-13T19:45:48.418056] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-13T19:45:48.546659] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:45:48.689962] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-13T19:45:49.217957] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-13T19:45:49.819302] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-13T19:45:50.017961] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-13T19:45:50.223382] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-13T19:45:50.817978] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-13T19:45:51.423229] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-13T19:45:51.617903] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-13T19:45:51.779592] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-13T19:45:52.417946] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-13T19:45:52.982260] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:45:53.105053] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-13T19:45:53.107840] [INFO ] [REMOTE ] KB: Full fetch complete (33622 records). [2025-10-13T19:45:53.108120] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-13T19:45:53.223051] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-13T19:45:53.474594] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-13T19:45:53.474753] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-13T19:45:53.475400] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-13T19:45:53.475464] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-13T19:45:53.476504] [DEBUG] [LOCAL ] KB: Trimmed 33622 records to 23448 (keeping 200 days of data) [2025-10-13T19:45:53.618340] [DEBUG] [LOCAL ] KB: Primary data saved (23448 records). [2025-10-13T19:45:53.618471] [INFO ] [MAIN ] KB: Full history saved. [2025-10-13T19:45:53.618598] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KB took 23.7s. Estimated remaining: 2h 48m 14s. Rate: 7.1 symbols/min [2025-10-13T19:45:53.811816] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:45:53.865153] [DEBUG] [LOCAL ] KBR: Loaded 48571 existing records from primary storage. [2025-10-13T19:45:53.865529] [INFO ] [MAIN ] KBR: Loaded 48571 existing records. [2025-10-13T19:45:54.020129] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-13T19:45:54.073844] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:45:54.074321] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-13T19:45:54.074379] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-13T19:45:54.075518] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-13T19:45:54.075588] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-13T19:45:54.446855] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:45:54.448291] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-13T19:45:54.817960] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-13T19:45:55.624574] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-13T19:45:55.645037] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T19:45:55.985480] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-13T19:45:56.417969] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-13T19:45:57.213150] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-13T19:45:57.222768] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-13T19:45:57.954415] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T19:45:58.017896] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-13T19:45:58.213004] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-13T19:45:58.817947] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-13T19:45:59.304144] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T19:45:59.617994] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-13T19:46:00.417941] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-13T19:46:00.450609] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-13T19:46:01.217909] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-13T19:46:01.404565] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-13T19:46:01.846401] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:46:01.850203] [INFO ] [REMOTE ] KBDC: Full fetch complete (29905 records). [2025-10-13T19:46:01.850311] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-13T19:46:02.030636] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-13T19:46:02.230284] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-13T19:46:02.230365] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-13T19:46:02.230940] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-13T19:46:02.231007] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-13T19:46:02.231799] [DEBUG] [LOCAL ] KBDC: Trimmed 29905 records to 22026 (keeping 200 days of data) [2025-10-13T19:46:02.369208] [DEBUG] [LOCAL ] KBDC: Primary data saved (22026 records). [2025-10-13T19:46:02.369344] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-13T19:46:02.369469] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 30.9s. Estimated remaining: 2h 48m 6s. Rate: 7.1 symbols/min [2025-10-13T19:46:02.546821] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:02.602610] [DEBUG] [LOCAL ] KD: Loaded 53097 existing records from primary storage. [2025-10-13T19:46:02.602965] [INFO ] [MAIN ] KD: Loaded 53097 existing records. [2025-10-13T19:46:02.806232] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T19:46:02.809848] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:02.818029] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-13T19:46:02.820080] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-13T19:46:02.820193] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-13T19:46:02.821478] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-13T19:46:02.821569] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-13T19:46:03.189362] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:03.617946] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-13T19:46:03.975145] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-13T19:46:04.242482] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-13T19:46:04.417947] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-13T19:46:05.052864] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:46:05.058004] [INFO ] [REMOTE ] KAR: Full fetch complete (56822 records). [2025-10-13T19:46:05.058128] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-13T19:46:05.224680] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-13T19:46:05.486145] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-13T19:46:05.486230] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-13T19:46:05.487123] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-13T19:46:05.487198] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-13T19:46:05.488724] [DEBUG] [LOCAL ] KAR: Trimmed 56822 records to 40157 (keeping 200 days of data) [2025-10-13T19:46:05.729213] [DEBUG] [LOCAL ] KAR: Primary data saved (40157 records). [2025-10-13T19:46:05.729341] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-13T19:46:05.729417] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KAR took 45.3s. Estimated remaining: 2h 47m 52s. Rate: 7.1 symbols/min [2025-10-13T19:46:05.898243] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:05.904794] [DEBUG] [LOCAL ] KEN: Loaded 4721 existing records from primary storage. [2025-10-13T19:46:05.904974] [INFO ] [MAIN ] KEN: Loaded 4721 existing records. [2025-10-13T19:46:06.023073] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-13T19:46:06.081748] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:06.082385] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-13T19:46:06.082437] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-13T19:46:06.082809] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-13T19:46:06.082869] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-13T19:46:06.440782] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:06.503399] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-13T19:46:06.622157] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-13T19:46:06.817958] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-13T19:46:07.617910] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-13T19:46:07.769603] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:46:08.264860] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-13T19:46:08.417486] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:46:08.426812] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-13T19:46:09.217956] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-13T19:46:10.017902] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-13T19:46:10.234984] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-13T19:46:10.590173] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-13T19:46:10.817904] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-13T19:46:10.922163] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T19:46:11.338554] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-13T19:46:11.617970] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-13T19:46:12.417954] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-13T19:46:13.217903] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-13T19:46:13.343153] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:46:13.722273] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-13T19:46:14.017958] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-13T19:46:14.817899] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-13T19:46:15.021930] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T19:46:15.620237] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-13T19:46:15.625465] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-13T19:46:16.277762] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-13T19:46:16.417944] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-13T19:46:17.217904] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-13T19:46:17.357425] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:46:18.017945] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-13T19:46:18.115886] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-13T19:46:18.121605] [INFO ] [REMOTE ] KBH: Full fetch complete (70804 records). [2025-10-13T19:46:18.121766] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-13T19:46:18.422020] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-13T19:46:18.515284] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-13T19:46:18.515375] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-13T19:46:18.516325] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-13T19:46:18.516395] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-13T19:46:18.517855] [DEBUG] [LOCAL ] KBH: Trimmed 70804 records to 48810 (keeping 200 days of data) [2025-10-13T19:46:18.816054] [DEBUG] [LOCAL ] KBH: Primary data saved (48810 records). [2025-10-13T19:46:18.816186] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-13T19:46:18.816269] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KBH took 39.4s. Estimated remaining: 2h 47m 48s. Rate: 7.1 symbols/min [2025-10-13T19:46:18.827673] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-13T19:46:18.992139] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:19.022921] [DEBUG] [LOCAL ] KEP: Loaded 31817 existing records from primary storage. [2025-10-13T19:46:19.023315] [INFO ] [MAIN ] KEP: Loaded 31817 existing records. [2025-10-13T19:46:19.180554] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-13T19:46:19.272639] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:19.273248] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-13T19:46:19.273377] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-13T19:46:19.274022] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-13T19:46:19.274083] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-13T19:46:19.625371] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-13T19:46:19.631282] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:19.639922] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-13T19:46:20.418003] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-13T19:46:21.217984] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-13T19:46:21.519140] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-13T19:46:21.656854] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-13T19:46:21.831694] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-13T19:46:22.017971] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-13T19:46:22.818011] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-13T19:46:23.534734] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:46:23.617878] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-13T19:46:24.417894] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-13T19:46:24.547538] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-13T19:46:25.175172] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T19:46:25.180115] [INFO ] [REMOTE ] KBR: Full fetch complete (69786 records). [2025-10-13T19:46:25.180237] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-13T19:46:25.223265] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-13T19:46:25.564219] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-13T19:46:25.564310] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-13T19:46:25.565215] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-13T19:46:25.565278] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-13T19:46:25.566804] [DEBUG] [LOCAL ] KBR: Trimmed 69786 records to 48028 (keeping 200 days of data) [2025-10-13T19:46:25.873198] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:46:25.887537] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-13T19:46:25.902837] [DEBUG] [LOCAL ] KBR: Primary data saved (48028 records). [2025-10-13T19:46:25.902945] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-13T19:46:25.903041] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KBR took 32.3s. Estimated remaining: 2h 47m 38s. Rate: 7.1 symbols/min [2025-10-13T19:46:26.017996] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-13T19:46:26.097307] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:26.135313] [DEBUG] [LOCAL ] KEX: Loaded 39119 existing records from primary storage. [2025-10-13T19:46:26.135665] [INFO ] [MAIN ] KEX: Loaded 39119 existing records. [2025-10-13T19:46:26.329625] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:26.329879] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-13T19:46:26.329927] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-13T19:46:26.330628] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-13T19:46:26.330735] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-13T19:46:26.799359] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:26.818018] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-13T19:46:27.508514] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-13T19:46:27.617964] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-13T19:46:27.750201] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-13T19:46:28.418033] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-13T19:46:28.766428] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-13T19:46:29.218004] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-13T19:46:30.017971] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-13T19:46:30.339199] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-13T19:46:30.365739] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-13T19:46:30.665693] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T19:46:30.817972] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-13T19:46:31.617947] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-13T19:46:32.417994] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-13T19:46:32.665491] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-13T19:46:32.983815] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T19:46:33.184397] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T19:46:33.217897] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-13T19:46:34.017955] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-13T19:46:34.741701] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T19:46:34.817903] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-13T19:46:35.062263] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-13T19:46:35.380023] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-13T19:46:35.380967] [INFO ] [REMOTE ] KEN: Full fetch complete (5962 records). [2025-10-13T19:46:35.381039] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-13T19:46:35.623176] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-13T19:46:35.739021] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-13T19:46:35.739102] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-13T19:46:35.739270] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-13T19:46:35.739310] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-13T19:46:35.739732] [DEBUG] [LOCAL ] KEN: Trimmed 5962 records to 4698 (keeping 200 days of data) [2025-10-13T19:46:35.767318] [DEBUG] [LOCAL ] KEN: Primary data saved (4698 records). [2025-10-13T19:46:35.767452] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-13T19:46:35.767536] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KEN took 30.0s. Estimated remaining: 2h 47m 31s. Rate: 7.1 symbols/min [2025-10-13T19:46:35.937366] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:35.937543] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-13T19:46:35.937586] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-13T19:46:35.937720] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-13T19:46:35.937789] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-13T19:46:35.937832] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-13T19:46:35.937864] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-13T19:46:36.283926] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:36.417941] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-13T19:46:37.021413] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-13T19:46:37.218006] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-13T19:46:37.715751] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:46:38.017908] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-13T19:46:38.817908] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-13T19:46:39.044947] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-13T19:46:39.439267] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-13T19:46:39.617955] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-13T19:46:40.417994] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-13T19:46:40.579783] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-13T19:46:41.072323] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T19:46:41.217958] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-13T19:46:42.017891] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-13T19:46:42.183871] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T19:46:42.189573] [INFO ] [REMOTE ] KD: Full fetch complete (75789 records). [2025-10-13T19:46:42.189773] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-13T19:46:42.588103] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-13T19:46:42.588269] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-13T19:46:42.589300] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-13T19:46:42.589401] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-13T19:46:42.591262] [DEBUG] [LOCAL ] KD: Trimmed 75789 records to 52360 (keeping 200 days of data) [2025-10-13T19:46:42.822997] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-13T19:46:42.841460] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:46:42.952279] [DEBUG] [LOCAL ] KD: Primary data saved (52360 records). [2025-10-13T19:46:42.952504] [INFO ] [MAIN ] KD: Full history saved. [2025-10-13T19:46:42.952603] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KD took 40.6s. Estimated remaining: 2h 47m 22s. Rate: 7.1 symbols/min [2025-10-13T19:46:43.122335] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:43.166991] [DEBUG] [LOCAL ] KEYS: Loaded 43794 existing records from primary storage. [2025-10-13T19:46:43.167291] [INFO ] [MAIN ] KEYS: Loaded 43794 existing records. [2025-10-13T19:46:43.347828] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:43.348164] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-13T19:46:43.348210] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-13T19:46:43.348855] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-13T19:46:43.348912] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-13T19:46:43.633266] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-13T19:46:43.660499] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T19:46:43.747554] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:44.337172] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:46:44.417883] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-13T19:46:45.217981] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-13T19:46:45.349969] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T19:46:45.830459] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-13T19:46:46.017978] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-13T19:46:46.197570] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T19:46:46.817911] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-13T19:46:47.473157] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-13T19:46:47.617892] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-13T19:46:48.417966] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-13T19:46:48.635984] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-13T19:46:48.961995] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T19:46:49.217980] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-13T19:46:49.795417] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-13T19:46:50.017900] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-13T19:46:50.329097] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-13T19:46:50.817954] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-13T19:46:51.617948] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-13T19:46:51.890372] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-13T19:46:52.282930] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-13T19:46:52.418009] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-13T19:46:53.076968] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:46:53.217950] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-13T19:46:53.678537] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-13T19:46:53.682474] [INFO ] [REMOTE ] KEP: Full fetch complete (41817 records). [2025-10-13T19:46:53.682564] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-13T19:46:54.023109] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-13T19:46:54.098160] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-13T19:46:54.098262] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-13T19:46:54.099778] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-13T19:46:54.099849] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-13T19:46:54.100955] [DEBUG] [LOCAL ] KEP: Trimmed 41817 records to 31657 (keeping 200 days of data) [2025-10-13T19:46:54.291413] [DEBUG] [LOCAL ] KEP: Primary data saved (31657 records). [2025-10-13T19:46:54.291555] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-13T19:46:54.291660] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEP took 35.5s. Estimated remaining: 2h 47m 16s. Rate: 7.1 symbols/min [2025-10-13T19:46:54.469873] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:54.474054] [DEBUG] [LOCAL ] KF: Loaded 2400 existing records from primary storage. [2025-10-13T19:46:54.474207] [INFO ] [MAIN ] KF: Loaded 2400 existing records. [2025-10-13T19:46:54.684716] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:54.684964] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-13T19:46:54.685022] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-13T19:46:54.685246] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-13T19:46:54.685304] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-13T19:46:54.822680] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-13T19:46:55.057799] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-13T19:46:55.090207] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:46:55.617972] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-13T19:46:55.675228] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-13T19:46:55.975540] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-13T19:46:56.417917] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-13T19:46:56.706772] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-13T19:46:57.217952] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-13T19:46:58.021691] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-13T19:46:58.032183] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-13T19:46:58.811484] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-13T19:46:58.815829] [INFO ] [REMOTE ] KEX: Full fetch complete (55812 records). [2025-10-13T19:46:58.815924] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-13T19:46:58.827581] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-13T19:46:59.189485] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-13T19:46:59.189566] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-13T19:46:59.190332] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-13T19:46:59.190395] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-13T19:46:59.191635] [DEBUG] [LOCAL ] KEX: Trimmed 55812 records to 38528 (keeping 200 days of data) [2025-10-13T19:46:59.430341] [DEBUG] [LOCAL ] KEX: Primary data saved (38528 records). [2025-10-13T19:46:59.430612] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-13T19:46:59.430855] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEX took 33.5s. Estimated remaining: 2h 47m 4s. Rate: 7.1 symbols/min [2025-10-13T19:46:59.626098] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:46:59.623552] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-13T19:46:59.669487] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:46:59.697843] [DEBUG] [LOCAL ] KFRC: Loaded 20385 existing records from primary storage. [2025-10-13T19:46:59.698139] [INFO ] [MAIN ] KFRC: Loaded 20385 existing records. [2025-10-13T19:46:59.876176] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:46:59.876391] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-13T19:46:59.876440] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-13T19:46:59.876932] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-13T19:46:59.876992] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-13T19:47:00.167152] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-13T19:47:00.242131] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:00.417955] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-13T19:47:00.635161] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T19:47:00.958852] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T19:47:01.217946] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-13T19:47:02.017977] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-13T19:47:02.817956] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-13T19:47:03.276475] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-13T19:47:03.618038] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-13T19:47:03.708242] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:47:03.748011] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-13T19:47:04.083135] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-13T19:47:04.417989] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-13T19:47:04.932450] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-13T19:47:05.217977] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-13T19:47:06.017982] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-13T19:47:06.762356] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-13T19:47:06.806570] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T19:47:06.817884] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-13T19:47:07.617983] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-13T19:47:08.299707] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:47:08.417896] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-13T19:47:08.491145] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-13T19:47:09.217947] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-13T19:47:10.017902] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-13T19:47:10.289749] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T19:47:10.727858] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-13T19:47:10.817977] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-13T19:47:10.935808] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-13T19:47:11.373597] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-13T19:47:11.617950] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-13T19:47:12.417986] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-13T19:47:12.663377] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-13T19:47:12.922663] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-13T19:47:13.217913] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-13T19:47:13.660869] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-13T19:47:14.017946] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-13T19:47:14.463500] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-13T19:47:14.817949] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-13T19:47:15.617947] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-13T19:47:16.079308] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-13T19:47:16.080151] [INFO ] [REMOTE ] KF: Full fetch complete (3556 records). [2025-10-13T19:47:16.080251] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-13T19:47:16.418273] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-13T19:47:16.450209] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-13T19:47:16.450348] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-13T19:47:16.450503] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-13T19:47:16.450575] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-13T19:47:16.451434] [DEBUG] [LOCAL ] KF: Trimmed 3556 records to 2335 (keeping 200 days of data) [2025-10-13T19:47:16.465901] [DEBUG] [LOCAL ] KF: Primary data saved (2335 records). [2025-10-13T19:47:16.465981] [INFO ] [MAIN ] KF: Full history saved. [2025-10-13T19:47:16.466060] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KF took 22.2s. Estimated remaining: 2h 47m 5s. Rate: 7.1 symbols/min [2025-10-13T19:47:16.681751] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:16.684848] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T19:47:16.705872] [DEBUG] [LOCAL ] KFS: Loaded 8671 existing records from primary storage. [2025-10-13T19:47:16.706103] [INFO ] [MAIN ] KFS: Loaded 8671 existing records. [2025-10-13T19:47:16.885196] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:16.885430] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-13T19:47:16.885478] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-13T19:47:16.885811] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-13T19:47:16.885869] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-13T19:47:17.219045] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-13T19:47:17.242176] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:17.522201] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-13T19:47:18.017914] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-13T19:47:18.655783] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-13T19:47:18.817897] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-13T19:47:19.044022] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-13T19:47:19.049586] [INFO ] [REMOTE ] KEY: Full fetch complete (77258 records). [2025-10-13T19:47:19.049763] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-13T19:47:19.251157] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T19:47:19.251928] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:47:19.251998] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:47:19.252048] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-13T19:47:19.252117] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-13T19:47:19.252171] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-13T19:47:19.252228] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-13T19:47:19.252310] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KEY took 43.5s. Estimated remaining: 2h 46m 50s. Rate: 7.1 symbols/min [2025-10-13T19:47:19.425053] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:19.455577] [DEBUG] [LOCAL ] KFY: Loaded 30330 existing records from primary storage. [2025-10-13T19:47:19.455905] [INFO ] [MAIN ] KFY: Loaded 30330 existing records. [2025-10-13T19:47:19.623480] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-13T19:47:19.654229] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:19.654798] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-13T19:47:19.655015] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-13T19:47:19.655753] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-13T19:47:19.655812] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-13T19:47:20.022493] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-13T19:47:20.186398] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:20.289577] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-13T19:47:20.417985] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-13T19:47:21.217956] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-13T19:47:21.982620] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T19:47:22.017887] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-13T19:47:22.228226] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T19:47:22.817998] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-13T19:47:23.189080] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-13T19:47:23.618966] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-13T19:47:23.624790] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-13T19:47:24.417982] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-13T19:47:24.946155] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-13T19:47:25.217978] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-13T19:47:25.506476] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-13T19:47:25.832218] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-13T19:47:26.017967] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-13T19:47:26.817992] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-13T19:47:27.571334] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T19:47:27.576137] [INFO ] [REMOTE ] KEYS: Full fetch complete (62660 records). [2025-10-13T19:47:27.576290] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-13T19:47:27.620206] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-13T19:47:27.965086] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-13T19:47:27.965236] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-13T19:47:27.966101] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-13T19:47:27.966163] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-13T19:47:27.967368] [DEBUG] [LOCAL ] KEYS: Trimmed 62660 records to 43256 (keeping 200 days of data) [2025-10-13T19:47:28.092803] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-13T19:47:28.257112] [DEBUG] [LOCAL ] KEYS: Primary data saved (43256 records). [2025-10-13T19:47:28.257248] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-13T19:47:28.257325] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KEYS took 45.3s. Estimated remaining: 2h 46m 42s. Rate: 7.1 symbols/min [2025-10-13T19:47:28.426500] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:28.426597] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-13T19:47:28.446429] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-13T19:47:28.488405] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-10-13T19:47:28.488757] [INFO ] [MAIN ] KGC: Loaded 54479 existing records. [2025-10-13T19:47:28.660097] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:28.660320] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-13T19:47:28.660374] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-13T19:47:28.660875] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-13T19:47:28.660932] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-13T19:47:29.005827] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:29.217902] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-13T19:47:29.510073] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-13T19:47:30.017946] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-13T19:47:30.817904] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-13T19:47:31.087050] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T19:47:31.147940] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-13T19:47:31.578712] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-13T19:47:31.617883] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-13T19:47:32.363805] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-13T19:47:32.417883] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-13T19:47:33.190631] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-13T19:47:33.217880] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-13T19:47:34.008234] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T19:47:34.017873] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-13T19:47:34.757040] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-13T19:47:34.817973] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-13T19:47:35.617897] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-13T19:47:35.942347] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-13T19:47:36.417984] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-13T19:47:36.853851] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-13T19:47:36.856964] [INFO ] [REMOTE ] KFRC: Full fetch complete (26295 records). [2025-10-13T19:47:36.857088] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-13T19:47:37.223455] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-13T19:47:37.224147] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-13T19:47:37.224228] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-13T19:47:37.225599] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-13T19:47:37.225687] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-13T19:47:37.226516] [DEBUG] [LOCAL ] KFRC: Trimmed 26295 records to 20312 (keeping 200 days of data) [2025-10-13T19:47:37.351212] [DEBUG] [LOCAL ] KFRC: Primary data saved (20312 records). [2025-10-13T19:47:37.351339] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-13T19:47:37.351414] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFRC took 37.9s. Estimated remaining: 2h 46m 35s. Rate: 7.1 symbols/min [2025-10-13T19:47:37.522789] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:37.563888] [DEBUG] [LOCAL ] KGS: Loaded 46609 existing records from primary storage. [2025-10-13T19:47:37.564250] [INFO ] [MAIN ] KGS: Loaded 46609 existing records. [2025-10-13T19:47:37.737297] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:37.737583] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-13T19:47:37.737663] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-13T19:47:37.738600] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-13T19:47:37.738698] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-13T19:47:38.023106] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-13T19:47:38.107217] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:38.272378] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-13T19:47:38.817911] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-13T19:47:38.895863] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T19:47:38.910878] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-13T19:47:38.913866] [INFO ] [REMOTE ] KFS: Full fetch complete (10877 records). [2025-10-13T19:47:38.914120] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-13T19:47:39.269230] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-13T19:47:39.269313] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-13T19:47:39.269611] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-13T19:47:39.269687] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-13T19:47:39.270638] [DEBUG] [LOCAL ] KFS: Trimmed 10877 records to 8662 (keeping 200 days of data) [2025-10-13T19:47:39.319936] [DEBUG] [LOCAL ] KFS: Primary data saved (8662 records). [2025-10-13T19:47:39.320064] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-13T19:47:39.320180] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFS took 22.9s. Estimated remaining: 2h 46m 20s. Rate: 7.1 symbols/min [2025-10-13T19:47:39.483349] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:39.536137] [DEBUG] [LOCAL ] KIM: Loaded 53761 existing records from primary storage. [2025-10-13T19:47:39.536441] [INFO ] [MAIN ] KIM: Loaded 53761 existing records. [2025-10-13T19:47:39.625208] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-13T19:47:39.712957] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:39.713157] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-13T19:47:39.713203] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-13T19:47:39.713691] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-13T19:47:39.713748] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-13T19:47:40.057939] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:40.417905] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-13T19:47:40.748661] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-13T19:47:41.123285] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-13T19:47:41.217918] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-13T19:47:42.017958] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-13T19:47:42.121742] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-13T19:47:42.353128] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-13T19:47:42.817956] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-13T19:47:43.618001] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-13T19:47:44.072454] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-13T19:47:44.221682] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-13T19:47:44.418010] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-13T19:47:45.003552] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T19:47:45.218003] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-13T19:47:46.017982] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-13T19:47:46.063895] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T19:47:46.524201] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-13T19:47:46.817888] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-13T19:47:47.617899] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-13T19:47:47.919708] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:47:47.949029] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T19:47:48.417955] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-13T19:47:48.996079] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T19:47:49.217987] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-13T19:47:50.017909] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-13T19:47:50.529154] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-13T19:47:50.773393] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-13T19:47:50.817895] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-13T19:47:51.617903] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-13T19:47:51.729200] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-13T19:47:52.304484] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T19:47:52.417911] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-13T19:47:52.969257] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T19:47:53.217970] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-13T19:47:54.017982] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-13T19:47:54.201159] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T19:47:54.817976] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-13T19:47:55.182230] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-13T19:47:55.202411] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-13T19:47:55.206035] [INFO ] [REMOTE ] KFY: Full fetch complete (43199 records). [2025-10-13T19:47:55.206119] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-13T19:47:55.581092] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-13T19:47:55.581169] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-13T19:47:55.581813] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-13T19:47:55.581874] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-13T19:47:55.582816] [DEBUG] [LOCAL ] KFY: Trimmed 43199 records to 30001 (keeping 200 days of data) [2025-10-13T19:47:55.636202] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-13T19:47:55.768485] [DEBUG] [LOCAL ] KFY: Primary data saved (30001 records). [2025-10-13T19:47:55.768628] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-13T19:47:55.768784] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KFY took 36.5s. Estimated remaining: 2h 46m 19s. Rate: 7.1 symbols/min [2025-10-13T19:47:55.936123] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:47:55.957262] [DEBUG] [LOCAL ] KIO: Loaded 21860 existing records from primary storage. [2025-10-13T19:47:55.957507] [INFO ] [MAIN ] KIO: Loaded 21860 existing records. [2025-10-13T19:47:56.167815] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:47:56.168147] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-13T19:47:56.168198] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-13T19:47:56.168865] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-13T19:47:56.168926] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-13T19:47:56.425459] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-13T19:47:56.538599] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:47:56.570597] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T19:47:57.217946] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-13T19:47:57.807456] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-13T19:47:57.871407] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-13T19:47:58.017959] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-13T19:47:58.766259] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-13T19:47:58.817890] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-13T19:47:59.617950] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-13T19:47:59.819980] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-13T19:48:00.232976] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:48:00.283139] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-13T19:48:00.417941] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-13T19:48:01.217960] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-13T19:48:02.017994] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-13T19:48:02.596424] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-13T19:48:02.817917] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-13T19:48:02.974346] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-13T19:48:03.608954] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-13T19:48:03.618918] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-13T19:48:04.417895] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-13T19:48:04.721822] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-13T19:48:04.823330] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-13T19:48:05.217972] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-13T19:48:06.017959] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-13T19:48:06.277474] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-13T19:48:06.303629] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-13T19:48:06.817949] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-13T19:48:07.617909] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-13T19:48:07.664583] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T19:48:08.158393] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-13T19:48:08.417959] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-13T19:48:09.217901] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-13T19:48:09.547598] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-13T19:48:09.867407] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-13T19:48:09.872879] [INFO ] [REMOTE ] KGC: Full fetch complete (77702 records). [2025-10-13T19:48:09.873005] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-13T19:48:10.025398] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-13T19:48:10.279521] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-13T19:48:10.279601] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-13T19:48:10.280521] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-13T19:48:10.280583] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-13T19:48:10.282663] [DEBUG] [LOCAL ] KGC: Trimmed 77702 records to 53700 (keeping 200 days of data) [2025-10-13T19:48:10.616095] [DEBUG] [LOCAL ] KGC: Primary data saved (53700 records). [2025-10-13T19:48:10.616249] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-13T19:48:10.616387] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGC took 42.4s. Estimated remaining: 2h 46m 17s. Rate: 7.1 symbols/min [2025-10-13T19:48:10.794080] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:10.822287] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-13T19:48:10.846062] [DEBUG] [LOCAL ] KKR: Loaded 54282 existing records from primary storage. [2025-10-13T19:48:10.846379] [INFO ] [MAIN ] KKR: Loaded 54282 existing records. [2025-10-13T19:48:11.036690] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:11.048368] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-13T19:48:11.066187] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-13T19:48:11.068372] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T19:48:11.068429] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-13T19:48:11.079395] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-13T19:48:11.275074] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-13T19:48:11.497498] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:11.617914] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-13T19:48:12.418199] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-13T19:48:12.422790] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-13T19:48:12.538039] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T19:48:13.218079] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-13T19:48:14.018054] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-13T19:48:14.174381] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T19:48:14.186743] [INFO ] [REMOTE ] KIM: Full fetch complete (76793 records). [2025-10-13T19:48:14.191677] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-13T19:48:14.192080] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-13T19:48:14.620571] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-13T19:48:14.620697] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-13T19:48:14.621675] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-13T19:48:14.621737] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-13T19:48:14.623226] [DEBUG] [LOCAL ] KIM: Trimmed 76793 records to 52996 (keeping 200 days of data) [2025-10-13T19:48:14.837393] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-13T19:48:14.957672] [DEBUG] [LOCAL ] KIM: Primary data saved (52996 records). [2025-10-13T19:48:14.957830] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-13T19:48:14.957915] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIM took 35.6s. Estimated remaining: 2h 46m 5s. Rate: 7.1 symbols/min [2025-10-13T19:48:15.127468] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:15.134909] [DEBUG] [LOCAL ] KKRS: Loaded 5772 existing records from primary storage. [2025-10-13T19:48:15.135591] [INFO ] [MAIN ] KKRS: Loaded 5772 existing records. [2025-10-13T19:48:15.327245] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:15.327484] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-13T19:48:15.327534] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-13T19:48:15.327745] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-13T19:48:15.327803] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-13T19:48:15.622998] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-13T19:48:15.670213] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-13T19:48:15.721500] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:15.723211] [INFO ] [REMOTE ] KGS: Full fetch complete (66412 records). [2025-10-13T19:48:15.723451] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-13T19:48:15.790073] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-13T19:48:16.166838] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-13T19:48:16.166924] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-13T19:48:16.167805] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-13T19:48:16.167867] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-13T19:48:16.169539] [DEBUG] [LOCAL ] KGS: Trimmed 66412 records to 46095 (keeping 200 days of data) [2025-10-13T19:48:16.428495] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-13T19:48:16.450836] [DEBUG] [LOCAL ] KGS: Primary data saved (46095 records). [2025-10-13T19:48:16.450929] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-13T19:48:16.451005] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KGS took 39.1s. Estimated remaining: 2h 45m 49s. Rate: 7.1 symbols/min [2025-10-13T19:48:16.624277] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:16.624444] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-13T19:48:16.624484] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-13T19:48:16.624598] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-13T19:48:16.624663] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-13T19:48:16.624733] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-13T19:48:16.624792] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-13T19:48:16.980110] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:17.217987] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-13T19:48:17.415599] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:48:17.416147] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-13T19:48:17.416245] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:48:17.416325] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-13T19:48:17.416404] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:48:17.416499] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-13T19:48:17.416595] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-13T19:48:17.416635] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-13T19:48:17.416731] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-13T19:48:17.416839] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKRT took 1.0s. Estimated remaining: 2h 45m 33s. Rate: 7.1 symbols/min [2025-10-13T19:48:17.618601] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:17.618850] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-13T19:48:17.618930] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-13T19:48:17.619179] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-13T19:48:17.619280] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-13T19:48:17.619507] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-13T19:48:17.619583] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-13T19:48:17.896187] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-13T19:48:18.001151] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-13T19:48:18.021047] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-13T19:48:18.066523] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:18.818001] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-13T19:48:19.019856] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:48:19.020261] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-13T19:48:19.020359] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:48:19.020418] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-13T19:48:19.020477] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:48:19.020550] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-13T19:48:19.020618] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-13T19:48:19.020689] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-13T19:48:19.020751] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-13T19:48:19.020806] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KLAR took 1.6s. Estimated remaining: 2h 45m 18s. Rate: 7.1 symbols/min [2025-10-13T19:48:19.222929] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:19.239842] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-13T19:48:19.281825] [DEBUG] [LOCAL ] KLC: Loaded 37317 existing records from primary storage. [2025-10-13T19:48:19.282259] [INFO ] [MAIN ] KLC: Loaded 37317 existing records. [2025-10-13T19:48:19.476305] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:19.476612] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-13T19:48:19.476696] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-13T19:48:19.477155] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-13T19:48:19.477223] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-13T19:48:19.627197] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-13T19:48:19.864778] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:20.417903] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-13T19:48:20.428056] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T19:48:21.217998] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-13T19:48:21.868421] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T19:48:22.017963] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-13T19:48:22.347117] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-13T19:48:22.350022] [INFO ] [REMOTE ] KIO: Full fetch complete (31676 records). [2025-10-13T19:48:22.350095] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-13T19:48:22.711377] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-13T19:48:22.711461] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-13T19:48:22.712034] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-13T19:48:22.712094] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-13T19:48:22.712806] [DEBUG] [LOCAL ] KIO: Trimmed 31676 records to 21587 (keeping 200 days of data) [2025-10-13T19:48:22.818005] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-13T19:48:22.849865] [DEBUG] [LOCAL ] KIO: Primary data saved (21587 records). [2025-10-13T19:48:22.849998] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-13T19:48:22.850077] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KIO took 27.1s. Estimated remaining: 2h 45m 5s. Rate: 7.1 symbols/min [2025-10-13T19:48:23.253055] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-13T19:48:23.617984] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-13T19:48:24.156398] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-13T19:48:24.417982] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-13T19:48:24.597997] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-13T19:48:25.014514] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-13T19:48:25.218010] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-13T19:48:25.736483] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-13T19:48:26.017951] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-13T19:48:26.808064] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-13T19:48:26.817870] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-13T19:48:27.525876] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-13T19:48:27.617981] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-13T19:48:28.417943] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-13T19:48:28.684483] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T19:48:29.062633] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-13T19:48:29.217985] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-13T19:48:30.017917] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-13T19:48:30.817982] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-13T19:48:30.936114] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-13T19:48:31.405434] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-13T19:48:31.551101] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-13T19:48:31.617965] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-13T19:48:32.417952] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-13T19:48:33.031213] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-13T19:48:33.035419] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-13T19:48:33.217954] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-13T19:48:34.018014] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-13T19:48:34.611873] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-13T19:48:34.709084] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-13T19:48:34.817983] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-13T19:48:35.617958] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-13T19:48:36.418000] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-13T19:48:36.783332] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-13T19:48:36.918935] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-13T19:48:37.041376] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-13T19:48:37.042603] [INFO ] [REMOTE ] KKRS: Full fetch complete (7721 records). [2025-10-13T19:48:37.042709] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-13T19:48:37.223460] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-13T19:48:37.428826] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-13T19:48:37.428951] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-13T19:48:37.429450] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-13T19:48:37.429525] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-13T19:48:37.430069] [DEBUG] [LOCAL ] KKRS: Trimmed 7721 records to 5732 (keeping 200 days of data) [2025-10-13T19:48:37.469550] [DEBUG] [LOCAL ] KKRS: Primary data saved (5732 records). [2025-10-13T19:48:37.469766] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-13T19:48:37.469929] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKRS took 22.5s. Estimated remaining: 2h 45m 3s. Rate: 7.1 symbols/min [2025-10-13T19:48:38.018046] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-13T19:48:38.623950] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-13T19:48:38.817911] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-13T19:48:40.155137] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-13T19:48:40.166632] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-13T19:48:40.374481] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-13T19:48:40.417962] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-13T19:48:41.890417] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-13T19:48:41.899221] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-13T19:48:42.000108] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-13T19:48:42.018029] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-13T19:48:43.312556] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:48:43.316636] [INFO ] [REMOTE ] KLC: Full fetch complete (50450 records). [2025-10-13T19:48:43.316754] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-13T19:48:43.703793] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-13T19:48:43.703895] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-13T19:48:43.704616] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-13T19:48:43.704820] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-13T19:48:43.706029] [DEBUG] [LOCAL ] KLC: Trimmed 50450 records to 36593 (keeping 200 days of data) [2025-10-13T19:48:43.931187] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T19:48:43.954024] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-13T19:48:43.964484] [DEBUG] [LOCAL ] KLC: Primary data saved (36593 records). [2025-10-13T19:48:43.964576] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-13T19:48:43.964673] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KLC took 24.9s. Estimated remaining: 2h 44m 53s. Rate: 7.1 symbols/min [2025-10-13T19:48:46.118748] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-13T19:48:46.131753] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-13T19:48:47.966840] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T19:48:47.979358] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-13T19:48:49.836417] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T19:48:49.848899] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-13T19:48:51.660725] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-13T19:48:51.666592] [INFO ] [REMOTE ] KKR: Full fetch complete (77455 records). [2025-10-13T19:48:51.666749] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-13T19:48:52.053345] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-13T19:48:52.053427] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-13T19:48:52.054354] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-13T19:48:52.054418] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-13T19:48:52.055864] [DEBUG] [LOCAL ] KKR: Trimmed 77455 records to 53503 (keeping 200 days of data) [2025-10-13T19:48:52.390135] [DEBUG] [LOCAL ] KKR: Primary data saved (53503 records). [2025-10-13T19:48:52.390280] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-13T19:48:52.390365] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KKR took 41.8s. Estimated remaining: 2h 44m 44s. Rate: 7.1 symbols/min [2025-10-13T19:48:53.057694] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:53.036995] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:53.110516] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:53.142853] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:48:53.153000] [DEBUG] [LOCAL ] KMPB: Loaded 3854 existing records from primary storage. [2025-10-13T19:48:53.153569] [INFO ] [MAIN ] KMPB: Loaded 3854 existing records. [2025-10-13T19:48:53.415039] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:53.405543] [DEBUG] [LOCAL ] KMT: Loaded 43511 existing records from primary storage. [2025-10-13T19:48:53.417442] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-13T19:48:53.417038] [DEBUG] [LOCAL ] KMPR: Loaded 40015 existing records from primary storage. [2025-10-13T19:48:53.432922] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-13T19:48:53.433469] [INFO ] [MAIN ] KMT: Loaded 43511 existing records. [2025-10-13T19:48:53.439891] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-10-13T19:48:53.440163] [INFO ] [MAIN ] KMPR: Loaded 40015 existing records. [2025-10-13T19:48:53.440261] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-13T19:48:53.513630] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-13T19:48:53.513974] [INFO ] [MAIN ] KMI: Loaded 54473 existing records. [2025-10-13T19:48:53.965297] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:54.081200] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-13T19:48:54.132917] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:54.163898] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-13T19:48:54.191624] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-13T19:48:54.196998] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-13T19:48:54.283285] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-13T19:48:54.294123] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-13T19:48:54.378041] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-13T19:48:54.377915] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:48:54.378425] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-13T19:48:54.404506] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-13T19:48:54.416482] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-13T19:48:54.487095] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-13T19:48:54.501579] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-13T19:48:54.882727] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:55.027988] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-13T19:48:55.558606] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:55.601091] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:55.606589] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-13T19:48:55.592713] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-13T19:48:55.677876] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:48:55.678340] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-13T19:48:55.858672] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-13T19:48:55.860124] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-13T19:48:56.342025] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-13T19:48:56.344209] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-13T19:48:56.740094] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-13T19:48:56.746215] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-13T19:48:56.790066] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-13T19:48:56.791875] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-13T19:48:56.838924] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T19:48:56.847837] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-13T19:48:57.374705] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-13T19:48:57.376530] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-13T19:48:57.704321] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-13T19:48:57.715731] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-13T19:48:57.732204] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:48:57.738271] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-13T19:48:57.909144] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-13T19:48:57.910511] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-13T19:48:58.251244] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-13T19:48:58.261134] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-13T19:48:58.266720] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-13T19:48:58.268319] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-13T19:48:58.685055] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-13T19:48:58.691134] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-13T19:48:58.898367] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-13T19:48:58.900169] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-13T19:48:59.376459] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-13T19:48:59.617941] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-13T19:48:59.718174] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-13T19:48:59.781031] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-13T19:48:59.880448] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-13T19:49:00.252901] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-13T19:49:00.417909] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-13T19:49:01.217999] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-13T19:49:01.786901] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-13T19:49:01.943140] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T19:49:02.017919] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-13T19:49:02.817999] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-13T19:49:03.550168] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-13T19:49:03.617975] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-13T19:49:04.281915] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T19:49:04.417994] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-13T19:49:05.218016] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-13T19:49:05.594336] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-13T19:49:05.915280] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T19:49:05.918479] [INFO ] [REMOTE ] KMPB: Full fetch complete (5052 records). [2025-10-13T19:49:05.920739] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T19:49:05.921079] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-13T19:49:06.023246] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-13T19:49:06.316690] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-13T19:49:06.316785] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-13T19:49:06.316935] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-13T19:49:06.316973] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-13T19:49:06.317469] [DEBUG] [LOCAL ] KMPB: Trimmed 5052 records to 3733 (keeping 200 days of data) [2025-10-13T19:49:06.342056] [DEBUG] [LOCAL ] KMPB: Primary data saved (3733 records). [2025-10-13T19:49:06.342187] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-13T19:49:06.342270] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 13.9s. Estimated remaining: 2h 44m 41s. Rate: 7.1 symbols/min [2025-10-13T19:49:06.528471] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:06.579400] [DEBUG] [LOCAL ] KMX: Loaded 53995 existing records from primary storage. [2025-10-13T19:49:06.579729] [INFO ] [MAIN ] KMX: Loaded 53995 existing records. [2025-10-13T19:49:06.751939] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:06.752161] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-13T19:49:06.752207] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-13T19:49:06.753101] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-13T19:49:06.753158] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-13T19:49:06.823145] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-13T19:49:07.116376] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:07.583314] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-13T19:49:07.617902] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-13T19:49:08.275203] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-13T19:49:08.417957] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-13T19:49:09.081621] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-13T19:49:09.217984] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-13T19:49:09.868286] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-13T19:49:10.017912] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-13T19:49:10.675241] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-13T19:49:10.817984] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-13T19:49:11.617907] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-13T19:49:11.816071] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-13T19:49:12.417912] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-13T19:49:12.767752] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-13T19:49:12.891674] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-13T19:49:13.218005] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-13T19:49:13.708858] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-13T19:49:14.017971] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-13T19:49:14.817971] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-13T19:49:15.166241] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-13T19:49:15.617964] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-13T19:49:15.735295] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-13T19:49:16.224317] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-13T19:49:16.417987] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-13T19:49:17.111000] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T19:49:17.217894] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-13T19:49:17.962575] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T19:49:17.968133] [INFO ] [REMOTE ] KMPR: Full fetch complete (52376 records). [2025-10-13T19:49:17.968361] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-13T19:49:18.028046] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-13T19:49:18.377965] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-13T19:49:18.378084] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-13T19:49:18.379161] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-13T19:49:18.379227] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-13T19:49:18.380865] [DEBUG] [LOCAL ] KMPR: Trimmed 52376 records to 39744 (keeping 200 days of data) [2025-10-13T19:49:18.653780] [DEBUG] [LOCAL ] KMPR: Primary data saved (39744 records). [2025-10-13T19:49:18.653985] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-13T19:49:18.654096] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMPR took 26.3s. Estimated remaining: 2h 44m 36s. Rate: 7.1 symbols/min [2025-10-13T19:49:18.818472] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-13T19:49:18.839819] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:18.871630] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T19:49:18.917113] [DEBUG] [LOCAL ] KN: Loaded 39166 existing records from primary storage. [2025-10-13T19:49:18.917478] [INFO ] [MAIN ] KN: Loaded 39166 existing records. [2025-10-13T19:49:19.103543] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:19.103861] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-13T19:49:19.103911] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-13T19:49:19.104632] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-13T19:49:19.104732] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-13T19:49:19.480717] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:19.617965] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-13T19:49:19.965278] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-13T19:49:20.417968] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-13T19:49:20.807071] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T19:49:20.843106] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-13T19:49:21.218005] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-13T19:49:22.017961] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-13T19:49:22.318417] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-13T19:49:22.627544] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T19:49:22.817990] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-13T19:49:23.617991] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-13T19:49:23.820031] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-13T19:49:24.417995] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-13T19:49:24.668517] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-13T19:49:25.138604] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:49:25.218039] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-13T19:49:26.017959] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-13T19:49:26.345099] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T19:49:26.691241] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-13T19:49:26.818025] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-13T19:49:27.511401] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-13T19:49:27.515961] [INFO ] [REMOTE ] KMT: Full fetch complete (61792 records). [2025-10-13T19:49:27.516149] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-13T19:49:27.623206] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-13T19:49:27.956388] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-13T19:49:27.956773] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-13T19:49:27.957955] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-13T19:49:27.958038] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-13T19:49:27.970749] [DEBUG] [LOCAL ] KMT: Trimmed 61792 records to 42905 (keeping 200 days of data) [2025-10-13T19:49:27.989284] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-13T19:49:28.278285] [DEBUG] [LOCAL ] KMT: Primary data saved (42905 records). [2025-10-13T19:49:28.278486] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-13T19:49:28.278591] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 35.9s. Estimated remaining: 2h 44m 29s. Rate: 7.1 symbols/min [2025-10-13T19:49:28.427812] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-13T19:49:28.467375] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:28.510850] [DEBUG] [LOCAL ] KNF: Loaded 36854 existing records from primary storage. [2025-10-13T19:49:28.511314] [INFO ] [MAIN ] KNF: Loaded 36854 existing records. [2025-10-13T19:49:28.701268] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:28.701666] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-13T19:49:28.701749] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-13T19:49:28.702574] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-13T19:49:28.702638] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-13T19:49:29.064963] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:29.217917] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-13T19:49:29.395905] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-13T19:49:30.022213] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-13T19:49:30.031337] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:49:30.709035] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T19:49:30.817995] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-13T19:49:31.617911] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-13T19:49:31.951859] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-13T19:49:32.266909] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T19:49:32.417993] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-13T19:49:33.217921] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-13T19:49:33.553267] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-13T19:49:33.779768] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-13T19:49:34.017977] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-13T19:49:34.817908] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-13T19:49:35.132907] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-13T19:49:35.455305] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-13T19:49:35.617964] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-13T19:49:36.418051] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-13T19:49:36.674476] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-13T19:49:36.680808] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-13T19:49:36.681028] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-13T19:49:37.099797] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-13T19:49:37.099921] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-13T19:49:37.101736] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-13T19:49:37.101809] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-13T19:49:37.103874] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-10-13T19:49:37.218282] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-13T19:49:37.497174] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-13T19:49:37.510338] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-13T19:49:37.511963] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-13T19:49:37.512282] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMI took 45.1s. Estimated remaining: 2h 44m 21s. Rate: 7.1 symbols/min [2025-10-13T19:49:37.693860] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:37.731541] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-13T19:49:37.752964] [DEBUG] [LOCAL ] KNOP: Loaded 10627 existing records from primary storage. [2025-10-13T19:49:37.753884] [INFO ] [MAIN ] KNOP: Loaded 10627 existing records. [2025-10-13T19:49:37.938392] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:37.938708] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-13T19:49:37.938770] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-13T19:49:37.939147] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-13T19:49:37.939219] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-13T19:49:38.023223] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-13T19:49:38.311632] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:38.584777] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-13T19:49:38.823000] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-13T19:49:38.833560] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-13T19:49:38.840837] [INFO ] [REMOTE ] KMX: Full fetch complete (76108 records). [2025-10-13T19:49:38.840999] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-13T19:49:39.265221] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-13T19:49:39.265344] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-13T19:49:39.266897] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-13T19:49:39.266987] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-13T19:49:39.269099] [DEBUG] [LOCAL ] KMX: Trimmed 76108 records to 53264 (keeping 200 days of data) [2025-10-13T19:49:39.618015] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-13T19:49:39.625699] [DEBUG] [LOCAL ] KMX: Primary data saved (53264 records). [2025-10-13T19:49:39.625946] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-13T19:49:39.626114] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KMX took 33.3s. Estimated remaining: 2h 44m 7s. Rate: 7.1 symbols/min [2025-10-13T19:49:39.810786] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:39.831351] [DEBUG] [LOCAL ] KNSL: Loaded 18641 existing records from primary storage. [2025-10-13T19:49:39.831731] [INFO ] [MAIN ] KNSL: Loaded 18641 existing records. [2025-10-13T19:49:40.026883] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:40.027264] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-13T19:49:40.027479] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-13T19:49:40.028118] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-13T19:49:40.028195] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-13T19:49:40.192115] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-13T19:49:40.426736] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-13T19:49:40.472397] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:41.163982] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-13T19:49:41.186572] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-13T19:49:41.217897] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-13T19:49:42.017967] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-13T19:49:42.540831] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-13T19:49:42.555063] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:49:42.559465] [INFO ] [REMOTE ] KN: Full fetch complete (56436 records). [2025-10-13T19:49:42.559600] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-13T19:49:42.823394] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-13T19:49:42.966311] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-13T19:49:42.966417] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-13T19:49:42.967550] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-13T19:49:42.967630] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-13T19:49:42.969605] [DEBUG] [LOCAL ] KN: Trimmed 56436 records to 38584 (keeping 200 days of data) [2025-10-13T19:49:43.209698] [DEBUG] [LOCAL ] KN: Primary data saved (38584 records). [2025-10-13T19:49:43.209893] [INFO ] [MAIN ] KN: Full history saved. [2025-10-13T19:49:43.210008] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KN took 24.6s. Estimated remaining: 2h 43m 54s. Rate: 7.1 symbols/min [2025-10-13T19:49:43.380953] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:43.428775] [DEBUG] [LOCAL ] KNTK: Loaded 47300 existing records from primary storage. [2025-10-13T19:49:43.429169] [INFO ] [MAIN ] KNTK: Loaded 47300 existing records. [2025-10-13T19:49:43.607211] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:43.607478] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-13T19:49:43.607542] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-13T19:49:43.608200] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-13T19:49:43.608266] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-13T19:49:43.623005] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-13T19:49:43.979185] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-13T19:49:44.010800] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:49:44.418027] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-13T19:49:45.093400] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:49:45.217962] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-13T19:49:46.017950] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-13T19:49:46.048080] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T19:49:46.817913] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-13T19:49:46.828769] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T19:49:47.130050] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-13T19:49:47.617950] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-13T19:49:48.240491] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-13T19:49:48.417961] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-13T19:49:48.436060] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-13T19:49:49.217976] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-13T19:49:49.763564] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-13T19:49:49.965801] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T19:49:50.017894] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-13T19:49:50.460889] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-13T19:49:50.817980] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-13T19:49:51.617985] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-13T19:49:52.155549] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-13T19:49:52.417996] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-13T19:49:53.003514] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-13T19:49:53.217974] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-13T19:49:53.774399] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-13T19:49:54.017975] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-13T19:49:54.754276] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-13T19:49:54.817974] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-13T19:49:55.045744] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T19:49:55.617961] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-13T19:49:56.423066] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-13T19:49:56.441964] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:49:57.059770] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-13T19:49:57.154856] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-13T19:49:57.217968] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-13T19:49:58.017971] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-13T19:49:58.675149] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T19:49:58.682600] [INFO ] [REMOTE ] KNF: Full fetch complete (51069 records). [2025-10-13T19:49:58.682914] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-13T19:49:58.823184] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-13T19:49:59.139396] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-13T19:49:59.139635] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-13T19:49:59.140825] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-13T19:49:59.141033] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-13T19:49:59.147622] [DEBUG] [LOCAL ] KNF: Trimmed 51069 records to 36521 (keeping 200 days of data) [2025-10-13T19:49:59.388611] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-13T19:49:59.430220] [DEBUG] [LOCAL ] KNF: Primary data saved (36521 records). [2025-10-13T19:49:59.430434] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-13T19:49:59.430557] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNF took 31.2s. Estimated remaining: 2h 43m 53s. Rate: 7.1 symbols/min [2025-10-13T19:49:59.603283] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:49:59.617942] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-13T19:49:59.663838] [DEBUG] [LOCAL ] KNX: Loaded 53376 existing records from primary storage. [2025-10-13T19:49:59.664306] [INFO ] [MAIN ] KNX: Loaded 53376 existing records. [2025-10-13T19:49:59.852427] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:49:59.852774] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-13T19:49:59.852832] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-13T19:49:59.853783] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-13T19:49:59.853843] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-13T19:49:59.968931] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-13T19:50:00.256047] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:00.417977] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-13T19:50:01.217950] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-13T19:50:01.256395] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-13T19:50:02.018013] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-13T19:50:02.135139] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T19:50:02.184125] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T19:50:02.818035] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-13T19:50:02.883830] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-13T19:50:03.618039] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-13T19:50:04.417984] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-13T19:50:04.729737] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-13T19:50:04.784306] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-13T19:50:05.217965] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-13T19:50:06.020595] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-13T19:50:06.027852] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-13T19:50:06.372729] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-13T19:50:06.817979] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-13T19:50:07.617963] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-13T19:50:07.829556] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T19:50:08.417976] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-13T19:50:08.477693] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-13T19:50:08.518105] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-13T19:50:09.217965] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-13T19:50:10.017951] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-13T19:50:10.134213] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-13T19:50:10.137024] [INFO ] [REMOTE ] KNOP: Full fetch complete (14563 records). [2025-10-13T19:50:10.137493] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-13T19:50:10.535823] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-13T19:50:10.572732] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-13T19:50:10.573370] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-13T19:50:10.574327] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-13T19:50:10.574416] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-13T19:50:10.575463] [DEBUG] [LOCAL ] KNOP: Trimmed 14563 records to 10368 (keeping 200 days of data) [2025-10-13T19:50:10.643909] [DEBUG] [LOCAL ] KNOP: Primary data saved (10368 records). [2025-10-13T19:50:10.644156] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-13T19:50:10.644312] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNOP took 33.1s. Estimated remaining: 2h 43m 47s. Rate: 7.1 symbols/min [2025-10-13T19:50:10.830206] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:10.830537] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-13T19:50:10.826220] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-13T19:50:10.830637] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-13T19:50:10.832456] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-13T19:50:10.832556] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-13T19:50:10.832610] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-13T19:50:10.832688] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-13T19:50:11.211435] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:11.277559] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-13T19:50:11.618014] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-13T19:50:12.417986] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-13T19:50:12.489494] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T19:50:13.217914] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-13T19:50:13.455559] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-13T19:50:13.479749] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-13T19:50:14.017996] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-13T19:50:14.514054] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-13T19:50:14.521023] [INFO ] [REMOTE ] KNTK: Full fetch complete (65106 records). [2025-10-13T19:50:14.521292] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-13T19:50:14.823166] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-13T19:50:15.067267] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-13T19:50:15.067500] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-13T19:50:15.069758] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-13T19:50:15.069977] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-13T19:50:15.073479] [DEBUG] [LOCAL ] KNTK: Trimmed 65106 records to 46863 (keeping 200 days of data) [2025-10-13T19:50:15.384567] [DEBUG] [LOCAL ] KNTK: Primary data saved (46863 records). [2025-10-13T19:50:15.384727] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-13T19:50:15.384816] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNTK took 32.2s. Estimated remaining: 2h 43m 35s. Rate: 7.1 symbols/min [2025-10-13T19:50:15.556094] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:15.594048] [DEBUG] [LOCAL ] KODK: Loaded 44104 existing records from primary storage. [2025-10-13T19:50:15.594337] [INFO ] [MAIN ] KODK: Loaded 44104 existing records. [2025-10-13T19:50:15.625755] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-13T19:50:15.777453] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:50:15.777706] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-13T19:50:15.777767] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-13T19:50:15.778500] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-13T19:50:15.778557] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-13T19:50:16.147205] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:16.417973] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-13T19:50:16.732722] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-10-13T19:50:16.795624] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-13T19:50:16.797831] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-13T19:50:17.217963] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-13T19:50:18.018045] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-13T19:50:18.098774] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T19:50:18.818029] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-13T19:50:18.903814] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:50:19.617920] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-13T19:50:20.417998] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-13T19:50:20.560188] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:50:20.600436] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-13T19:50:21.217892] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-13T19:50:21.399769] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-13T19:50:21.559698] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T19:50:22.017948] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-13T19:50:22.817967] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-13T19:50:23.617996] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-13T19:50:23.702135] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-13T19:50:23.797179] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-13T19:50:23.852456] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-13T19:50:24.417999] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-13T19:50:24.857692] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-13T19:50:25.217916] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-13T19:50:25.463863] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-13T19:50:26.017919] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-13T19:50:26.817965] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-13T19:50:27.573287] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T19:50:27.617889] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-13T19:50:27.741958] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-13T19:50:28.417913] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-13T19:50:28.588005] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:50:28.934159] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-13T19:50:29.217970] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-13T19:50:30.017949] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-13T19:50:30.817964] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-13T19:50:30.882860] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-13T19:50:30.984141] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-13T19:50:30.987733] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-13T19:50:31.002206] [INFO ] [REMOTE ] KNSL: Full fetch complete (26810 records). [2025-10-13T19:50:31.003601] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-13T19:50:31.399370] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-13T19:50:31.399570] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-13T19:50:31.400945] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-13T19:50:31.401014] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-13T19:50:31.402212] [DEBUG] [LOCAL ] KNSL: Trimmed 26810 records to 18409 (keeping 200 days of data) [2025-10-13T19:50:31.521766] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T19:50:31.535001] [INFO ] [REMOTE ] KNX: Full fetch complete (75928 records). [2025-10-13T19:50:31.535734] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-13T19:50:31.624690] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-13T19:50:31.765234] [DEBUG] [LOCAL ] KNSL: Primary data saved (18409 records). [2025-10-13T19:50:31.819060] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-13T19:50:31.833725] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNSL took 52.2s. Estimated remaining: 2h 43m 34s. Rate: 7.1 symbols/min [2025-10-13T19:50:32.128815] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:32.128933] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-13T19:50:32.129301] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-13T19:50:32.130272] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-13T19:50:32.130355] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-13T19:50:32.132318] [DEBUG] [LOCAL ] KNX: Trimmed 75928 records to 52602 (keeping 200 days of data) [2025-10-13T19:50:32.271001] [DEBUG] [LOCAL ] KOF: Loaded 26841 existing records from primary storage. [2025-10-13T19:50:32.271328] [INFO ] [MAIN ] KOF: Loaded 26841 existing records. [2025-10-13T19:50:32.454885] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-13T19:50:32.564600] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:50:32.567238] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-13T19:50:32.567830] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-13T19:50:32.569155] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-13T19:50:32.569754] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-13T19:50:33.014060] [DEBUG] [LOCAL ] KNX: Primary data saved (52602 records). [2025-10-13T19:50:33.019003] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:33.019176] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-13T19:50:33.019282] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KNX took 33.6s. Estimated remaining: 2h 43m 19s. Rate: 7.1 symbols/min [2025-10-13T19:50:33.183922] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:33.200164] [DEBUG] [LOCAL ] KOP: Loaded 17721 existing records from primary storage. [2025-10-13T19:50:33.200395] [INFO ] [MAIN ] KOP: Loaded 17721 existing records. [2025-10-13T19:50:33.231287] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-13T19:50:33.379405] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:50:33.379619] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-13T19:50:33.379694] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-13T19:50:33.380151] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-13T19:50:33.380209] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-13T19:50:33.734189] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:33.944219] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:50:34.017902] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-13T19:50:34.254084] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-10-13T19:50:34.379888] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-13T19:50:34.818062] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-13T19:50:35.617951] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-13T19:50:35.733373] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T19:50:35.827205] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T19:50:36.417964] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-13T19:50:37.217920] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-13T19:50:38.018037] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-13T19:50:38.206633] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-13T19:50:38.350799] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-10-13T19:50:38.408429] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-13T19:50:38.817916] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-13T19:50:39.005525] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:50:39.617914] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-13T19:50:40.142542] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-13T19:50:40.418027] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-13T19:50:41.157703] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-13T19:50:41.217888] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-13T19:50:41.477028] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-13T19:50:42.017983] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-13T19:50:42.777798] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-13T19:50:42.783817] [INFO ] [REMOTE ] KODK: Full fetch complete (63313 records). [2025-10-13T19:50:42.783966] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-13T19:50:42.825954] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-13T19:50:43.053413] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-13T19:50:43.187067] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-13T19:50:43.187151] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-13T19:50:43.188023] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-13T19:50:43.188126] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-13T19:50:43.189410] [DEBUG] [LOCAL ] KODK: Trimmed 63313 records to 43626 (keeping 200 days of data) [2025-10-13T19:50:43.436291] [DEBUG] [LOCAL ] KODK: Primary data saved (43626 records). [2025-10-13T19:50:43.436451] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-13T19:50:43.436548] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 28.1s. Estimated remaining: 2h 43m 12s. Rate: 7.1 symbols/min [2025-10-13T19:50:43.604664] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:43.608939] [DEBUG] [LOCAL ] KORE: Loaded 2158 existing records from primary storage. [2025-10-13T19:50:43.609104] [INFO ] [MAIN ] KORE: Loaded 2158 existing records. [2025-10-13T19:50:43.623263] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-13T19:50:43.788351] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:50:43.788588] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-13T19:50:43.788638] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-13T19:50:43.788873] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-13T19:50:43.788931] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-13T19:50:44.144850] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:44.417947] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-13T19:50:44.986224] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-13T19:50:45.217910] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-13T19:50:45.394529] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-13T19:50:45.773298] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-13T19:50:46.017977] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-13T19:50:46.334942] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-13T19:50:46.817998] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-13T19:50:47.617916] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-13T19:50:47.626768] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-13T19:50:48.299302] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-13T19:50:48.417983] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-13T19:50:48.690189] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-13T19:50:49.217918] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-13T19:50:50.017980] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-13T19:50:50.195047] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-13T19:50:50.583926] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-13T19:50:50.817898] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-13T19:50:51.240466] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-13T19:50:51.514106] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T19:50:51.519544] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-13T19:50:51.519677] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-13T19:50:51.620013] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-13T19:50:51.716042] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-13T19:50:51.716799] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:50:51.716870] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:50:51.716945] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-13T19:50:51.717012] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-13T19:50:51.717048] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-13T19:50:51.717087] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-13T19:50:51.717145] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KO took 41.1s. Estimated remaining: 2h 43m 4s. Rate: 7.1 symbols/min [2025-10-13T19:50:51.882717] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:50:51.935216] [DEBUG] [LOCAL ] KOS: Loaded 53851 existing records from primary storage. [2025-10-13T19:50:51.935541] [INFO ] [MAIN ] KOS: Loaded 53851 existing records. [2025-10-13T19:50:52.131935] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:50:52.132149] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-13T19:50:52.132197] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-13T19:50:52.133929] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-13T19:50:52.133990] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-13T19:50:52.421889] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-13T19:50:52.423721] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-13T19:50:52.505674] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:50:53.217922] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-13T19:50:53.771780] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T19:50:54.017954] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-13T19:50:54.152554] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T19:50:54.817942] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-13T19:50:55.617905] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-13T19:50:55.900478] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T19:50:56.069346] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-13T19:50:56.417910] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-13T19:50:56.603006] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-13T19:50:57.217906] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-13T19:50:57.513677] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-13T19:50:58.017899] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-13T19:50:58.334298] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-13T19:50:58.817993] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-13T19:50:59.364683] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T19:50:59.617899] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-13T19:50:59.737004] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T19:51:00.052540] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-13T19:51:00.417972] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-13T19:51:01.217941] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-13T19:51:01.816637] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-13T19:51:02.017954] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-13T19:51:02.226451] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:51:02.228902] [INFO ] [REMOTE ] KOP: Full fetch complete (25439 records). [2025-10-13T19:51:02.228978] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-13T19:51:02.503328] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-13T19:51:02.612434] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-13T19:51:02.612508] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-13T19:51:02.613029] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-13T19:51:02.613091] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-13T19:51:02.613748] [DEBUG] [LOCAL ] KOP: Trimmed 25439 records to 17485 (keeping 200 days of data) [2025-10-13T19:51:02.724639] [DEBUG] [LOCAL ] KOP: Primary data saved (17485 records). [2025-10-13T19:51:02.724830] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-13T19:51:02.724928] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOP took 29.7s. Estimated remaining: 2h 42m 58s. Rate: 7.1 symbols/min [2025-10-13T19:51:02.823148] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-13T19:51:02.904585] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:02.953694] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-10-13T19:51:02.954015] [INFO ] [MAIN ] KR: Loaded 54461 existing records. [2025-10-13T19:51:03.135237] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:03.135454] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-13T19:51:03.135500] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-13T19:51:03.136420] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-13T19:51:03.136479] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-13T19:51:03.495682] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:03.617908] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-13T19:51:03.718285] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T19:51:03.721482] [INFO ] [REMOTE ] KOF: Full fetch complete (37625 records). [2025-10-13T19:51:03.721559] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-13T19:51:04.126687] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-13T19:51:04.126774] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-13T19:51:04.127379] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-13T19:51:04.127416] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-13T19:51:04.128346] [DEBUG] [LOCAL ] KOF: Trimmed 37625 records to 26539 (keeping 200 days of data) [2025-10-13T19:51:04.297708] [DEBUG] [LOCAL ] KOF: Primary data saved (26539 records). [2025-10-13T19:51:04.297850] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-13T19:51:04.297961] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOF took 32.5s. Estimated remaining: 2h 42m 43s. Rate: 7.1 symbols/min [2025-10-13T19:51:04.422986] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-13T19:51:04.477916] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:04.521985] [DEBUG] [LOCAL ] KRC: Loaded 49050 existing records from primary storage. [2025-10-13T19:51:04.522318] [INFO ] [MAIN ] KRC: Loaded 49050 existing records. [2025-10-13T19:51:04.704025] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:04.704251] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-13T19:51:04.704305] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-13T19:51:04.705260] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-13T19:51:04.705322] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-13T19:51:04.993558] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-13T19:51:05.072941] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:05.217905] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-13T19:51:05.380673] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T19:51:06.017955] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-13T19:51:06.783960] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-13T19:51:06.818038] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-13T19:51:07.618027] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-13T19:51:07.903864] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T19:51:08.417956] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-13T19:51:08.597970] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-13T19:51:08.738294] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-13T19:51:08.840340] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-13T19:51:09.217991] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-13T19:51:09.676669] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-13T19:51:10.017966] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-13T19:51:10.818065] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-13T19:51:11.543480] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-13T19:51:11.580969] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-13T19:51:11.617917] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-13T19:51:12.418009] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-13T19:51:13.217998] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-13T19:51:13.428105] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T19:51:14.018001] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-13T19:51:14.252282] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-13T19:51:14.451680] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-13T19:51:14.662244] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-13T19:51:14.817950] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-13T19:51:15.617922] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-13T19:51:16.417901] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-13T19:51:16.641918] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T19:51:17.217986] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-13T19:51:17.360713] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-13T19:51:18.021065] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-13T19:51:18.233093] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T19:51:18.817896] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-13T19:51:19.274203] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-13T19:51:19.411430] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-13T19:51:19.617891] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-13T19:51:20.417893] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-13T19:51:20.529967] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-13T19:51:21.197225] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-13T19:51:21.217880] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-13T19:51:22.017982] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-13T19:51:22.375526] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-13T19:51:22.487276] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-13T19:51:22.817971] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-13T19:51:23.617897] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-13T19:51:23.902280] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-13T19:51:24.251023] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-13T19:51:24.252014] [INFO ] [REMOTE ] KORE: Full fetch complete (5590 records). [2025-10-13T19:51:24.252101] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-13T19:51:24.425623] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-13T19:51:24.670712] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-13T19:51:24.670821] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-13T19:51:24.671045] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-13T19:51:24.671774] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-13T19:51:24.673291] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-13T19:51:24.683877] [DEBUG] [LOCAL ] KORE: Trimmed 5590 records to 2146 (keeping 200 days of data) [2025-10-13T19:51:24.697274] [DEBUG] [LOCAL ] KORE: Primary data saved (2146 records). [2025-10-13T19:51:24.697343] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-13T19:51:24.697431] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KORE took 41.3s. Estimated remaining: 2h 42m 45s. Rate: 7.1 symbols/min [2025-10-13T19:51:24.872243] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:24.906379] [DEBUG] [LOCAL ] KREF: Loaded 38383 existing records from primary storage. [2025-10-13T19:51:24.906710] [INFO ] [MAIN ] KREF: Loaded 38383 existing records. [2025-10-13T19:51:25.091827] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:25.092051] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-13T19:51:25.092098] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-13T19:51:25.092857] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-13T19:51:25.092916] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-13T19:51:25.223166] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-13T19:51:25.474945] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:26.017913] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-13T19:51:26.590306] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-13T19:51:26.675212] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:51:26.817956] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-13T19:51:27.197074] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-13T19:51:27.617948] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-13T19:51:28.417899] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-13T19:51:28.683398] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-13T19:51:29.217892] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-13T19:51:29.389543] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-13T19:51:29.801104] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-13T19:51:30.018031] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-13T19:51:30.753983] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-13T19:51:30.759604] [INFO ] [REMOTE ] KRC: Full fetch complete (69846 records). [2025-10-13T19:51:30.759787] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-13T19:51:30.818677] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-13T19:51:31.214214] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-13T19:51:31.214370] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-13T19:51:31.215513] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-13T19:51:31.215582] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-13T19:51:31.217128] [DEBUG] [LOCAL ] KRC: Trimmed 69846 records to 48286 (keeping 200 days of data) [2025-10-13T19:51:31.522130] [DEBUG] [LOCAL ] KRC: Primary data saved (48286 records). [2025-10-13T19:51:31.522272] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-13T19:51:31.522355] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KRC took 27.2s. Estimated remaining: 2h 42m 35s. Rate: 7.1 symbols/min [2025-10-13T19:51:31.619149] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-13T19:51:31.693310] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:31.737375] [DEBUG] [LOCAL ] KRG: Loaded 49891 existing records from primary storage. [2025-10-13T19:51:31.737869] [INFO ] [MAIN ] KRG: Loaded 49891 existing records. [2025-10-13T19:51:31.857905] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-13T19:51:31.907515] [INFO ] [REMOTE ] KOS: Full fetch complete (76873 records). [2025-10-13T19:51:31.929134] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-13T19:51:31.956218] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:31.956806] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-13T19:51:31.956862] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-13T19:51:31.989836] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-13T19:51:32.022067] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-13T19:51:32.716128] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:32.740105] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-13T19:51:32.759683] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-13T19:51:32.761395] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-13T19:51:32.762527] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-13T19:51:32.762815] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-13T19:51:32.761163] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T19:51:32.772077] [DEBUG] [LOCAL ] KOS: Trimmed 76873 records to 53089 (keeping 200 days of data) [2025-10-13T19:51:32.885509] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T19:51:33.117013] [DEBUG] [LOCAL ] KOS: Primary data saved (53089 records). [2025-10-13T19:51:33.117150] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-13T19:51:33.117234] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KOS took 41.4s. Estimated remaining: 2h 42m 21s. Rate: 7.1 symbols/min [2025-10-13T19:51:33.218914] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-13T19:51:33.290035] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:33.290202] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-13T19:51:33.290240] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-13T19:51:33.290352] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-13T19:51:33.290395] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-13T19:51:33.290447] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-13T19:51:33.290479] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-13T19:51:33.651028] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:34.018006] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-13T19:51:34.393176] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-13T19:51:34.817986] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-13T19:51:34.871164] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T19:51:35.118076] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-13T19:51:35.617958] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-13T19:51:36.418011] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-13T19:51:36.457210] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-13T19:51:36.615105] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:51:36.615503] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-13T19:51:36.615595] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:51:36.615687] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-13T19:51:36.615754] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:51:36.615828] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-13T19:51:36.615893] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-13T19:51:36.615929] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-13T19:51:36.615966] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-13T19:51:36.616048] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KRMN took 3.5s. Estimated remaining: 2h 42m 7s. Rate: 7.1 symbols/min [2025-10-13T19:51:36.785038] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:36.810092] [DEBUG] [LOCAL ] KRO: Loaded 26592 existing records from primary storage. [2025-10-13T19:51:36.810390] [INFO ] [MAIN ] KRO: Loaded 26592 existing records. [2025-10-13T19:51:36.995720] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:36.995976] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-13T19:51:36.996023] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-13T19:51:36.996575] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-13T19:51:36.996677] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-13T19:51:37.223098] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-13T19:51:37.402375] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:37.439782] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-13T19:51:38.018008] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-13T19:51:38.723450] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-13T19:51:38.752121] [INFO ] [REMOTE ] KR: Full fetch complete (77680 records). [2025-10-13T19:51:38.752885] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-13T19:51:38.753696] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T19:51:38.828209] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-13T19:51:39.149895] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-13T19:51:39.149970] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-13T19:51:39.150890] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-13T19:51:39.150951] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-13T19:51:39.152470] [DEBUG] [LOCAL ] KR: Trimmed 77680 records to 53681 (keeping 200 days of data) [2025-10-13T19:51:39.481110] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-13T19:51:39.481280] [INFO ] [MAIN ] KR: Full history saved. [2025-10-13T19:51:39.481386] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KR took 36.8s. Estimated remaining: 2h 41m 54s. Rate: 7.1 symbols/min [2025-10-13T19:51:39.630175] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-13T19:51:39.663893] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:39.701329] [DEBUG] [LOCAL ] KRP: Loaded 37244 existing records from primary storage. [2025-10-13T19:51:39.701610] [INFO ] [MAIN ] KRP: Loaded 37244 existing records. [2025-10-13T19:51:39.886108] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:39.886494] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-13T19:51:39.886546] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-13T19:51:39.888329] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-13T19:51:39.888399] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-13T19:51:40.265091] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:51:40.416006] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-13T19:51:40.424361] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-13T19:51:40.813815] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-13T19:51:41.217956] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-13T19:51:41.950959] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:51:42.017964] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-13T19:51:42.666371] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T19:51:42.817983] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-13T19:51:43.588053] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:51:43.617882] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-13T19:51:44.306550] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:51:44.417918] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-13T19:51:45.217901] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-13T19:51:45.391911] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T19:51:45.437711] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-13T19:51:46.017946] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-13T19:51:46.531153] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:51:46.817988] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-13T19:51:47.029517] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T19:51:47.617955] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-13T19:51:48.417922] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-13T19:51:48.488222] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-13T19:51:49.168489] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T19:51:49.217960] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-13T19:51:49.579399] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T19:51:50.020986] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-13T19:51:50.263529] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T19:51:50.817948] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-13T19:51:51.368977] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-13T19:51:51.617921] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-13T19:51:52.288059] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-13T19:51:52.419817] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-13T19:51:52.422533] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-13T19:51:53.217921] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-13T19:51:53.995610] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:51:54.017913] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-13T19:51:54.818042] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-13T19:51:55.207016] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-13T19:51:55.617900] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-13T19:51:56.421010] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-13T19:51:56.422792] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:51:56.560702] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-13T19:51:57.034530] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:51:57.217965] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-13T19:51:57.516856] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-13T19:51:58.018000] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-13T19:51:58.817889] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-13T19:51:58.961386] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-13T19:51:58.978841] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T19:51:58.983225] [INFO ] [REMOTE ] KREF: Full fetch complete (52699 records). [2025-10-13T19:51:58.983311] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-13T19:51:59.351381] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-13T19:51:59.351452] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-13T19:51:59.352131] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-13T19:51:59.352191] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-13T19:51:59.353263] [DEBUG] [LOCAL ] KREF: Trimmed 52699 records to 37962 (keeping 200 days of data) [2025-10-13T19:51:59.581748] [DEBUG] [LOCAL ] KREF: Primary data saved (37962 records). [2025-10-13T19:51:59.581884] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-13T19:51:59.581983] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KREF took 34.9s. Estimated remaining: 2h 41m 56s. Rate: 7.1 symbols/min [2025-10-13T19:51:59.624358] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-13T19:51:59.749937] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:51:59.799748] [DEBUG] [LOCAL ] KSS: Loaded 54376 existing records from primary storage. [2025-10-13T19:51:59.800091] [INFO ] [MAIN ] KSS: Loaded 54376 existing records. [2025-10-13T19:51:59.985116] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:51:59.985422] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-13T19:51:59.985483] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-13T19:51:59.986616] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-13T19:51:59.986720] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-13T19:52:00.423268] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-13T19:52:00.546766] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:00.597303] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-13T19:52:01.121238] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-13T19:52:01.217958] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-13T19:52:01.603554] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-13T19:52:02.017963] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-13T19:52:02.817960] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-13T19:52:03.617947] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-13T19:52:03.841805] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-13T19:52:04.006727] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-13T19:52:04.243730] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-13T19:52:04.417975] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-13T19:52:04.931423] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-13T19:52:05.217942] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-13T19:52:05.894941] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T19:52:06.017964] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-13T19:52:06.735189] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-13T19:52:06.817969] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-13T19:52:07.532361] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-13T19:52:07.537387] [INFO ] [REMOTE ] KRG: Full fetch complete (71128 records). [2025-10-13T19:52:07.537491] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-13T19:52:07.625382] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-13T19:52:07.959777] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-13T19:52:07.959874] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-13T19:52:07.960804] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-13T19:52:07.960893] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-13T19:52:07.962189] [DEBUG] [LOCAL ] KRG: Trimmed 71128 records to 49255 (keeping 200 days of data) [2025-10-13T19:52:08.263500] [DEBUG] [LOCAL ] KRG: Primary data saved (49255 records). [2025-10-13T19:52:08.263626] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-13T19:52:08.263751] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRG took 36.7s. Estimated remaining: 2h 41m 48s. Rate: 7.1 symbols/min [2025-10-13T19:52:08.423810] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-13T19:52:08.423725] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-13T19:52:08.462188] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:08.511871] [DEBUG] [LOCAL ] KT: Loaded 46155 existing records from primary storage. [2025-10-13T19:52:08.512183] [INFO ] [MAIN ] KT: Loaded 46155 existing records. [2025-10-13T19:52:08.690929] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:08.691183] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-13T19:52:08.691243] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-13T19:52:08.692117] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-13T19:52:08.692176] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-13T19:52:09.045336] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:09.217970] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-13T19:52:09.661531] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-13T19:52:10.017972] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-13T19:52:10.391949] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-10-13T19:52:10.506088] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-13T19:52:10.817900] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-13T19:52:11.238942] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-13T19:52:11.241972] [INFO ] [REMOTE ] KRO: Full fetch complete (35150 records). [2025-10-13T19:52:11.242043] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-13T19:52:11.607028] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-13T19:52:11.607150] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-13T19:52:11.607778] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-13T19:52:11.607840] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-13T19:52:11.608802] [DEBUG] [LOCAL ] KRO: Trimmed 35150 records to 26376 (keeping 200 days of data) [2025-10-13T19:52:11.656571] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-13T19:52:11.759852] [DEBUG] [LOCAL ] KRO: Primary data saved (26376 records). [2025-10-13T19:52:11.759973] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-13T19:52:11.760069] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRO took 35.1s. Estimated remaining: 2h 41m 35s. Rate: 7.1 symbols/min [2025-10-13T19:52:11.924962] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:11.964589] [DEBUG] [LOCAL ] KTB: Loaded 41117 existing records from primary storage. [2025-10-13T19:52:11.964887] [INFO ] [MAIN ] KTB: Loaded 41117 existing records. [2025-10-13T19:52:12.137533] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:12.137754] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-13T19:52:12.137802] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-13T19:52:12.138540] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-13T19:52:12.138596] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-13T19:52:12.418175] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-13T19:52:12.500503] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:12.524945] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-13T19:52:13.217910] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-13T19:52:13.315541] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-13T19:52:13.771307] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-13T19:52:14.017995] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-13T19:52:14.710398] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-13T19:52:14.817979] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-13T19:52:15.623010] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-13T19:52:15.637533] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:52:16.171022] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-13T19:52:16.174995] [INFO ] [REMOTE ] KRP: Full fetch complete (54849 records). [2025-10-13T19:52:16.175091] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-13T19:52:16.425343] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-13T19:52:16.617416] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-13T19:52:16.617522] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-13T19:52:16.618541] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-13T19:52:16.618613] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-13T19:52:16.620088] [DEBUG] [LOCAL ] KRP: Trimmed 54849 records to 36498 (keeping 200 days of data) [2025-10-13T19:52:16.866834] [DEBUG] [LOCAL ] KRP: Primary data saved (36498 records). [2025-10-13T19:52:16.866983] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-13T19:52:16.867065] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KRP took 37.4s. Estimated remaining: 2h 41m 23s. Rate: 7.1 symbols/min [2025-10-13T19:52:17.037022] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:17.048738] [DEBUG] [LOCAL ] KTF: Loaded 12160 existing records from primary storage. [2025-10-13T19:52:17.048939] [INFO ] [MAIN ] KTF: Loaded 12160 existing records. [2025-10-13T19:52:17.224498] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-13T19:52:17.253717] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:17.254350] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-13T19:52:17.254437] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-13T19:52:17.254801] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-13T19:52:17.254859] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-13T19:52:17.606046] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:17.783758] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T19:52:18.017964] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-13T19:52:18.409596] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-13T19:52:18.528024] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-13T19:52:18.817999] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-13T19:52:18.985486] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-13T19:52:19.617924] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-13T19:52:20.423007] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-13T19:52:20.439609] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:52:21.217915] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-13T19:52:21.614948] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-13T19:52:22.017958] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-13T19:52:22.393399] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-13T19:52:22.809520] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-13T19:52:22.819358] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-13T19:52:23.557425] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T19:52:23.603035] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-13T19:52:23.617966] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-13T19:52:24.418038] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-13T19:52:24.428043] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-13T19:52:25.217983] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-13T19:52:25.989378] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-13T19:52:26.017902] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-13T19:52:26.241212] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-13T19:52:26.818035] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-13T19:52:27.628621] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-13T19:52:27.635780] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-13T19:52:28.417969] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-13T19:52:28.655851] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-13T19:52:28.888676] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-13T19:52:29.217981] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-13T19:52:29.904408] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-13T19:52:30.017950] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-13T19:52:30.734068] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-13T19:52:30.791212] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-13T19:52:30.817949] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-13T19:52:31.617953] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-13T19:52:31.714416] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-13T19:52:32.417963] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-13T19:52:33.095156] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-13T19:52:33.218004] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-13T19:52:33.708981] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-13T19:52:34.017971] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-13T19:52:34.817977] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-13T19:52:35.377396] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-13T19:52:35.608300] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-13T19:52:35.617904] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-13T19:52:36.417976] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-13T19:52:36.544453] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-13T19:52:37.209900] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-13T19:52:37.220983] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-13T19:52:37.301032] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-13T19:52:38.017996] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-13T19:52:38.817994] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-13T19:52:39.245773] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-13T19:52:39.482121] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-13T19:52:39.486952] [INFO ] [REMOTE ] KT: Full fetch complete (66386 records). [2025-10-13T19:52:39.487088] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-13T19:52:39.621036] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-13T19:52:39.610744] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-13T19:52:39.891818] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-13T19:52:39.891905] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-13T19:52:39.892813] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-13T19:52:39.892876] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-13T19:52:39.894207] [DEBUG] [LOCAL ] KT: Trimmed 66386 records to 45544 (keeping 200 days of data) [2025-10-13T19:52:40.174433] [DEBUG] [LOCAL ] KT: Primary data saved (45544 records). [2025-10-13T19:52:40.174581] [INFO ] [MAIN ] KT: Full history saved. [2025-10-13T19:52:40.174730] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KT took 31.9s. Estimated remaining: 2h 41m 29s. Rate: 7.1 symbols/min [2025-10-13T19:52:40.348217] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:40.348422] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-13T19:52:40.348505] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-13T19:52:40.348662] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-13T19:52:40.348722] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-13T19:52:40.348812] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-13T19:52:40.348854] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-13T19:52:40.423705] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-13T19:52:40.722965] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:41.217977] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-13T19:52:41.618571] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-13T19:52:41.624389] [INFO ] [REMOTE ] KSS: Full fetch complete (77627 records). [2025-10-13T19:52:41.624528] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-13T19:52:42.019249] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-13T19:52:42.059676] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-13T19:52:42.069064] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T19:52:42.069169] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-13T19:52:42.072255] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-13T19:52:42.082493] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-13T19:52:42.082968] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-13T19:52:42.090774] [DEBUG] [LOCAL ] KSS: Trimmed 77627 records to 53596 (keeping 200 days of data) [2025-10-13T19:52:42.448788] [DEBUG] [LOCAL ] KSS: Primary data saved (53596 records). [2025-10-13T19:52:42.448990] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-13T19:52:42.449089] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KSS took 42.9s. Estimated remaining: 2h 41m 15s. Rate: 7.1 symbols/min [2025-10-13T19:52:42.629835] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:42.687968] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-10-13T19:52:42.688478] [INFO ] [MAIN ] KVUE: Loaded 54447 existing records. [2025-10-13T19:52:42.823112] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-13T19:52:42.888926] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:42.895545] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-13T19:52:42.895862] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T19:52:42.896128] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-13T19:52:42.899774] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-13T19:52:42.899954] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-13T19:52:43.257255] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:43.617999] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-13T19:52:43.670309] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-13T19:52:43.671598] [INFO ] [REMOTE ] KTF: Full fetch complete (17403 records). [2025-10-13T19:52:43.671711] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-13T19:52:44.032342] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-13T19:52:44.032421] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-13T19:52:44.032886] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-13T19:52:44.032950] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-13T19:52:44.033482] [DEBUG] [LOCAL ] KTF: Trimmed 17403 records to 11915 (keeping 200 days of data) [2025-10-13T19:52:44.103925] [DEBUG] [LOCAL ] KTF: Primary data saved (11915 records). [2025-10-13T19:52:44.104053] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-13T19:52:44.104130] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KTF took 27.2s. Estimated remaining: 2h 40m 60s. Rate: 7.1 symbols/min [2025-10-13T19:52:44.270948] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:44.317239] [DEBUG] [LOCAL ] KVYO: Loaded 51205 existing records from primary storage. [2025-10-13T19:52:44.317543] [INFO ] [MAIN ] KVYO: Loaded 51205 existing records. [2025-10-13T19:52:44.423091] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-13T19:52:44.493874] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:44.494060] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-13T19:52:44.494110] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-13T19:52:44.495066] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-13T19:52:44.495125] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-13T19:52:44.852082] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:45.217907] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-13T19:52:45.482471] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T19:52:46.017977] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-13T19:52:46.057040] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T19:52:46.817987] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-13T19:52:47.082038] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-13T19:52:47.617915] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-13T19:52:47.673984] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-13T19:52:47.852775] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-13T19:52:47.857177] [INFO ] [REMOTE ] KTB: Full fetch complete (57945 records). [2025-10-13T19:52:47.857340] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-13T19:52:48.264632] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-13T19:52:48.264762] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-13T19:52:48.265797] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-13T19:52:48.265866] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-13T19:52:48.267422] [DEBUG] [LOCAL ] KTB: Trimmed 57945 records to 40542 (keeping 200 days of data) [2025-10-13T19:52:48.380810] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-13T19:52:48.419232] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-13T19:52:48.553783] [DEBUG] [LOCAL ] KTB: Primary data saved (40542 records). [2025-10-13T19:52:48.553965] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-13T19:52:48.554062] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KTB took 36.8s. Estimated remaining: 2h 40m 48s. Rate: 7.1 symbols/min [2025-10-13T19:52:48.723589] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:52:48.764858] [DEBUG] [LOCAL ] KW: Loaded 40951 existing records from primary storage. [2025-10-13T19:52:48.765307] [INFO ] [MAIN ] KW: Loaded 40951 existing records. [2025-10-13T19:52:48.956936] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:52:48.957305] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-13T19:52:48.963843] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-13T19:52:48.963968] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-13T19:52:48.967076] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-13T19:52:48.967155] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-13T19:52:49.223191] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-13T19:52:49.327816] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:52:50.017906] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-13T19:52:50.817916] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-13T19:52:50.952608] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-13T19:52:51.617918] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-13T19:52:51.690628] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-13T19:52:51.815534] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-13T19:52:52.417923] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-13T19:52:52.879780] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-13T19:52:52.972037] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-13T19:52:53.218010] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-13T19:52:54.017948] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-13T19:52:54.794007] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:52:54.817888] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-13T19:52:55.474945] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:52:55.617915] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-13T19:52:56.417954] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-13T19:52:56.500181] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:52:57.132008] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:52:57.217942] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-13T19:52:57.844620] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-13T19:52:58.017964] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-13T19:52:58.817956] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-13T19:52:58.902965] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-13T19:52:59.398593] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-13T19:52:59.617922] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-13T19:53:00.417923] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-13T19:53:00.988136] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-13T19:53:01.217909] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-13T19:53:01.542703] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-13T19:53:01.599952] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-13T19:53:01.865311] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T19:53:02.017953] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-13T19:53:02.448258] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-13T19:53:02.817970] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-13T19:53:03.617999] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-13T19:53:04.384391] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-13T19:53:04.417920] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-13T19:53:05.217988] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-13T19:53:05.372001] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-13T19:53:05.863337] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-13T19:53:06.017981] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-13T19:53:06.817943] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-13T19:53:07.090620] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-13T19:53:07.575531] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T19:53:07.617891] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-13T19:53:07.856601] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-13T19:53:08.417907] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-13T19:53:09.217898] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-13T19:53:09.254710] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T19:53:09.824101] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T19:53:10.017995] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-13T19:53:10.664367] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-13T19:53:10.817925] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-13T19:53:11.306762] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-13T19:53:11.457082] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T19:53:11.617959] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-13T19:53:12.181329] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-13T19:53:12.417987] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-13T19:53:13.217925] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-13T19:53:14.017899] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-13T19:53:14.229523] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-13T19:53:14.818012] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-13T19:53:14.849326] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-13T19:53:15.618024] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-13T19:53:15.692117] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-13T19:53:16.417951] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-13T19:53:16.686968] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-13T19:53:16.708787] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T19:53:16.712905] [INFO ] [REMOTE ] KW: Full fetch complete (57055 records). [2025-10-13T19:53:16.713057] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-13T19:53:17.104942] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-13T19:53:17.105019] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-13T19:53:17.105907] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-13T19:53:17.105975] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-13T19:53:17.107392] [DEBUG] [LOCAL ] KW: Trimmed 57055 records to 40483 (keeping 200 days of data) [2025-10-13T19:53:17.218078] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-13T19:53:17.351859] [DEBUG] [LOCAL ] KW: Primary data saved (40483 records). [2025-10-13T19:53:17.351994] [INFO ] [MAIN ] KW: Full history saved. [2025-10-13T19:53:17.352075] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KW took 28.8s. Estimated remaining: 2h 40m 58s. Rate: 7.1 symbols/min [2025-10-13T19:53:17.440046] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-13T19:53:17.538006] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:17.556890] [DEBUG] [LOCAL ] KWR: Loaded 16404 existing records from primary storage. [2025-10-13T19:53:17.557129] [INFO ] [MAIN ] KWR: Loaded 16404 existing records. [2025-10-13T19:53:17.737561] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:17.737827] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-13T19:53:17.737877] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-13T19:53:17.738290] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-13T19:53:17.738348] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-13T19:53:18.019362] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-13T19:53:18.118454] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:18.114856] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T19:53:18.124254] [INFO ] [REMOTE ] KVUE: Full fetch complete (77674 records). [2025-10-13T19:53:18.124347] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-13T19:53:18.531836] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-13T19:53:18.531937] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-13T19:53:18.533375] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-13T19:53:18.533442] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-13T19:53:18.535523] [DEBUG] [LOCAL ] KVUE: Trimmed 77674 records to 53667 (keeping 200 days of data) [2025-10-13T19:53:18.843020] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-13T19:53:18.902214] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-13T19:53:18.902435] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-13T19:53:18.902546] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KVUE took 36.5s. Estimated remaining: 2h 40m 43s. Rate: 7.1 symbols/min [2025-10-13T19:53:19.085349] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:19.119604] [DEBUG] [LOCAL ] KYN: Loaded 30600 existing records from primary storage. [2025-10-13T19:53:19.120043] [INFO ] [MAIN ] KYN: Loaded 30600 existing records. [2025-10-13T19:53:19.316161] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:19.316495] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-13T19:53:19.316550] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-13T19:53:19.317688] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-13T19:53:19.317774] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-13T19:53:19.621424] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-13T19:53:19.709023] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:19.794038] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-13T19:53:19.804550] [INFO ] [REMOTE ] KVYO: Full fetch complete (71819 records). [2025-10-13T19:53:19.804787] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-13T19:53:19.805663] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-13T19:53:19.832798] [INFO ] [REMOTE ] KUKE: Full fetch complete (8863 records). [2025-10-13T19:53:19.876839] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-13T19:53:20.283678] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-13T19:53:20.305517] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-13T19:53:20.326545] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-13T19:53:20.344985] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-13T19:53:20.365217] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-13T19:53:20.379772] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-13T19:53:20.384727] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-13T19:53:20.402231] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-13T19:53:20.402479] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-13T19:53:20.402423] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KUKE took 40.2s. Estimated remaining: 2h 40m 28s. Rate: 7.1 symbols/min [2025-10-13T19:53:20.403481] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-13T19:53:20.408861] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-13T19:53:20.426988] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-13T19:53:20.511928] [DEBUG] [LOCAL ] KVYO: Trimmed 71819 records to 50682 (keeping 200 days of data) [2025-10-13T19:53:20.666623] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:20.696745] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T19:53:20.736476] [DEBUG] [LOCAL ] L: Loaded 41622 existing records from primary storage. [2025-10-13T19:53:20.737817] [INFO ] [MAIN ] L: Loaded 41622 existing records. [2025-10-13T19:53:21.017615] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:21.018414] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-13T19:53:21.019059] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-13T19:53:21.020195] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-13T19:53:21.020268] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-13T19:53:21.218543] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-13T19:53:21.454466] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:21.461518] [DEBUG] [LOCAL ] KVYO: Primary data saved (50682 records). [2025-10-13T19:53:21.461683] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-13T19:53:21.461787] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KVYO took 37.4s. Estimated remaining: 2h 40m 13s. Rate: 7.1 symbols/min [2025-10-13T19:53:21.629523] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:21.681464] [DEBUG] [LOCAL ] LAC: Loaded 53223 existing records from primary storage. [2025-10-13T19:53:21.681846] [INFO ] [MAIN ] LAC: Loaded 53223 existing records. [2025-10-13T19:53:21.890765] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:21.891096] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-13T19:53:21.891321] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-13T19:53:21.892078] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-13T19:53:21.892143] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-13T19:53:22.021873] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-13T19:53:22.063574] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-13T19:53:22.293009] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:22.331301] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-13T19:53:22.817992] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-13T19:53:23.425915] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-13T19:53:23.617953] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-13T19:53:24.287238] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-13T19:53:24.417983] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-13T19:53:25.111603] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-13T19:53:25.218024] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-13T19:53:26.017924] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-13T19:53:26.442217] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T19:53:26.605261] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-13T19:53:26.818023] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-13T19:53:27.036788] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-13T19:53:27.617984] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-13T19:53:28.106461] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T19:53:28.417966] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-13T19:53:29.217978] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-13T19:53:29.534004] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-13T19:53:29.581351] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-13T19:53:30.017951] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-13T19:53:30.753469] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-13T19:53:30.817965] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-13T19:53:31.473774] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-13T19:53:31.617967] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-13T19:53:32.330494] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-13T19:53:32.417913] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-13T19:53:33.218025] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-13T19:53:33.426251] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T19:53:33.979319] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:53:34.017883] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-13T19:53:34.331720] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-13T19:53:34.817971] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-13T19:53:35.617898] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-13T19:53:35.980272] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-13T19:53:36.261336] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-13T19:53:36.417891] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-13T19:53:36.672755] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T19:53:37.217947] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-13T19:53:37.883793] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-13T19:53:38.017911] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-13T19:53:38.533459] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-13T19:53:38.817955] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-13T19:53:39.565771] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-13T19:53:39.617885] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-13T19:53:39.828943] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-13T19:53:40.417947] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-13T19:53:41.055817] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-13T19:53:41.217891] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-13T19:53:41.448106] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-13T19:53:42.017949] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-13T19:53:42.776866] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-13T19:53:42.817883] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-13T19:53:43.266500] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-13T19:53:43.617960] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-13T19:53:44.148436] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-13T19:53:44.153354] [INFO ] [REMOTE ] L: Full fetch complete (59225 records). [2025-10-13T19:53:44.153743] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-13T19:53:44.421689] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-13T19:53:44.536374] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-13T19:53:44.536462] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-13T19:53:44.537356] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-13T19:53:44.537422] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-13T19:53:44.538767] [DEBUG] [LOCAL ] L: Trimmed 59225 records to 41080 (keeping 200 days of data) [2025-10-13T19:53:44.681429] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-13T19:53:44.811901] [DEBUG] [LOCAL ] L: Primary data saved (41080 records). [2025-10-13T19:53:44.812036] [INFO ] [MAIN ] L: Full history saved. [2025-10-13T19:53:44.812179] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. L took 24.4s. Estimated remaining: 2h 40m 18s. Rate: 7.1 symbols/min [2025-10-13T19:53:44.976148] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:45.000588] [DEBUG] [LOCAL ] LAD: Loaded 23862 existing records from primary storage. [2025-10-13T19:53:45.000898] [INFO ] [MAIN ] LAD: Loaded 23862 existing records. [2025-10-13T19:53:45.172990] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:45.173249] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-13T19:53:45.173297] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-13T19:53:45.173919] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-13T19:53:45.173989] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-13T19:53:45.226596] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-13T19:53:45.543214] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:45.589564] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-13T19:53:45.844132] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T19:53:46.017974] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-13T19:53:46.818003] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-13T19:53:47.617972] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-13T19:53:47.724933] [DEBUG] [REMOTE ] LAD: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-13T19:53:47.725252] [WARN ] [REMOTE ] LAD: No data returned for month 2024-12 [2025-10-13T19:53:47.725341] [FATAL] [REMOTE ] LAD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:53:47.725388] [FATAL] [MAIN ] LAD: Failed to fetch primary data. [2025-10-13T19:53:47.725447] [WARN ] [MAIN ] LAD: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:53:47.725522] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-13T19:53:47.725586] [DEBUG] [LOCAL ] LAD: No primary data file found to delete. [2025-10-13T19:53:47.725622] [INFO ] [LOCAL ] LAD: Starting deletion of derivative data. [2025-10-13T19:53:47.725859] [DEBUG] [LOCAL ] LAD: Deleted derivative data file. [2025-10-13T19:53:47.725963] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. LAD took 2.9s. Estimated remaining: 2h 40m 5s. Rate: 7.1 symbols/min [2025-10-13T19:53:47.913931] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:47.972184] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-13T19:53:47.999603] [DEBUG] [LOCAL ] LADR: Loaded 39783 existing records from primary storage. [2025-10-13T19:53:47.999979] [INFO ] [MAIN ] LADR: Loaded 39783 existing records. [2025-10-13T19:53:48.198165] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:48.198605] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-13T19:53:48.198886] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-13T19:53:48.199854] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-13T19:53:48.199918] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-13T19:53:48.328881] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T19:53:48.423033] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-13T19:53:48.609015] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:49.217956] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-13T19:53:50.017923] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-13T19:53:50.409946] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-13T19:53:50.458777] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T19:53:50.817916] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-13T19:53:51.212019] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-13T19:53:51.617961] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-13T19:53:52.417972] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-13T19:53:52.433833] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-13T19:53:52.435717] [INFO ] [REMOTE ] KWR: Full fetch complete (23676 records). [2025-10-13T19:53:52.435815] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-13T19:53:52.862440] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-13T19:53:52.912507] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-13T19:53:52.912944] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-13T19:53:52.913612] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-13T19:53:52.913714] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-13T19:53:52.914420] [DEBUG] [LOCAL ] KWR: Trimmed 23676 records to 16178 (keeping 200 days of data) [2025-10-13T19:53:53.024562] [DEBUG] [LOCAL ] KWR: Primary data saved (16178 records). [2025-10-13T19:53:53.024747] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-13T19:53:53.024863] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. KWR took 35.7s. Estimated remaining: 2h 39m 53s. Rate: 7.1 symbols/min [2025-10-13T19:53:53.219147] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-13T19:53:53.219064] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:53.225105] [DEBUG] [LOCAL ] LANV: Loaded 2845 existing records from primary storage. [2025-10-13T19:53:53.225462] [INFO ] [MAIN ] LANV: Loaded 2845 existing records. [2025-10-13T19:53:53.433783] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:53:53.434133] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-13T19:53:53.434186] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-13T19:53:53.434390] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-13T19:53:53.434433] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-13T19:53:53.592008] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-13T19:53:53.691133] [INFO ] [REMOTE ] KYN: Full fetch complete (44348 records). [2025-10-13T19:53:53.718411] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-13T19:53:54.023398] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:54.050340] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-13T19:53:54.257744] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-13T19:53:54.257833] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-13T19:53:54.258738] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-13T19:53:54.258801] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-13T19:53:54.259843] [DEBUG] [LOCAL ] KYN: Trimmed 44348 records to 30165 (keeping 200 days of data) [2025-10-13T19:53:54.442438] [DEBUG] [LOCAL ] KYN: Primary data saved (30165 records). [2025-10-13T19:53:54.442571] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-13T19:53:54.442683] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. KYN took 35.5s. Estimated remaining: 2h 39m 39s. Rate: 7.1 symbols/min [2025-10-13T19:53:54.610154] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:53:54.610342] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-13T19:53:54.610398] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-13T19:53:54.610530] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-13T19:53:54.610603] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-13T19:53:54.610676] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-13T19:53:54.610732] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-13T19:53:54.828505] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-13T19:53:54.967697] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:53:55.447784] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-13T19:53:55.605263] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T19:53:55.617871] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-13T19:53:55.707574] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-13T19:53:56.417971] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-13T19:53:56.615961] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-13T19:53:56.616282] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-13T19:53:56.616375] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:53:56.616421] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-13T19:53:56.616454] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:53:56.616517] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-13T19:53:56.616579] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-13T19:53:56.616614] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-13T19:53:56.616685] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-13T19:53:56.616751] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LAR took 2.2s. Estimated remaining: 2h 39m 24s. Rate: 7.1 symbols/min [2025-10-13T19:53:56.919508] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-13T19:53:57.217976] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-13T19:53:58.017956] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-13T19:53:58.632075] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-13T19:53:58.817955] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-13T19:53:59.196103] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T19:53:59.617915] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-13T19:53:59.828895] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-13T19:54:00.418028] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-13T19:54:01.217978] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-13T19:54:01.565708] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-13T19:54:01.626629] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T19:54:01.688184] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-13T19:54:02.018069] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-13T19:54:02.818043] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-13T19:54:03.386712] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-13T19:54:03.617977] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-13T19:54:04.400629] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-13T19:54:04.406567] [INFO ] [REMOTE ] LAC: Full fetch complete (76007 records). [2025-10-13T19:54:04.406980] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-13T19:54:04.441557] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-13T19:54:04.805544] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-13T19:54:04.805626] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-13T19:54:04.806599] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-13T19:54:04.806678] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-13T19:54:04.808464] [DEBUG] [LOCAL ] LAC: Trimmed 76007 records to 52482 (keeping 200 days of data) [2025-10-13T19:54:04.984362] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-13T19:54:05.095304] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-13T19:54:05.147503] [DEBUG] [LOCAL ] LAC: Primary data saved (52482 records). [2025-10-13T19:54:05.147662] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-13T19:54:05.147799] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAC took 43.7s. Estimated remaining: 2h 39m 16s. Rate: 7.1 symbols/min [2025-10-13T19:54:05.217978] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-13T19:54:06.018005] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-13T19:54:06.400870] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-13T19:54:06.642880] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-13T19:54:06.817912] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-13T19:54:07.617975] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-13T19:54:08.051569] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-13T19:54:08.423016] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-13T19:54:08.439576] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-13T19:54:08.756853] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-13T19:54:09.218008] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-13T19:54:10.018018] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-13T19:54:10.607834] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-13T19:54:10.634867] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-13T19:54:10.818034] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-13T19:54:11.617987] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-13T19:54:12.272809] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-13T19:54:12.301985] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-13T19:54:12.417915] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-13T19:54:13.218070] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-13T19:54:13.845821] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-13T19:54:13.853056] [INFO ] [REMOTE ] LADR: Full fetch complete (55526 records). [2025-10-13T19:54:13.853186] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-13T19:54:13.853385] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-13T19:54:13.854398] [INFO ] [REMOTE ] LANV: Full fetch complete (4323 records). [2025-10-13T19:54:13.854589] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-13T19:54:14.619957] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-13T19:54:14.634849] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-13T19:54:14.635137] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-13T19:54:14.645583] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-13T19:54:14.656453] [DEBUG] [LOCAL ] LANV: Trimmed 4323 records to 2815 (keeping 200 days of data) [2025-10-13T19:54:14.704607] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-13T19:54:14.708586] [DEBUG] [LOCAL ] LANV: Primary data saved (2815 records). [2025-10-13T19:54:14.708888] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-13T19:54:14.708815] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-13T19:54:14.709068] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LANV took 21.7s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-13T19:54:14.710032] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-13T19:54:14.710262] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-13T19:54:14.711618] [DEBUG] [LOCAL ] LADR: Trimmed 55526 records to 39324 (keeping 200 days of data) [2025-10-13T19:54:14.953480] [DEBUG] [LOCAL ] LADR: Primary data saved (39324 records). [2025-10-13T19:54:14.953674] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-13T19:54:14.953777] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LADR took 27.2s. Estimated remaining: 2h 38m 53s. Rate: 7.1 symbols/min [2025-10-13T19:54:15.591627] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:15.642207] [DEBUG] [LOCAL ] LBRT: No existing data file found in primary storage. [2025-10-13T19:54:15.684299] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:15.718577] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:15.739955] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:15.735410] [WARN ] [MAIN ] LBRT: No existing data found, performing full refresh instead. [2025-10-13T19:54:15.741707] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-13T19:54:15.741949] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-13T19:54:15.742054] [DEBUG] [LOCAL ] LBRT: No primary data file found to delete. [2025-10-13T19:54:15.742115] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-13T19:54:15.868500] [DEBUG] [LOCAL ] LAW: Loaded 14516 existing records from primary storage. [2025-10-13T19:54:15.904129] [INFO ] [MAIN ] LAW: Loaded 14516 existing records. [2025-10-13T19:54:16.099986] [DEBUG] [LOCAL ] LB: Loaded 38235 existing records from primary storage. [2025-10-13T19:54:16.161137] [INFO ] [MAIN ] LB: Loaded 38235 existing records. [2025-10-13T19:54:16.220231] [DEBUG] [LOCAL ] LAZ: Loaded 45361 existing records from primary storage. [2025-10-13T19:54:16.329322] [INFO ] [MAIN ] LAZ: Loaded 45361 existing records. [2025-10-13T19:54:16.436748] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:16.479135] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-13T19:54:16.530944] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-13T19:54:16.594946] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-13T19:54:16.633945] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-13T19:54:16.837247] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:16.833624] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:16.884404] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:16.899012] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-13T19:54:16.898926] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-13T19:54:16.919927] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-13T19:54:16.935023] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-13T19:54:16.935168] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-13T19:54:16.940837] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-13T19:54:16.940967] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-13T19:54:16.961628] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-13T19:54:16.975674] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-13T19:54:17.720719] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:17.820231] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-13T19:54:18.007795] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:18.012272] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-13T19:54:18.011948] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:18.013454] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-13T19:54:18.779579] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-13T19:54:18.790067] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-13T19:54:18.956033] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-13T19:54:18.959864] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-13T19:54:19.214858] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-13T19:54:19.222951] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-13T19:54:19.748679] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T19:54:19.757371] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-13T19:54:19.788465] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-13T19:54:20.417909] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-13T19:54:20.529454] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-13T19:54:20.769192] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-13T19:54:20.964203] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-13T19:54:21.217986] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-13T19:54:21.431902] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T19:54:22.017960] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-13T19:54:22.745449] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-13T19:54:22.817908] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-13T19:54:23.529998] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T19:54:23.617905] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-13T19:54:24.417974] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-13T19:54:24.561076] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-13T19:54:24.581997] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-13T19:54:25.217926] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-13T19:54:25.949441] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-13T19:54:26.017918] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-13T19:54:26.066805] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-13T19:54:26.817960] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-13T19:54:27.498358] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-13T19:54:27.618043] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-13T19:54:28.417975] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-13T19:54:28.494045] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-13T19:54:28.784566] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-13T19:54:29.217994] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-13T19:54:30.017996] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-13T19:54:30.075551] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-13T19:54:30.794239] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-13T19:54:30.817901] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-13T19:54:30.905114] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-13T19:54:31.617915] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-13T19:54:32.379147] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:54:32.417962] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-13T19:54:33.146225] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-13T19:54:33.217921] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-13T19:54:33.343638] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-13T19:54:34.018021] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-13T19:54:34.817960] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-13T19:54:35.034737] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-13T19:54:35.433010] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-13T19:54:35.617974] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-13T19:54:35.715141] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-13T19:54:36.417985] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-13T19:54:37.219213] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-13T19:54:37.218011] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-13T19:54:37.917581] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T19:54:38.018028] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-13T19:54:38.817953] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-13T19:54:38.956534] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-13T19:54:39.381822] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-13T19:54:39.617993] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-13T19:54:39.743544] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-13T19:54:40.417986] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-13T19:54:41.217960] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-13T19:54:41.320021] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-13T19:54:41.431887] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-13T19:54:41.434530] [INFO ] [REMOTE ] LAW: Full fetch complete (20767 records). [2025-10-13T19:54:41.434687] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-13T19:54:41.847018] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-13T19:54:41.847100] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-13T19:54:41.847758] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-13T19:54:41.847823] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-13T19:54:41.848772] [DEBUG] [LOCAL ] LAW: Trimmed 20767 records to 14500 (keeping 200 days of data) [2025-10-13T19:54:41.934173] [DEBUG] [LOCAL ] LAW: Primary data saved (14500 records). [2025-10-13T19:54:41.934378] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-13T19:54:41.934483] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 27.0s. Estimated remaining: 2h 39m 1s. Rate: 7.1 symbols/min [2025-10-13T19:54:42.026328] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-13T19:54:42.115861] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:42.164712] [DEBUG] [LOCAL ] LC: Loaded 48680 existing records from primary storage. [2025-10-13T19:54:42.165109] [INFO ] [MAIN ] LC: Loaded 48680 existing records. [2025-10-13T19:54:42.355256] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:42.355604] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-13T19:54:42.355880] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-13T19:54:42.357089] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-13T19:54:42.357156] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-13T19:54:42.545713] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-13T19:54:42.773680] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:42.817985] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-13T19:54:43.529384] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-13T19:54:43.618011] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-13T19:54:44.417922] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-13T19:54:44.456471] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-13T19:54:45.024492] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-13T19:54:45.030177] [INFO ] [REMOTE ] LAZ: Full fetch complete (65579 records). [2025-10-13T19:54:45.030300] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-13T19:54:45.226804] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-13T19:54:45.431025] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-13T19:54:45.431139] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-13T19:54:45.432233] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-13T19:54:45.432297] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-13T19:54:45.434269] [DEBUG] [LOCAL ] LAZ: Trimmed 65579 records to 44790 (keeping 200 days of data) [2025-10-13T19:54:45.736083] [DEBUG] [LOCAL ] LAZ: Primary data saved (44790 records). [2025-10-13T19:54:45.736285] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-13T19:54:45.736402] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LAZ took 30.8s. Estimated remaining: 2h 38m 49s. Rate: 7.1 symbols/min [2025-10-13T19:54:45.923369] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:45.953387] [DEBUG] [LOCAL ] LCII: Loaded 27968 existing records from primary storage. [2025-10-13T19:54:45.953772] [INFO ] [MAIN ] LCII: Loaded 27968 existing records. [2025-10-13T19:54:46.018830] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-13T19:54:46.150186] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:46.150737] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-13T19:54:46.150908] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-13T19:54:46.151804] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-13T19:54:46.151872] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-13T19:54:46.415237] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-13T19:54:46.577035] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:46.738292] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-13T19:54:46.817961] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-13T19:54:47.617974] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-13T19:54:47.741202] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-13T19:54:48.417911] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-13T19:54:48.667687] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-13T19:54:48.695297] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-13T19:54:49.217975] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-13T19:54:50.028683] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-13T19:54:50.035486] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-13T19:54:50.274332] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-13T19:54:50.817905] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-13T19:54:51.589949] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-13T19:54:51.617885] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-13T19:54:51.788392] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-13T19:54:51.794672] [INFO ] [REMOTE ] LBRT: Full fetch complete (76648 records). [2025-10-13T19:54:51.794852] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-13T19:54:52.195352] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-13T19:54:52.195446] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-13T19:54:52.196659] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-13T19:54:52.196726] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-13T19:54:52.198715] [DEBUG] [LOCAL ] LBRT: Trimmed 76648 records to 52952 (keeping 200 days of data) [2025-10-13T19:54:52.424916] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-13T19:54:52.546792] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-13T19:54:52.578183] [DEBUG] [LOCAL ] LBRT: Primary data saved (52952 records). [2025-10-13T19:54:52.578386] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-13T19:54:52.578476] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LBRT took 37.6s. Estimated remaining: 2h 38m 39s. Rate: 7.1 symbols/min [2025-10-13T19:54:52.754616] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:52.797083] [DEBUG] [LOCAL ] LDI: Loaded 45259 existing records from primary storage. [2025-10-13T19:54:52.797472] [INFO ] [MAIN ] LDI: Loaded 45259 existing records. [2025-10-13T19:54:52.979135] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:52.979485] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-13T19:54:52.979536] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-13T19:54:52.980600] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-13T19:54:52.980696] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-13T19:54:53.225589] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-13T19:54:53.356326] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:53.995239] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-13T19:54:54.017897] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-13T19:54:54.672476] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-13T19:54:54.818047] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-13T19:54:55.481224] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-13T19:54:55.617967] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-13T19:54:56.128736] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-13T19:54:56.133371] [INFO ] [REMOTE ] LB: Full fetch complete (55968 records). [2025-10-13T19:54:56.133490] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-13T19:54:56.423178] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-13T19:54:56.589219] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-13T19:54:56.589358] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-13T19:54:56.590425] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-13T19:54:56.590491] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-13T19:54:56.593129] [DEBUG] [LOCAL ] LB: Trimmed 55968 records to 37646 (keeping 200 days of data) [2025-10-13T19:54:56.832828] [DEBUG] [LOCAL ] LB: Primary data saved (37646 records). [2025-10-13T19:54:56.833121] [INFO ] [MAIN ] LB: Full history saved. [2025-10-13T19:54:56.833375] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LB took 41.9s. Estimated remaining: 2h 38m 26s. Rate: 7.1 symbols/min [2025-10-13T19:54:57.026691] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:54:57.028968] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-13T19:54:57.079766] [DEBUG] [LOCAL ] LDOS: Loaded 45881 existing records from primary storage. [2025-10-13T19:54:57.080112] [INFO ] [MAIN ] LDOS: Loaded 45881 existing records. [2025-10-13T19:54:57.230851] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-13T19:54:57.277725] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:54:57.278506] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-13T19:54:57.278594] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-13T19:54:57.280251] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-13T19:54:57.280430] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-13T19:54:57.640617] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:54:58.018332] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-13T19:54:58.018468] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-13T19:54:58.211278] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T19:54:58.818078] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-13T19:54:59.617321] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-13T19:54:59.627083] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-13T19:55:00.377956] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-13T19:55:00.418046] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-13T19:55:01.217977] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-13T19:55:01.467798] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-13T19:55:02.017962] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-13T19:55:02.165373] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-13T19:55:02.817912] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-13T19:55:02.856369] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-13T19:55:03.527153] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-13T19:55:03.617994] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-13T19:55:04.130597] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-13T19:55:04.417992] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-13T19:55:04.896596] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-13T19:55:05.218012] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-13T19:55:05.690613] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-13T19:55:06.017905] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-13T19:55:06.817907] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-13T19:55:06.983910] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-13T19:55:07.574511] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T19:55:07.617891] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-13T19:55:07.741247] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-13T19:55:08.417984] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-13T19:55:09.217903] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-13T19:55:09.350638] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-13T19:55:09.654283] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-13T19:55:10.017951] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-13T19:55:10.309687] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-13T19:55:10.817966] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-13T19:55:11.617961] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-13T19:55:11.780196] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-13T19:55:11.845626] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T19:55:12.417921] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-13T19:55:12.672122] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-13T19:55:13.217969] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-13T19:55:14.017950] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-13T19:55:14.300764] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-13T19:55:14.817969] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-13T19:55:14.943368] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-13T19:55:15.495123] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-13T19:55:15.618013] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-13T19:55:16.417901] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-13T19:55:16.500401] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-13T19:55:17.217978] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-13T19:55:17.268891] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-13T19:55:17.834176] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-13T19:55:17.839491] [INFO ] [REMOTE ] LC: Full fetch complete (70492 records). [2025-10-13T19:55:17.839622] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-13T19:55:18.021613] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-13T19:55:18.258901] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-13T19:55:18.259022] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-13T19:55:18.260077] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-13T19:55:18.260149] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-13T19:55:18.261831] [DEBUG] [LOCAL ] LC: Trimmed 70492 records to 48079 (keeping 200 days of data) [2025-10-13T19:55:18.563091] [DEBUG] [LOCAL ] LC: Primary data saved (48079 records). [2025-10-13T19:55:18.563244] [INFO ] [MAIN ] LC: Full history saved. [2025-10-13T19:55:18.563333] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LC took 36.6s. Estimated remaining: 2h 38m 30s. Rate: 7.1 symbols/min [2025-10-13T19:55:18.738745] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:18.752431] [DEBUG] [LOCAL ] LDP: Loaded 13106 existing records from primary storage. [2025-10-13T19:55:18.752794] [INFO ] [MAIN ] LDP: Loaded 13106 existing records. [2025-10-13T19:55:18.826415] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-13T19:55:18.947582] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:18.948076] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-13T19:55:18.948269] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-13T19:55:18.949068] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-13T19:55:18.949293] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-13T19:55:19.128396] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T19:55:19.354387] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:19.617927] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-13T19:55:19.904474] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-13T19:55:20.421934] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-13T19:55:20.423905] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-13T19:55:20.746223] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T19:55:21.217962] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-13T19:55:21.435543] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-13T19:55:22.017979] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-13T19:55:22.307237] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-13T19:55:22.310020] [INFO ] [REMOTE ] LCII: Full fetch complete (39052 records). [2025-10-13T19:55:22.310121] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-13T19:55:22.676509] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-13T19:55:22.676583] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-13T19:55:22.677215] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-13T19:55:22.677321] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-13T19:55:22.678273] [DEBUG] [LOCAL ] LCII: Trimmed 39052 records to 27562 (keeping 200 days of data) [2025-10-13T19:55:22.825099] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-13T19:55:22.853536] [DEBUG] [LOCAL ] LCII: Primary data saved (27562 records). [2025-10-13T19:55:22.853636] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-13T19:55:22.853767] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LCII took 37.1s. Estimated remaining: 2h 38m 18s. Rate: 7.1 symbols/min [2025-10-13T19:55:22.991766] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-13T19:55:23.044681] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:23.081825] [DEBUG] [LOCAL ] LEA: Loaded 42180 existing records from primary storage. [2025-10-13T19:55:23.082133] [INFO ] [MAIN ] LEA: Loaded 42180 existing records. [2025-10-13T19:55:23.253045] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:23.253238] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-13T19:55:23.253306] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-13T19:55:23.254348] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-13T19:55:23.254408] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-13T19:55:23.610217] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:23.617895] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-13T19:55:24.418037] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-13T19:55:25.152688] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-13T19:55:25.158529] [INFO ] [REMOTE ] LDI: Full fetch complete (61402 records). [2025-10-13T19:55:25.158690] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-13T19:55:25.222692] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-13T19:55:25.492332] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-13T19:55:25.599053] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-13T19:55:25.599156] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-13T19:55:25.600071] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-13T19:55:25.600183] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-13T19:55:25.601717] [DEBUG] [LOCAL ] LDI: Trimmed 61402 records to 44727 (keeping 200 days of data) [2025-10-13T19:55:25.736421] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-13T19:55:25.901425] [DEBUG] [LOCAL ] LDI: Primary data saved (44727 records). [2025-10-13T19:55:25.901572] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-13T19:55:25.901695] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDI took 33.3s. Estimated remaining: 2h 38m 5s. Rate: 7.1 symbols/min [2025-10-13T19:55:26.020041] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-13T19:55:26.074004] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:26.093967] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-13T19:55:26.131285] [DEBUG] [LOCAL ] LEG: Loaded 50914 existing records from primary storage. [2025-10-13T19:55:26.131590] [INFO ] [MAIN ] LEG: Loaded 50914 existing records. [2025-10-13T19:55:26.302252] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:26.302469] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-13T19:55:26.302557] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-13T19:55:26.303336] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-13T19:55:26.303403] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-13T19:55:26.649770] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:26.817945] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-13T19:55:27.593992] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-13T19:55:27.617885] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-13T19:55:28.417900] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-13T19:55:28.449545] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T19:55:29.166979] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-13T19:55:29.171448] [INFO ] [REMOTE ] LDOS: Full fetch complete (67177 records). [2025-10-13T19:55:29.171560] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-13T19:55:29.225354] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-13T19:55:29.576333] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-13T19:55:29.576420] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-13T19:55:29.577328] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-13T19:55:29.577392] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-13T19:55:29.578779] [DEBUG] [LOCAL ] LDOS: Trimmed 67177 records to 45172 (keeping 200 days of data) [2025-10-13T19:55:29.868385] [DEBUG] [LOCAL ] LDOS: Primary data saved (45172 records). [2025-10-13T19:55:29.868535] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-13T19:55:29.868622] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 33.0s. Estimated remaining: 2h 37m 52s. Rate: 7.1 symbols/min [2025-10-13T19:55:30.027753] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-13T19:55:30.055219] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:30.086922] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-13T19:55:30.153510] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-13T19:55:30.153113] [DEBUG] [LOCAL ] LEN: Loaded 53950 existing records from primary storage. [2025-10-13T19:55:30.157240] [INFO ] [MAIN ] LEN: Loaded 53950 existing records. [2025-10-13T19:55:30.341282] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:30.341549] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-13T19:55:30.341597] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-13T19:55:30.342956] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-13T19:55:30.343046] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-13T19:55:30.708381] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:30.817951] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-13T19:55:31.618037] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-13T19:55:31.706232] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-13T19:55:32.417902] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-13T19:55:32.599743] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-13T19:55:32.638753] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-13T19:55:33.217946] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-13T19:55:33.997205] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-13T19:55:34.017899] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-13T19:55:34.422514] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-13T19:55:34.817955] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-13T19:55:35.617902] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-13T19:55:35.733438] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-13T19:55:35.972369] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-13T19:55:36.417925] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-13T19:55:37.217909] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-13T19:55:37.290392] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-13T19:55:37.896545] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-13T19:55:38.017978] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-13T19:55:38.177415] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-13T19:55:38.817947] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-13T19:55:39.617973] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-13T19:55:39.815924] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-13T19:55:40.417973] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-13T19:55:40.724306] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-13T19:55:40.955699] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-13T19:55:41.217923] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-13T19:55:41.263687] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-13T19:55:41.871960] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-13T19:55:42.017979] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-13T19:55:42.817995] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-13T19:55:43.617967] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-13T19:55:43.948982] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-13T19:55:44.417958] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-13T19:55:44.508110] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-13T19:55:45.173801] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-13T19:55:45.217965] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-13T19:55:46.018113] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-13T19:55:46.320860] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-13T19:55:46.321955] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-13T19:55:46.817949] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-13T19:55:47.618013] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-13T19:55:47.702150] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-13T19:55:47.705937] [INFO ] [REMOTE ] LDP: Full fetch complete (18983 records). [2025-10-13T19:55:47.706175] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-13T19:55:47.710755] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-13T19:55:48.242075] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-13T19:55:48.242228] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-13T19:55:48.242765] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-13T19:55:48.242830] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-13T19:55:48.243465] [DEBUG] [LOCAL ] LDP: Trimmed 18983 records to 12892 (keeping 200 days of data) [2025-10-13T19:55:48.340530] [DEBUG] [LOCAL ] LDP: Primary data saved (12892 records). [2025-10-13T19:55:48.340671] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-13T19:55:48.340863] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDP took 29.8s. Estimated remaining: 2h 37m 53s. Rate: 7.1 symbols/min [2025-10-13T19:55:48.423048] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-13T19:55:48.522584] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:48.540607] [DEBUG] [LOCAL ] LEO: Loaded 17099 existing records from primary storage. [2025-10-13T19:55:48.540903] [INFO ] [MAIN ] LEO: Loaded 17099 existing records. [2025-10-13T19:55:48.720222] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:48.720434] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-13T19:55:48.720497] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-13T19:55:48.721111] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-13T19:55:48.721182] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-13T19:55:49.089326] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:49.119228] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-13T19:55:49.217965] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-13T19:55:49.331011] [DEBUG] [REMOTE ] LEO: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-13T19:55:49.331331] [WARN ] [REMOTE ] LEO: No data returned for month 2024-12 [2025-10-13T19:55:49.331421] [FATAL] [REMOTE ] LEO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:55:49.331467] [FATAL] [MAIN ] LEO: Failed to fetch primary data. [2025-10-13T19:55:49.331499] [WARN ] [MAIN ] LEO: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:55:49.331535] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-13T19:55:49.331586] [DEBUG] [LOCAL ] LEO: No primary data file found to delete. [2025-10-13T19:55:49.331621] [INFO ] [LOCAL ] LEO: Starting deletion of derivative data. [2025-10-13T19:55:49.331877] [DEBUG] [LOCAL ] LEO: Deleted derivative data file. [2025-10-13T19:55:49.331981] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEO took 1.0s. Estimated remaining: 2h 37m 38s. Rate: 7.1 symbols/min [2025-10-13T19:55:49.496463] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:55:49.546238] [DEBUG] [LOCAL ] LEVI: Loaded 52452 existing records from primary storage. [2025-10-13T19:55:49.546538] [INFO ] [MAIN ] LEVI: Loaded 52452 existing records. [2025-10-13T19:55:49.725237] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:55:49.725441] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-13T19:55:49.725503] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-13T19:55:49.725859] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-13T19:55:49.725939] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-13T19:55:50.019336] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-13T19:55:50.104467] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:55:50.138449] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-13T19:55:50.817989] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-13T19:55:51.617924] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-13T19:55:51.863426] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-13T19:55:52.077635] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-13T19:55:52.417928] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-13T19:55:53.218013] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-13T19:55:53.284951] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-13T19:55:53.933406] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-13T19:55:54.017922] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-13T19:55:54.817896] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-13T19:55:55.216955] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T19:55:55.505520] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-13T19:55:55.617909] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-13T19:55:56.417900] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-13T19:55:56.682866] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-13T19:55:56.744734] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-13T19:55:57.217910] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-13T19:55:57.809154] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-13T19:55:58.018032] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-13T19:55:58.736401] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-13T19:55:58.817985] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-13T19:55:59.618003] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-13T19:55:59.654476] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-13T19:55:59.659989] [INFO ] [REMOTE ] LEG: Full fetch complete (72951 records). [2025-10-13T19:55:59.660158] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-13T19:56:00.044460] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-13T19:56:00.044538] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-13T19:56:00.046291] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-13T19:56:00.046354] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-13T19:56:00.048712] [DEBUG] [LOCAL ] LEG: Trimmed 72951 records to 50184 (keeping 200 days of data) [2025-10-13T19:56:00.318966] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-13T19:56:00.342319] [INFO ] [REMOTE ] LEA: Full fetch complete (60537 records). [2025-10-13T19:56:00.348806] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-13T19:56:00.424866] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-13T19:56:00.730324] [DEBUG] [LOCAL ] LEG: Primary data saved (50184 records). [2025-10-13T19:56:00.759157] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-13T19:56:00.759503] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEG took 34.9s. Estimated remaining: 2h 37m 32s. Rate: 7.1 symbols/min [2025-10-13T19:56:01.053881] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-13T19:56:01.058959] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-13T19:56:01.060285] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-13T19:56:01.058862] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:01.060500] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-13T19:56:01.063480] [DEBUG] [LOCAL ] LEA: Trimmed 60537 records to 41508 (keeping 200 days of data) [2025-10-13T19:56:01.179711] [DEBUG] [LOCAL ] LFT: Loaded 18593 existing records from primary storage. [2025-10-13T19:56:01.181887] [INFO ] [MAIN ] LFT: Loaded 18593 existing records. [2025-10-13T19:56:01.392624] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:01.394314] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-13T19:56:01.395028] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-13T19:56:01.395363] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-13T19:56:01.395733] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-13T19:56:01.909166] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:01.910469] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-13T19:56:01.982122] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-13T19:56:02.016981] [DEBUG] [LOCAL ] LEA: Primary data saved (41508 records). [2025-10-13T19:56:02.017165] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-13T19:56:02.017270] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEA took 39.2s. Estimated remaining: 2h 37m 17s. Rate: 7.1 symbols/min [2025-10-13T19:56:02.022675] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-13T19:56:02.218413] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:02.239728] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T19:56:02.260717] [DEBUG] [LOCAL ] LGI: Loaded 10159 existing records from primary storage. [2025-10-13T19:56:02.261024] [INFO ] [MAIN ] LGI: Loaded 10159 existing records. [2025-10-13T19:56:02.456195] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:02.456464] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-13T19:56:02.456514] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-13T19:56:02.456998] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-13T19:56:02.457058] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-13T19:56:02.826876] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-13T19:56:02.833483] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:02.983717] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-13T19:56:03.618052] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-13T19:56:04.385259] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-13T19:56:04.417911] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-13T19:56:04.463292] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-13T19:56:04.603817] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-13T19:56:05.214996] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-13T19:56:05.217875] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-13T19:56:06.016186] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T19:56:06.018866] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-13T19:56:06.723769] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-13T19:56:06.730342] [INFO ] [REMOTE ] LEN: Full fetch complete (77048 records). [2025-10-13T19:56:06.730588] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-13T19:56:06.823220] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-13T19:56:07.139410] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-13T19:56:07.139491] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-13T19:56:07.140464] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-13T19:56:07.140528] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-13T19:56:07.141960] [DEBUG] [LOCAL ] LEN: Trimmed 77048 records to 53175 (keeping 200 days of data) [2025-10-13T19:56:07.488026] [DEBUG] [LOCAL ] LEN: Primary data saved (53175 records). [2025-10-13T19:56:07.488195] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-13T19:56:07.488307] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEN took 37.6s. Estimated remaining: 2h 37m 6s. Rate: 7.1 symbols/min [2025-10-13T19:56:07.619501] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-13T19:56:07.618870] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-13T19:56:07.676207] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:07.711895] [DEBUG] [LOCAL ] LH: Loaded 38243 existing records from primary storage. [2025-10-13T19:56:07.712197] [INFO ] [MAIN ] LH: Loaded 38243 existing records. [2025-10-13T19:56:07.888029] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:07.888269] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-13T19:56:07.888315] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-13T19:56:07.889279] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-13T19:56:07.889337] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-13T19:56:08.251539] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:08.417887] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-13T19:56:09.217960] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-13T19:56:09.622025] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-13T19:56:09.897921] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-13T19:56:09.982111] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-13T19:56:10.017978] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-13T19:56:10.817965] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-13T19:56:11.072666] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-13T19:56:11.617973] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-13T19:56:12.297486] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-13T19:56:12.417921] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-13T19:56:13.217993] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-13T19:56:13.429217] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-13T19:56:13.479502] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-13T19:56:14.017898] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-13T19:56:14.061391] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-13T19:56:14.817925] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-13T19:56:15.617955] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-13T19:56:15.661236] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-13T19:56:15.664078] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-13T19:56:16.417961] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-13T19:56:17.127820] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-13T19:56:17.217901] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-13T19:56:17.244683] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-13T19:56:18.018034] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-13T19:56:18.817897] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-13T19:56:19.164097] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-13T19:56:19.619230] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-13T19:56:19.624233] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-13T19:56:19.678768] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-13T19:56:20.417964] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-13T19:56:21.217902] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-13T19:56:21.342940] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-13T19:56:21.374877] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-13T19:56:22.017914] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-13T19:56:22.308592] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-13T19:56:22.746632] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-13T19:56:22.817925] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-13T19:56:23.617958] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-13T19:56:24.417909] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-13T19:56:24.456944] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-13T19:56:24.455228] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-13T19:56:24.469623] [INFO ] [REMOTE ] LGI: Full fetch complete (14458 records). [2025-10-13T19:56:24.469770] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-13T19:56:24.848151] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-13T19:56:24.848237] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-13T19:56:24.848604] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-13T19:56:24.848710] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-13T19:56:24.849210] [DEBUG] [LOCAL ] LGI: Trimmed 14458 records to 10043 (keeping 200 days of data) [2025-10-13T19:56:24.911188] [DEBUG] [LOCAL ] LGI: Primary data saved (10043 records). [2025-10-13T19:56:24.911327] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-13T19:56:24.911405] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LGI took 22.9s. Estimated remaining: 2h 37m 5s. Rate: 7.1 symbols/min [2025-10-13T19:56:25.080189] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:25.124807] [DEBUG] [LOCAL ] LHX: Loaded 49289 existing records from primary storage. [2025-10-13T19:56:25.125125] [INFO ] [MAIN ] LHX: Loaded 49289 existing records. [2025-10-13T19:56:25.225492] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-13T19:56:25.308381] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:25.308626] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-13T19:56:25.308728] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-13T19:56:25.309819] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-13T19:56:25.309878] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-13T19:56:25.463214] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-13T19:56:25.688756] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:26.018018] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-13T19:56:26.817901] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-13T19:56:26.925933] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-13T19:56:27.118329] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-13T19:56:27.617915] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-13T19:56:28.417979] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-13T19:56:28.440183] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-13T19:56:28.446028] [INFO ] [REMOTE ] LEVI: Full fetch complete (74581 records). [2025-10-13T19:56:28.446150] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-13T19:56:28.831445] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-13T19:56:28.831530] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-13T19:56:28.832494] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-13T19:56:28.832557] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-13T19:56:28.834060] [DEBUG] [LOCAL ] LEVI: Trimmed 74581 records to 51716 (keeping 200 days of data) [2025-10-13T19:56:29.152840] [DEBUG] [LOCAL ] LEVI: Primary data saved (51716 records). [2025-10-13T19:56:29.152985] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-13T19:56:29.153076] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LEVI took 39.8s. Estimated remaining: 2h 36m 53s. Rate: 7.1 symbols/min [2025-10-13T19:56:29.221105] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-13T19:56:29.361802] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-13T19:56:29.365323] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:29.402974] [DEBUG] [LOCAL ] LII: Loaded 28417 existing records from primary storage. [2025-10-13T19:56:29.403280] [INFO ] [MAIN ] LII: Loaded 28417 existing records. [2025-10-13T19:56:29.586253] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:29.586464] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-13T19:56:29.586512] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-13T19:56:29.587560] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-13T19:56:29.587620] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-13T19:56:29.938275] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:30.017988] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-13T19:56:30.154894] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T19:56:30.362519] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-13T19:56:30.817928] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-13T19:56:31.560376] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-13T19:56:31.617893] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-13T19:56:31.845201] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-13T19:56:32.417983] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-13T19:56:33.142426] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-13T19:56:33.208450] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-13T19:56:33.217873] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-13T19:56:34.018066] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-13T19:56:34.122372] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-13T19:56:34.124470] [INFO ] [REMOTE ] LFT: Full fetch complete (23970 records). [2025-10-13T19:56:34.124546] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-13T19:56:34.479615] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-13T19:56:34.479725] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-13T19:56:34.480202] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-13T19:56:34.480242] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-13T19:56:34.480896] [DEBUG] [LOCAL ] LFT: Trimmed 23970 records to 18325 (keeping 200 days of data) [2025-10-13T19:56:34.588094] [DEBUG] [LOCAL ] LFT: Primary data saved (18325 records). [2025-10-13T19:56:34.588231] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-13T19:56:34.588342] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LFT took 33.8s. Estimated remaining: 2h 36m 42s. Rate: 7.1 symbols/min [2025-10-13T19:56:34.753066] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:34.793760] [DEBUG] [LOCAL ] LION: Loaded 46182 existing records from primary storage. [2025-10-13T19:56:34.794057] [INFO ] [MAIN ] LION: Loaded 46182 existing records. [2025-10-13T19:56:34.824204] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-13T19:56:34.977921] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:34.978140] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-13T19:56:34.978187] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-13T19:56:34.979124] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-13T19:56:34.979183] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-13T19:56:35.325574] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:35.617959] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-13T19:56:35.847092] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-13T19:56:36.374599] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-13T19:56:36.417893] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-13T19:56:36.603920] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-13T19:56:37.217970] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-13T19:56:37.699439] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-13T19:56:38.017981] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-13T19:56:38.527201] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-13T19:56:38.817967] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-13T19:56:39.377100] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-13T19:56:39.381028] [INFO ] [REMOTE ] LH: Full fetch complete (54883 records). [2025-10-13T19:56:39.381122] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-13T19:56:39.627449] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-13T19:56:39.714100] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-13T19:56:39.799164] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-13T19:56:39.799246] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-13T19:56:39.800120] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-13T19:56:39.800182] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-13T19:56:39.802126] [DEBUG] [LOCAL ] LH: Trimmed 54883 records to 37690 (keeping 200 days of data) [2025-10-13T19:56:40.050062] [DEBUG] [LOCAL ] LH: Primary data saved (37690 records). [2025-10-13T19:56:40.050216] [INFO ] [MAIN ] LH: Full history saved. [2025-10-13T19:56:40.050311] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 32.6s. Estimated remaining: 2h 36m 31s. Rate: 7.1 symbols/min [2025-10-13T19:56:40.227229] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:56:40.235734] [DEBUG] [LOCAL ] LITB: Loaded 4305 existing records from primary storage. [2025-10-13T19:56:40.236069] [INFO ] [MAIN ] LITB: Loaded 4305 existing records. [2025-10-13T19:56:40.423243] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-13T19:56:40.471565] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:56:40.472447] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-13T19:56:40.472524] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-13T19:56:40.472961] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-13T19:56:40.473038] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-13T19:56:41.074951] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:56:41.218002] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-13T19:56:41.435787] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-13T19:56:41.685910] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-13T19:56:41.782361] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-13T19:56:42.017962] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-13T19:56:42.570128] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-13T19:56:42.817925] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-13T19:56:43.617962] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-13T19:56:43.885407] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-13T19:56:44.417992] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-13T19:56:45.217949] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-13T19:56:45.426751] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-13T19:56:45.853731] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-13T19:56:46.017926] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-13T19:56:46.291889] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-13T19:56:46.817964] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-13T19:56:47.617898] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-13T19:56:47.784250] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-13T19:56:48.031842] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-13T19:56:48.417924] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-13T19:56:49.074572] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-13T19:56:49.217973] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-13T19:56:49.989739] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-13T19:56:50.017896] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-13T19:56:50.736485] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-13T19:56:50.817950] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-13T19:56:51.255049] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-13T19:56:51.609849] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-13T19:56:51.619395] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-13T19:56:52.417918] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-13T19:56:52.949673] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-13T19:56:53.093056] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-13T19:56:53.218003] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-13T19:56:54.017976] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-13T19:56:54.817957] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-13T19:56:55.250956] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-13T19:56:55.280831] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-13T19:56:55.571598] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-13T19:56:55.617884] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-13T19:56:56.159537] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-13T19:56:56.417998] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-13T19:56:57.217930] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-13T19:56:58.017913] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-13T19:56:58.327562] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-13T19:56:58.524128] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-13T19:56:58.623287] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-13T19:56:58.817959] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-13T19:56:59.617974] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-13T19:56:59.768366] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-13T19:57:00.417963] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-13T19:57:01.217980] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-13T19:57:01.619530] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T19:57:01.716562] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-13T19:57:02.017967] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-13T19:57:02.590353] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-13T19:57:02.817981] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-13T19:57:03.617923] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-13T19:57:03.995050] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-13T19:57:04.028584] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-13T19:57:04.031809] [INFO ] [REMOTE ] LII: Full fetch complete (41230 records). [2025-10-13T19:57:04.031888] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-13T19:57:04.126102] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-13T19:57:04.413150] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-13T19:57:04.413270] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-13T19:57:04.414453] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-13T19:57:04.414533] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-13T19:57:04.416176] [DEBUG] [LOCAL ] LII: Trimmed 41230 records to 27925 (keeping 200 days of data) [2025-10-13T19:57:04.417962] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-13T19:57:04.611045] [DEBUG] [LOCAL ] LII: Primary data saved (27925 records). [2025-10-13T19:57:04.611273] [INFO ] [MAIN ] LII: Full history saved. [2025-10-13T19:57:04.611381] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LII took 35.5s. Estimated remaining: 2h 36m 37s. Rate: 7.1 symbols/min [2025-10-13T19:57:04.793027] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:04.848159] [DEBUG] [LOCAL ] LLY: Loaded 54048 existing records from primary storage. [2025-10-13T19:57:04.848610] [INFO ] [MAIN ] LLY: Loaded 54048 existing records. [2025-10-13T19:57:05.038475] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:05.038805] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-13T19:57:05.038861] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-13T19:57:05.040201] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-13T19:57:05.040261] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-13T19:57:05.223921] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-13T19:57:05.421701] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:05.739740] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-13T19:57:06.017910] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-13T19:57:06.253364] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-13T19:57:06.817958] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-13T19:57:07.617955] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-13T19:57:08.417978] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-13T19:57:08.496722] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-13T19:57:08.538429] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-13T19:57:09.217995] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-13T19:57:09.276085] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-13T19:57:09.305155] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-13T19:57:10.017926] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-13T19:57:10.614681] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-13T19:57:10.615851] [INFO ] [REMOTE ] LITB: Full fetch complete (5663 records). [2025-10-13T19:57:10.615929] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-13T19:57:10.823255] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-13T19:57:10.997329] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-13T19:57:11.004500] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-13T19:57:11.004579] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-13T19:57:11.009161] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-13T19:57:11.009515] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-13T19:57:11.010165] [DEBUG] [LOCAL ] LITB: Trimmed 5663 records to 4216 (keeping 200 days of data) [2025-10-13T19:57:11.010081] [INFO ] [REMOTE ] LION: Full fetch complete (56611 records). [2025-10-13T19:57:11.010521] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-13T19:57:11.171292] [DEBUG] [LOCAL ] LITB: Primary data saved (4216 records). [2025-10-13T19:57:11.188230] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-13T19:57:11.188374] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LITB took 31.1s. Estimated remaining: 2h 36m 27s. Rate: 7.1 symbols/min [2025-10-13T19:57:11.550033] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:11.618904] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-13T19:57:11.638905] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-13T19:57:11.639196] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-13T19:57:11.640266] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-13T19:57:11.640384] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-13T19:57:11.643369] [DEBUG] [LOCAL ] LION: Trimmed 56611 records to 46070 (keeping 200 days of data) [2025-10-13T19:57:11.869398] [DEBUG] [LOCAL ] LMND: Loaded 52761 existing records from primary storage. [2025-10-13T19:57:11.900270] [INFO ] [MAIN ] LMND: Loaded 52761 existing records. [2025-10-13T19:57:12.091066] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:12.092785] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-13T19:57:12.092857] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-13T19:57:12.095196] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-13T19:57:12.096737] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-13T19:57:12.497087] [DEBUG] [LOCAL ] LION: Primary data saved (46070 records). [2025-10-13T19:57:12.497270] [INFO ] [MAIN ] LION: Full history saved. [2025-10-13T19:57:12.526491] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LION took 37.9s. Estimated remaining: 2h 36m 12s. Rate: 7.1 symbols/min [2025-10-13T19:57:12.526353] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:12.526952] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-13T19:57:12.711873] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:12.764898] [DEBUG] [LOCAL ] LMT: Loaded 50457 existing records from primary storage. [2025-10-13T19:57:12.765365] [INFO ] [MAIN ] LMT: Loaded 50457 existing records. [2025-10-13T19:57:12.968099] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:12.968765] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-13T19:57:12.968836] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-13T19:57:12.970549] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-13T19:57:12.970616] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-13T19:57:13.353116] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:13.353807] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-13T19:57:13.388550] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-13T19:57:13.781245] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-13T19:57:13.787012] [INFO ] [REMOTE ] LHX: Full fetch complete (70590 records). [2025-10-13T19:57:13.787290] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-13T19:57:14.042964] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-13T19:57:14.221263] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-13T19:57:14.221379] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-13T19:57:14.222905] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-13T19:57:14.222992] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-13T19:57:14.225157] [DEBUG] [LOCAL ] LHX: Trimmed 70590 records to 48591 (keeping 200 days of data) [2025-10-13T19:57:14.564568] [DEBUG] [LOCAL ] LHX: Primary data saved (48591 records). [2025-10-13T19:57:14.564836] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-13T19:57:14.564972] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LHX took 49.7s. Estimated remaining: 2h 35m 58s. Rate: 7.1 symbols/min [2025-10-13T19:57:14.746103] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:14.794957] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-13T19:57:14.830343] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-13T19:57:14.854791] [DEBUG] [LOCAL ] LNC: Loaded 52341 existing records from primary storage. [2025-10-13T19:57:14.855196] [INFO ] [MAIN ] LNC: Loaded 52341 existing records. [2025-10-13T19:57:15.036985] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:15.037229] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-13T19:57:15.037287] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-13T19:57:15.038512] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-13T19:57:15.038572] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-13T19:57:15.398039] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:15.499269] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-13T19:57:15.617925] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-13T19:57:16.417919] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-13T19:57:16.466675] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-13T19:57:16.554343] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-13T19:57:17.218000] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-13T19:57:17.251238] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-13T19:57:18.018000] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-13T19:57:18.486770] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-13T19:57:18.704701] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-13T19:57:18.817985] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-13T19:57:19.617970] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-13T19:57:20.417968] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-13T19:57:20.561475] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-13T19:57:20.853701] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-13T19:57:21.217996] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-13T19:57:21.521503] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-13T19:57:22.005108] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-13T19:57:22.017881] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-13T19:57:22.817972] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-13T19:57:23.368694] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-13T19:57:23.627206] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-13T19:57:23.633314] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-13T19:57:24.417930] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-13T19:57:25.129601] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-13T19:57:25.217978] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-13T19:57:25.530210] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-13T19:57:26.017922] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-13T19:57:26.070785] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-13T19:57:26.817986] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-13T19:57:27.492376] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-13T19:57:27.617887] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-13T19:57:27.903597] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-13T19:57:28.417999] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-13T19:57:28.462348] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:57:28.921094] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-13T19:57:29.217924] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-13T19:57:30.018004] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-13T19:57:30.818017] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-13T19:57:30.860439] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-13T19:57:30.952545] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-13T19:57:31.617988] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-13T19:57:32.066850] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-13T19:57:32.417964] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-13T19:57:32.863251] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-13T19:57:33.217928] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-13T19:57:33.335679] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-13T19:57:34.017909] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-13T19:57:34.510130] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-13T19:57:34.818022] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-13T19:57:35.141040] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-13T19:57:35.621211] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-13T19:57:35.823929] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-13T19:57:36.417927] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-13T19:57:37.064004] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-13T19:57:37.217919] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-13T19:57:38.017918] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-13T19:57:38.080627] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-13T19:57:38.126610] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-13T19:57:38.817924] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-13T19:57:39.617889] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-13T19:57:39.788269] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-13T19:57:40.077351] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-13T19:57:40.177954] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-13T19:57:40.417924] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-13T19:57:41.217926] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-13T19:57:41.434080] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-13T19:57:41.650478] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T19:57:41.655889] [INFO ] [REMOTE ] LNC: Full fetch complete (74353 records). [2025-10-13T19:57:41.655999] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-13T19:57:42.023918] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-13T19:57:42.042225] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-13T19:57:42.042302] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-13T19:57:42.044007] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-13T19:57:42.044173] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-13T19:57:42.046593] [DEBUG] [LOCAL ] LNC: Trimmed 74353 records to 51595 (keeping 200 days of data) [2025-10-13T19:57:42.367863] [DEBUG] [LOCAL ] LNC: Primary data saved (51595 records). [2025-10-13T19:57:42.368154] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-13T19:57:42.368260] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LNC took 27.8s. Estimated remaining: 2h 36m 7s. Rate: 7.1 symbols/min [2025-10-13T19:57:42.536669] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:42.543219] [DEBUG] [LOCAL ] LND: Loaded 5034 existing records from primary storage. [2025-10-13T19:57:42.543391] [INFO ] [MAIN ] LND: Loaded 5034 existing records. [2025-10-13T19:57:42.720226] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:42.720470] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-13T19:57:42.720526] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-13T19:57:42.720779] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-13T19:57:42.720838] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-13T19:57:42.827625] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-13T19:57:43.087627] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:43.617910] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-13T19:57:44.067729] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-10-13T19:57:44.146386] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-13T19:57:44.417913] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-13T19:57:44.454868] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T19:57:44.711154] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-13T19:57:44.716846] [INFO ] [REMOTE ] LMND: Full fetch complete (75341 records). [2025-10-13T19:57:44.716981] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-13T19:57:45.109498] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-13T19:57:45.109577] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-13T19:57:45.110613] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-13T19:57:45.110726] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-13T19:57:45.112126] [DEBUG] [LOCAL ] LMND: Trimmed 75341 records to 52006 (keeping 200 days of data) [2025-10-13T19:57:45.218678] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-13T19:57:45.421724] [DEBUG] [LOCAL ] LMND: Primary data saved (52006 records). [2025-10-13T19:57:45.421857] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-13T19:57:45.421936] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LMND took 34.2s. Estimated remaining: 2h 35m 53s. Rate: 7.1 symbols/min [2025-10-13T19:57:45.590877] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:45.641602] [DEBUG] [LOCAL ] LNG: Loaded 52045 existing records from primary storage. [2025-10-13T19:57:45.641936] [INFO ] [MAIN ] LNG: Loaded 52045 existing records. [2025-10-13T19:57:45.834411] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:45.838995] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-13T19:57:45.839572] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-13T19:57:45.839853] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-13T19:57:45.841664] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-13T19:57:45.842619] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-13T19:57:46.021076] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-13T19:57:46.219526] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:46.435116] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-13T19:57:46.440098] [INFO ] [REMOTE ] LMT: Full fetch complete (72347 records). [2025-10-13T19:57:46.440198] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-13T19:57:46.838346] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-13T19:57:46.867026] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-13T19:57:46.867395] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-13T19:57:46.867269] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-13T19:57:46.869341] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-13T19:57:46.869585] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-13T19:57:46.873867] [DEBUG] [LOCAL ] LMT: Trimmed 72347 records to 49667 (keeping 200 days of data) [2025-10-13T19:57:47.186598] [DEBUG] [LOCAL ] LMT: Primary data saved (49667 records). [2025-10-13T19:57:47.186759] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-13T19:57:47.186845] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LMT took 34.7s. Estimated remaining: 2h 35m 39s. Rate: 7.1 symbols/min [2025-10-13T19:57:47.350601] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:47.362725] [DEBUG] [LOCAL ] LNN: Loaded 11409 existing records from primary storage. [2025-10-13T19:57:47.362920] [INFO ] [MAIN ] LNN: Loaded 11409 existing records. [2025-10-13T19:57:47.533988] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:47.534238] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-13T19:57:47.534283] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-13T19:57:47.534569] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-13T19:57:47.534624] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-13T19:57:47.623063] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-13T19:57:47.881809] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:48.417925] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-13T19:57:49.217900] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-13T19:57:49.258966] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-13T19:57:49.512018] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-13T19:57:49.565665] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-13T19:57:49.903977] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-13T19:57:50.017982] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-13T19:57:50.813027] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-13T19:57:50.817870] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-13T19:57:50.924545] [DEBUG] [REMOTE ] LNN: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-13T19:57:50.924907] [WARN ] [REMOTE ] LNN: No data returned for month 2025-02 [2025-10-13T19:57:50.924996] [FATAL] [REMOTE ] LNN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-13T19:57:50.925071] [FATAL] [MAIN ] LNN: Failed to fetch primary data. [2025-10-13T19:57:50.925133] [WARN ] [MAIN ] LNN: Deleting existing primary and derivative data due to fetch failure. [2025-10-13T19:57:50.925199] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-13T19:57:50.925261] [DEBUG] [LOCAL ] LNN: No primary data file found to delete. [2025-10-13T19:57:50.925297] [INFO ] [LOCAL ] LNN: Starting deletion of derivative data. [2025-10-13T19:57:50.925513] [DEBUG] [LOCAL ] LNN: Deleted derivative data file. [2025-10-13T19:57:50.925596] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNN took 3.7s. Estimated remaining: 2h 35m 27s. Rate: 7.1 symbols/min [2025-10-13T19:57:51.095975] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:51.134206] [DEBUG] [LOCAL ] LOAR: Loaded 42616 existing records from primary storage. [2025-10-13T19:57:51.134486] [INFO ] [MAIN ] LOAR: Loaded 42616 existing records. [2025-10-13T19:57:51.312232] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:51.312468] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-13T19:57:51.312515] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-13T19:57:51.313569] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-13T19:57:51.313631] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-13T19:57:51.628165] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-13T19:57:51.669319] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:52.418003] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-13T19:57:53.217981] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-13T19:57:53.690325] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-13T19:57:53.947504] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-13T19:57:53.953005] [INFO ] [REMOTE ] LLY: Full fetch complete (77241 records). [2025-10-13T19:57:53.953124] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-13T19:57:54.022625] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-13T19:57:54.154017] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-13T19:57:54.395109] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-13T19:57:54.395310] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-13T19:57:54.396744] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-13T19:57:54.396812] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-13T19:57:54.398386] [DEBUG] [LOCAL ] LLY: Trimmed 77241 records to 53276 (keeping 200 days of data) [2025-10-13T19:57:54.499758] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-13T19:57:54.742866] [DEBUG] [LOCAL ] LLY: Primary data saved (53276 records). [2025-10-13T19:57:54.743002] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-13T19:57:54.743154] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LLY took 50.1s. Estimated remaining: 2h 35m 14s. Rate: 7.1 symbols/min [2025-10-13T19:57:54.823097] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-13T19:57:54.911014] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:57:54.937454] [DEBUG] [LOCAL ] LOB: Loaded 27539 existing records from primary storage. [2025-10-13T19:57:54.937766] [INFO ] [MAIN ] LOB: Loaded 27539 existing records. [2025-10-13T19:57:55.119700] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:57:55.119950] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-13T19:57:55.119997] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-13T19:57:55.120678] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-13T19:57:55.120752] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-13T19:57:55.490417] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:57:55.617920] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-13T19:57:56.417957] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-13T19:57:56.706191] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-13T19:57:56.761774] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T19:57:57.004257] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-13T19:57:57.217990] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-13T19:57:58.018029] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-13T19:57:58.607091] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-13T19:57:58.817928] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-13T19:57:59.472996] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-13T19:57:59.623871] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-13T19:57:59.637468] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-13T19:58:00.294007] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-13T19:58:00.417949] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-13T19:58:01.217919] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-13T19:58:01.450135] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-13T19:58:02.018048] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-13T19:58:02.600249] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-13T19:58:02.817964] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-13T19:58:03.336458] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-13T19:58:03.351210] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-13T19:58:03.352695] [INFO ] [REMOTE ] LND: Full fetch complete (7988 records). [2025-10-13T19:58:03.353116] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-13T19:58:03.623049] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-13T19:58:03.706124] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-13T19:58:03.706200] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-13T19:58:03.706401] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-13T19:58:03.706439] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-13T19:58:03.706853] [DEBUG] [LOCAL ] LND: Trimmed 7988 records to 5002 (keeping 200 days of data) [2025-10-13T19:58:03.736520] [DEBUG] [LOCAL ] LND: Primary data saved (5002 records). [2025-10-13T19:58:03.736636] [INFO ] [MAIN ] LND: Full history saved. [2025-10-13T19:58:03.736782] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LND took 21.4s. Estimated remaining: 2h 35m 6s. Rate: 7.1 symbols/min [2025-10-13T19:58:03.899862] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:58:03.905920] [DEBUG] [LOCAL ] LOCL: Loaded 3665 existing records from primary storage. [2025-10-13T19:58:03.906076] [INFO ] [MAIN ] LOCL: Loaded 3665 existing records. [2025-10-13T19:58:04.080172] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:58:04.080408] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-13T19:58:04.080456] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-13T19:58:04.080853] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-13T19:58:04.080912] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-13T19:58:04.422038] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-13T19:58:04.444956] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:58:04.763977] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-13T19:58:05.218037] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-13T19:58:05.828053] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-13T19:58:06.017895] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-13T19:58:06.435837] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-13T19:58:06.817911] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-13T19:58:07.242570] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-13T19:58:07.617960] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-13T19:58:07.864637] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-13T19:58:08.417969] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-13T19:58:08.999023] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-13T19:58:09.217920] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-13T19:58:10.017995] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-13T19:58:10.309472] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-13T19:58:10.757061] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-13T19:58:10.817915] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-13T19:58:10.845848] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-13T19:58:11.617967] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-13T19:58:11.975984] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-13T19:58:12.417958] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-13T19:58:12.594534] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-13T19:58:13.217965] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-13T19:58:13.553616] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-13T19:58:13.855602] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-13T19:58:14.017901] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-13T19:58:14.471274] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-13T19:58:14.817917] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-13T19:58:15.617925] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-13T19:58:16.417896] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-13T19:58:16.820433] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-13T19:58:16.846039] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-13T19:58:17.217900] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-13T19:58:17.254479] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-13T19:58:18.023019] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-13T19:58:18.030841] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-13T19:58:18.476769] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-13T19:58:18.817916] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-13T19:58:19.617899] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-13T19:58:20.325536] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-13T19:58:20.417898] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-13T19:58:21.217887] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-13T19:58:21.490150] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-13T19:58:21.547750] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-13T19:58:21.662103] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-13T19:58:22.017976] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-13T19:58:22.570871] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-13T19:58:22.817922] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-13T19:58:23.285685] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-13T19:58:23.617964] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-13T19:58:24.237781] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-13T19:58:24.417966] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-13T19:58:25.217919] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-13T19:58:25.739078] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-13T19:58:25.740536] [INFO ] [REMOTE ] LOCL: Full fetch complete (4459 records). [2025-10-13T19:58:25.740702] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-13T19:58:25.976797] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-13T19:58:26.025514] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-13T19:58:26.177622] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-13T19:58:26.177761] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-13T19:58:26.178054] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-13T19:58:26.178123] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-13T19:58:26.178574] [DEBUG] [LOCAL ] LOCL: Trimmed 4459 records to 3674 (keeping 200 days of data) [2025-10-13T19:58:26.200878] [DEBUG] [LOCAL ] LOCL: Primary data saved (3674 records). [2025-10-13T19:58:26.200993] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-13T19:58:26.201091] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOCL took 22.5s. Estimated remaining: 2h 35m 10s. Rate: 7.1 symbols/min [2025-10-13T19:58:26.381272] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:58:26.426932] [DEBUG] [LOCAL ] LOMA: Loaded 32810 existing records from primary storage. [2025-10-13T19:58:26.427340] [INFO ] [MAIN ] LOMA: Loaded 32810 existing records. [2025-10-13T19:58:26.615980] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:58:26.616288] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-13T19:58:26.616338] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-13T19:58:26.616707] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-13T19:58:26.616766] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-13T19:58:26.826965] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-13T19:58:26.996310] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:58:27.617914] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-13T19:58:27.808030] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-13T19:58:28.362158] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-13T19:58:28.422991] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-13T19:58:28.432680] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-13T19:58:29.144723] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-13T19:58:29.149925] [INFO ] [REMOTE ] LNG: Full fetch complete (74615 records). [2025-10-13T19:58:29.150055] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-13T19:58:29.223144] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-13T19:58:29.532586] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-13T19:58:29.532690] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-13T19:58:29.533633] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-13T19:58:29.533711] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-13T19:58:29.535158] [DEBUG] [LOCAL ] LNG: Trimmed 74615 records to 51287 (keeping 200 days of data) [2025-10-13T19:58:29.856346] [DEBUG] [LOCAL ] LNG: Primary data saved (51287 records). [2025-10-13T19:58:29.856480] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-13T19:58:29.856560] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LNG took 44.4s. Estimated remaining: 2h 34m 57s. Rate: 7.1 symbols/min [2025-10-13T19:58:30.021413] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-13T19:58:30.022911] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:58:30.073205] [DEBUG] [LOCAL ] LOW: Loaded 53753 existing records from primary storage. [2025-10-13T19:58:30.073541] [INFO ] [MAIN ] LOW: Loaded 53753 existing records. [2025-10-13T19:58:30.250990] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:58:30.251385] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-13T19:58:30.251447] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-13T19:58:30.252506] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-13T19:58:30.252565] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-13T19:58:30.617305] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:58:30.639282] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-13T19:58:30.817981] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-13T19:58:31.289959] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-13T19:58:31.617911] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-13T19:58:32.153683] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-13T19:58:32.157767] [INFO ] [REMOTE ] LOAR: Full fetch complete (56046 records). [2025-10-13T19:58:32.157859] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-13T19:58:32.423039] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-13T19:58:32.537889] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-13T19:58:32.538029] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-13T19:58:32.538897] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-13T19:58:32.538960] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-13T19:58:32.540115] [DEBUG] [LOCAL ] LOAR: Trimmed 56046 records to 42298 (keeping 200 days of data) [2025-10-13T19:58:32.791932] [DEBUG] [LOCAL ] LOAR: Primary data saved (42298 records). [2025-10-13T19:58:32.792062] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-13T19:58:32.792178] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOAR took 41.9s. Estimated remaining: 2h 34m 44s. Rate: 7.1 symbols/min [2025-10-13T19:58:32.962906] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:58:33.005770] [DEBUG] [LOCAL ] LPG: Loaded 40224 existing records from primary storage. [2025-10-13T19:58:33.006191] [INFO ] [MAIN ] LPG: Loaded 40224 existing records. [2025-10-13T19:58:33.171691] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-13T19:58:33.230429] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-13T19:58:33.238063] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:58:33.238525] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-13T19:58:33.238583] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-13T19:58:33.239186] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-13T19:58:33.239395] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-13T19:58:33.600321] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:58:34.017888] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-13T19:58:34.101630] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-13T19:58:34.456758] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-13T19:58:34.459732] [INFO ] [REMOTE ] LOB: Full fetch complete (38057 records). [2025-10-13T19:58:34.459810] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-13T19:58:34.825099] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-13T19:58:34.827249] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-13T19:58:34.827325] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-13T19:58:34.828049] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-13T19:58:34.828126] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-13T19:58:34.829607] [DEBUG] [LOCAL ] LOB: Trimmed 38057 records to 26773 (keeping 200 days of data) [2025-10-13T19:58:35.005736] [DEBUG] [LOCAL ] LOB: Primary data saved (26773 records). [2025-10-13T19:58:35.005934] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-13T19:58:35.006037] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOB took 40.3s. Estimated remaining: 2h 34m 30s. Rate: 7.1 symbols/min [2025-10-13T19:58:35.188941] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-03 to 2025-10-13. [2025-10-13T19:58:35.219247] [DEBUG] [LOCAL ] LPL: Loaded 28058 existing records from primary storage. [2025-10-13T19:58:35.219609] [INFO ] [MAIN ] LPL: Loaded 28058 existing records. [2025-10-13T19:58:35.415246] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-24 for 200 day retention. Performing full refresh. [2025-10-13T19:58:35.415882] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-13T19:58:35.416218] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-13T19:58:35.417004] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-13T19:58:35.417065] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-13T19:58:35.627137] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-13T19:58:35.617326] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-13T19:58:35.846276] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-24 to 2025-10-13 (requires 11 months of data pull). [2025-10-13T19:58:36.364094] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-13T19:58:36.417955] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-13T19:58:37.217908] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-13T19:58:37.552970] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-13T19:58:38.023023] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-13T19:58:38.028749] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-13T19:58:38.327005] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-13T19:58:38.817966] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-13T19:58:39.617971] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-13T19:58:39.843141] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-13T19:58:40.107387] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-13T19:58:40.418008] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-13T19:58:40.859424] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-13T19:58:41.217968] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-13T19:58:42.017912] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-13T19:58:42.247147] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-13T19:58:42.393093] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-13T19:58:42.818207] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-13T19:58:42.923008] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-13T19:58:43.618005] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-13T19:58:44.409807] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-13T19:58:44.418021] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-13T19:58:45.217929] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-13T19:58:45.400598] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-13T19:58:45.593566] [INFO ]